Aug 26 08:32:34 user nova-compute[73104]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 26 08:32:36 user nova-compute[73104]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73104) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73104) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73104) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 26 08:32:37 user nova-compute[73104]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:32:37 user nova-compute[73104]: INFO nova.virt.driver [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 26 08:32:37 user nova-compute[73104]: INFO nova.compute.provider_config [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] Acquiring lock "singleton_lock" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] Acquired lock "singleton_lock" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] Releasing lock "singleton_lock" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] Full set of CONF: {{(pid=73104) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] ******************************************************************************** {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] Configuration options gathered from: {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] ================================================================================ {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] allow_resize_to_same_host      = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] arq_binding_timeout            = 300 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] backdoor_port                  = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] backdoor_socket                = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] block_device_allocate_retries  = 300 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] block_device_allocate_retries_interval = 5 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cert                           = self.pem {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] compute_monitors               = [] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] config_dir                     = [] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] config_drive_format            = iso9660 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] config_source                  = [] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] console_host                   = user {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] control_exchange               = nova {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cpu_allocation_ratio           = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] daemon                         = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] debug                          = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] default_access_ip_network_name = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] default_availability_zone      = nova {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] default_ephemeral_format       = ext4 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] default_green_pool_size        = 1000 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] default_schedule_zone          = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] disk_allocation_ratio          = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] enable_new_services            = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] enabled_apis                   = ['osapi_compute'] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] enabled_ssl_apis               = [] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] flat_injected                  = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] force_config_drive             = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] force_raw_images               = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] graceful_shutdown_timeout      = 5 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] heal_instance_info_cache_interval = 60 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] host                           = user {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] instance_build_timeout         = 0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] instance_delete_interval       = 300 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] instance_format                = [instance: %(uuid)s]  {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] instance_name_template         = instance-%08x {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] instance_usage_audit           = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] instance_usage_audit_period    = month {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] internal_service_availability_zone = internal {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] key                            = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] live_migration_retry_count     = 30 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] log_config_append              = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] log_dir                        = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] log_file                       = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] log_options                    = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] log_rotate_interval            = 1 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] log_rotate_interval_type       = days {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] log_rotation_type              = none {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] long_rpc_timeout               = 1800 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] max_concurrent_builds          = 10 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] max_concurrent_live_migrations = 1 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] max_concurrent_snapshots       = 5 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] max_local_block_devices        = 3 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] max_logfile_count              = 30 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] max_logfile_size_mb            = 200 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] maximum_instance_delete_attempts = 5 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] metadata_listen                = 0.0.0.0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] metadata_listen_port           = 8775 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] metadata_workers               = 3 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] migrate_max_retries            = -1 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] mkisofs_cmd                    = genisoimage {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] my_ip                          = 10.0.0.210 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] network_allocate_retries       = 0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] osapi_compute_listen_port      = 8774 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] osapi_compute_unique_server_name_scope =  {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] osapi_compute_workers          = 3 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] password_length                = 12 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] periodic_enable                = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] periodic_fuzzy_delay           = 60 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] pointer_model                  = ps2mouse {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] preallocate_images             = none {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] publish_errors                 = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] pybasedir                      = /opt/stack/nova {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] ram_allocation_ratio           = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] rate_limit_burst               = 0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] rate_limit_except_level        = CRITICAL {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] rate_limit_interval            = 0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] reboot_timeout                 = 0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] reclaim_instance_interval      = 0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] record                         = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] reimage_timeout_per_gb         = 60 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] report_interval                = 120 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] rescue_timeout                 = 0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] reserved_host_cpus             = 0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] reserved_host_disk_mb          = 0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] reserved_host_memory_mb        = 512 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] reserved_huge_pages            = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] resize_confirm_window          = 0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] resize_fs_using_block_device   = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] resume_guests_state_on_host_boot = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] rpc_response_timeout           = 60 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] run_external_periodic_tasks    = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] running_deleted_instance_action = reap {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] running_deleted_instance_poll_interval = 1800 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] running_deleted_instance_timeout = 0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] scheduler_instance_sync_interval = 120 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] service_down_time              = 720 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] servicegroup_driver            = db {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] shelved_offload_time           = 0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] shelved_poll_interval          = 3600 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] shutdown_timeout               = 0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] source_is_ipv6                 = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] ssl_only                       = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] state_path                     = /opt/stack/data/nova {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] sync_power_state_interval      = 600 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] sync_power_state_pool_size     = 1000 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] syslog_log_facility            = LOG_USER {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] tempdir                        = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] timeout_nbd                    = 10 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] transport_url                  = **** {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] update_resources_interval      = 0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] use_cow_images                 = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] use_eventlog                   = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] use_journal                    = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] use_json                       = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] use_rootwrap_daemon            = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] use_stderr                     = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] use_syslog                     = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vcpu_pin_set                   = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vif_plugging_is_fatal          = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vif_plugging_timeout           = 0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] virt_mkfs                      = [] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] volume_usage_poll_interval     = 0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] watch_log_file                 = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] web                            = /usr/share/spice-html5 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_concurrency.disable_process_locking = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api.auth_strategy              = keystone {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api.compute_link_prefix        = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api.dhcp_domain                = novalocal {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api.enable_instance_password   = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api.glance_link_prefix         = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api.instance_list_per_project_cells = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api.list_records_by_skipping_down_cells = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api.local_metadata_per_cell    = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api.max_limit                  = 1000 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api.metadata_cache_expiration  = 15 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api.neutron_default_tenant_id  = default {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api.use_forwarded_for          = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api.use_neutron_default_nets   = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api.vendordata_dynamic_targets = [] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api.vendordata_jsonfile_path   = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cache.backend                  = dogpile.cache.memcached {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cache.backend_argument         = **** {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cache.config_prefix            = cache.oslo {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cache.dead_timeout             = 60.0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cache.debug_cache_backend      = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cache.enable_retry_client      = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cache.enable_socket_keepalive  = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cache.enabled                  = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cache.expiration_time          = 600 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cache.hashclient_retry_attempts = 2 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cache.memcache_dead_retry      = 300 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cache.memcache_password        =  {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cache.memcache_pool_maxsize    = 10 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cache.memcache_sasl_enabled    = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cache.memcache_username        =  {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cache.proxies                  = [] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cache.retry_attempts           = 2 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cache.retry_delay              = 0.0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cache.socket_keepalive_count   = 1 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cache.socket_keepalive_idle    = 1 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cache.socket_keepalive_interval = 1 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cache.tls_allowed_ciphers      = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cache.tls_cafile               = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cache.tls_certfile             = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cache.tls_enabled              = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cache.tls_keyfile              = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cinder.auth_section            = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cinder.auth_type               = password {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cinder.cafile                  = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cinder.certfile                = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cinder.collect_timing          = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cinder.cross_az_attach         = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cinder.debug                   = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cinder.endpoint_template       = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cinder.http_retries            = 3 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cinder.insecure                = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cinder.keyfile                 = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cinder.os_region_name          = RegionOne {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cinder.split_loggers           = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cinder.timeout                 = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] compute.cpu_dedicated_set      = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] compute.cpu_shared_set         = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] compute.image_type_exclude_list = [] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] compute.max_concurrent_disk_ops = 0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] compute.max_disk_devices_to_attach = -1 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] compute.resource_provider_association_refresh = 300 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] compute.shutdown_retry_interval = 10 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] conductor.workers              = 3 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] console.allowed_origins        = [] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] console.ssl_ciphers            = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] console.ssl_minimum_version    = default {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] consoleauth.token_ttl          = 600 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cyborg.cafile                  = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cyborg.certfile                = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cyborg.collect_timing          = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cyborg.connect_retries         = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cyborg.connect_retry_delay     = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cyborg.endpoint_override       = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cyborg.insecure                = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cyborg.keyfile                 = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cyborg.max_version             = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cyborg.min_version             = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cyborg.region_name             = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cyborg.service_name            = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cyborg.service_type            = accelerator {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cyborg.split_loggers           = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cyborg.status_code_retries     = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cyborg.status_code_retry_delay = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cyborg.timeout                 = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] cyborg.version                 = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] database.backend               = sqlalchemy {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] database.connection            = **** {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] database.connection_debug      = 0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] database.connection_parameters =  {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] database.connection_recycle_time = 3600 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] database.connection_trace      = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] database.db_inc_retry_interval = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] database.db_max_retries        = 20 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] database.db_max_retry_interval = 10 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] database.db_retry_interval     = 1 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] database.max_overflow          = 50 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] database.max_pool_size         = 5 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] database.max_retries           = 10 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] database.mysql_enable_ndb      = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] database.mysql_wsrep_sync_wait = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] database.pool_timeout          = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] database.retry_interval        = 10 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] database.slave_connection      = **** {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] database.sqlite_synchronous    = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api_database.backend           = sqlalchemy {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api_database.connection        = **** {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api_database.connection_debug  = 0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api_database.connection_parameters =  {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api_database.connection_recycle_time = 3600 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api_database.connection_trace  = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api_database.db_inc_retry_interval = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api_database.db_max_retries    = 20 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api_database.db_max_retry_interval = 10 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api_database.db_retry_interval = 1 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api_database.max_overflow      = 50 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api_database.max_pool_size     = 5 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api_database.max_retries       = 10 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api_database.mysql_enable_ndb  = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api_database.pool_timeout      = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api_database.retry_interval    = 10 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api_database.slave_connection  = **** {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] api_database.sqlite_synchronous = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] devices.enabled_mdev_types     = [] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] ephemeral_storage_encryption.enabled = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] glance.api_servers             = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] glance.cafile                  = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] glance.certfile                = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] glance.collect_timing          = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] glance.connect_retries         = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] glance.connect_retry_delay     = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] glance.debug                   = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] glance.default_trusted_certificate_ids = [] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] glance.enable_certificate_validation = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] glance.enable_rbd_download     = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] glance.endpoint_override       = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] glance.insecure                = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] glance.keyfile                 = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] glance.max_version             = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] glance.min_version             = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] glance.num_retries             = 3 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] glance.rbd_ceph_conf           =  {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] glance.rbd_connect_timeout     = 5 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] glance.rbd_pool                =  {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] glance.rbd_user                =  {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] glance.region_name             = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] glance.service_name            = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] glance.service_type            = image {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] glance.split_loggers           = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] glance.status_code_retries     = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] glance.status_code_retry_delay = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] glance.timeout                 = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] glance.verify_glance_signatures = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] glance.version                 = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] guestfs.debug                  = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] hyperv.config_drive_cdrom      = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] hyperv.config_drive_inject_password = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] hyperv.enable_instance_metrics_collection = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] hyperv.enable_remotefx         = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] hyperv.instances_path_share    =  {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] hyperv.iscsi_initiator_list    = [] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] hyperv.limit_cpu_features      = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] hyperv.power_state_check_timeframe = 60 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] hyperv.use_multipath_io        = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] hyperv.volume_attach_retry_count = 10 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] hyperv.vswitch_name            = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] mks.enabled                    = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] image_cache.manager_interval   = 2400 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] image_cache.precache_concurrency = 1 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] image_cache.remove_unused_base_images = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] image_cache.subdirectory_name  = _base {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] ironic.api_max_retries         = 60 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] ironic.api_retry_interval      = 2 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] ironic.auth_section            = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] ironic.auth_type               = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] ironic.cafile                  = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] ironic.certfile                = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] ironic.collect_timing          = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] ironic.connect_retries         = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] ironic.connect_retry_delay     = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] ironic.endpoint_override       = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] ironic.insecure                = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] ironic.keyfile                 = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] ironic.max_version             = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] ironic.min_version             = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] ironic.partition_key           = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] ironic.peer_list               = [] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] ironic.region_name             = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] ironic.serial_console_state_timeout = 10 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] ironic.service_name            = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] ironic.service_type            = baremetal {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] ironic.split_loggers           = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] ironic.status_code_retries     = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] ironic.status_code_retry_delay = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] ironic.timeout                 = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] ironic.version                 = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] key_manager.fixed_key          = **** {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] barbican.barbican_api_version  = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] barbican.barbican_endpoint     = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] barbican.barbican_endpoint_type = public {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] barbican.barbican_region_name  = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] barbican.cafile                = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] barbican.certfile              = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] barbican.collect_timing        = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] barbican.insecure              = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] barbican.keyfile               = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] barbican.number_of_retries     = 60 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] barbican.retry_delay           = 1 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] barbican.send_service_user_token = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] barbican.split_loggers         = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] barbican.timeout               = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] barbican.verify_ssl            = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] barbican.verify_ssl_path       = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] barbican_service_user.auth_section = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] barbican_service_user.auth_type = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] barbican_service_user.cafile   = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] barbican_service_user.certfile = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] barbican_service_user.collect_timing = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] barbican_service_user.insecure = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] barbican_service_user.keyfile  = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] barbican_service_user.split_loggers = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] barbican_service_user.timeout  = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vault.approle_role_id          = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vault.approle_secret_id        = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vault.cafile                   = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vault.certfile                 = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vault.collect_timing           = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vault.insecure                 = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vault.keyfile                  = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vault.kv_mountpoint            = secret {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vault.kv_version               = 2 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vault.namespace                = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vault.root_token_id            = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vault.split_loggers            = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vault.ssl_ca_crt_file          = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vault.timeout                  = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vault.use_ssl                  = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] keystone.cafile                = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] keystone.certfile              = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] keystone.collect_timing        = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] keystone.connect_retries       = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] keystone.connect_retry_delay   = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] keystone.endpoint_override     = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] keystone.insecure              = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] keystone.keyfile               = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] keystone.max_version           = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] keystone.min_version           = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] keystone.region_name           = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] keystone.service_name          = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] keystone.service_type          = identity {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] keystone.split_loggers         = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] keystone.status_code_retries   = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] keystone.status_code_retry_delay = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] keystone.timeout               = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] keystone.version               = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.connection_uri         =  {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.cpu_mode               = custom {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: WARNING oslo_config.cfg [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.cpu_power_governor_high = performance {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.cpu_power_governor_low = powersave {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.cpu_power_management   = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.device_detach_attempts = 8 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.device_detach_timeout  = 20 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.disk_cachemodes        = [] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.disk_prefix            = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.enabled_perf_events    = [] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.file_backed_memory     = 0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.gid_maps               = [] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.hw_disk_discard        = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.hw_machine_type        = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.images_rbd_glance_store_name =  {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.images_rbd_pool        = rbd {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.images_type            = default {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.images_volume_group    = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.inject_key             = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.inject_partition       = -2 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.inject_password        = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.iscsi_iface            = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.iser_use_multipath     = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.live_migration_bandwidth = 0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.live_migration_downtime = 500 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.live_migration_inbound_addr = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.live_migration_permit_post_copy = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.live_migration_scheme  = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.live_migration_timeout_action = abort {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.live_migration_tunnelled = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: WARNING oslo_config.cfg [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 26 08:32:37 user nova-compute[73104]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 26 08:32:37 user nova-compute[73104]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 26 08:32:37 user nova-compute[73104]: and ``live_migration_inbound_addr`` respectively.
Aug 26 08:32:37 user nova-compute[73104]: ).  Its value may be silently ignored in the future.
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.live_migration_with_native_tls = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.max_queues             = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.nfs_mount_options      = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.num_memory_encrypted_guests = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.num_pcie_ports         = 0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.pmem_namespaces        = [] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.quobyte_client_cfg     = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.rbd_secret_uuid        = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.rbd_user               = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.remote_filesystem_transport = ssh {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.rescue_image_id        = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.rescue_kernel_id       = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.rescue_ramdisk_id      = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.rx_queue_size          = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.smbfs_mount_options    =  {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.snapshot_compression   = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.snapshot_image_format  = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.sparse_logical_volumes = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.swtpm_enabled          = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.swtpm_group            = tss {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.swtpm_user             = tss {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.sysinfo_serial         = unique {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.tb_cache_size          = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.tx_queue_size          = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.uid_maps               = [] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.use_virtio_for_bridges = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.virt_type              = kvm {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.volume_clear           = zero {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.volume_clear_size      = 0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.volume_use_multipath   = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.vzstorage_cache_path   = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.vzstorage_mount_user   = stack {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] neutron.auth_section           = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] neutron.auth_type              = password {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] neutron.cafile                 = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] neutron.certfile               = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] neutron.collect_timing         = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] neutron.connect_retries        = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] neutron.connect_retry_delay    = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] neutron.default_floating_pool  = public {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] neutron.endpoint_override      = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] neutron.extension_sync_interval = 600 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] neutron.http_retries           = 3 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] neutron.insecure               = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] neutron.keyfile                = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] neutron.max_version            = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] neutron.min_version            = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] neutron.ovs_bridge             = br-int {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] neutron.physnets               = [] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] neutron.region_name            = RegionOne {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] neutron.service_metadata_proxy = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] neutron.service_name           = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] neutron.service_type           = network {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] neutron.split_loggers          = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] neutron.status_code_retries    = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] neutron.status_code_retry_delay = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] neutron.timeout                = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] neutron.version                = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] notifications.bdms_in_notifications = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] notifications.default_level    = INFO {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] notifications.notification_format = unversioned {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] notifications.notify_on_state_change = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] pci.alias                      = [] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] pci.device_spec                = [] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] pci.report_in_placement        = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.auth_section         = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.auth_type            = password {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.cafile               = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.certfile             = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.collect_timing       = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.connect_retries      = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.connect_retry_delay  = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.default_domain_id    = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.default_domain_name  = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.domain_id            = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.domain_name          = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.endpoint_override    = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.insecure             = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.keyfile              = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.max_version          = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.min_version          = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.password             = **** {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.project_domain_id    = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.project_domain_name  = Default {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.project_id           = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.project_name         = service {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.region_name          = RegionOne {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.service_name         = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.service_type         = placement {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.split_loggers        = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.status_code_retries  = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.status_code_retry_delay = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.system_scope         = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.timeout              = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.trust_id             = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.user_domain_id       = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.user_domain_name     = Default {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.user_id              = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.username             = placement {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] placement.version              = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] quota.cores                    = 20 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] quota.count_usage_from_placement = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] quota.injected_file_content_bytes = 10240 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] quota.injected_file_path_length = 255 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] quota.injected_files           = 5 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] quota.instances                = 10 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] quota.key_pairs                = 100 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] quota.metadata_items           = 128 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] quota.ram                      = 51200 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] quota.recheck_quota            = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] quota.server_group_members     = 10 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] quota.server_groups            = 10 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] rdp.enabled                    = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] scheduler.image_metadata_prefilter = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] scheduler.max_attempts         = 3 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] scheduler.max_placement_results = 1000 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] scheduler.query_placement_for_availability_zone = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] scheduler.query_placement_for_image_type_support = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] scheduler.workers              = 3 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] filter_scheduler.host_subset_size = 1 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] filter_scheduler.isolated_hosts = [] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] filter_scheduler.isolated_images = [] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] filter_scheduler.pci_in_placement = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] filter_scheduler.track_instance_changes = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] metrics.required               = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] metrics.weight_multiplier      = 1.0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] metrics.weight_setting         = [] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] serial_console.enabled         = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] serial_console.port_range      = 10000:20000 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] serial_console.serialproxy_port = 6083 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] service_user.auth_section      = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] service_user.auth_type         = password {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] service_user.cafile            = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] service_user.certfile          = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] service_user.collect_timing    = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] service_user.insecure          = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] service_user.keyfile           = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] service_user.send_service_user_token = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] service_user.split_loggers     = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] service_user.timeout           = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] spice.agent_enabled            = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] spice.enabled                  = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] spice.html5proxy_port          = 6082 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] spice.image_compression        = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] spice.jpeg_compression         = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] spice.playback_compression     = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] spice.server_listen            = 127.0.0.1 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] spice.streaming_mode           = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] spice.zlib_compression         = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] upgrade_levels.baseapi         = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] upgrade_levels.cert            = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] upgrade_levels.compute         = auto {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] upgrade_levels.conductor       = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] upgrade_levels.scheduler       = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vendordata_dynamic_auth.auth_section = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vendordata_dynamic_auth.auth_type = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vendordata_dynamic_auth.cafile = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vendordata_dynamic_auth.certfile = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vendordata_dynamic_auth.insecure = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vendordata_dynamic_auth.keyfile = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vendordata_dynamic_auth.timeout = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vmware.api_retry_count         = 10 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vmware.ca_file                 = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vmware.cache_prefix            = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vmware.cluster_name            = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vmware.connection_pool_size    = 10 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vmware.console_delay_seconds   = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vmware.datastore_regex         = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vmware.host_ip                 = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vmware.host_password           = **** {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vmware.host_port               = 443 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vmware.host_username           = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vmware.insecure                = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vmware.integration_bridge      = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vmware.maximum_objects         = 100 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vmware.pbm_default_policy      = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vmware.pbm_enabled             = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vmware.pbm_wsdl_location       = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vmware.serial_port_proxy_uri   = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vmware.serial_port_service_uri = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vmware.task_poll_interval      = 0.5 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vmware.use_linked_clone        = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vmware.vnc_keymap              = en-us {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vmware.vnc_port                = 5900 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vmware.vnc_port_total          = 10000 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vnc.auth_schemes               = ['none'] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vnc.enabled                    = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vnc.novncproxy_port            = 6080 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vnc.server_listen              = 0.0.0.0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vnc.vencrypt_ca_certs          = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vnc.vencrypt_client_cert       = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vnc.vencrypt_client_key        = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] workarounds.disable_rootwrap   = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] workarounds.enable_numa_live_migration = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] workarounds.libvirt_disable_apic = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] wsgi.client_socket_timeout     = 900 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] wsgi.default_pool_size         = 1000 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] wsgi.keep_alive                = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] wsgi.max_header_line           = 16384 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] wsgi.ssl_ca_file               = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] wsgi.ssl_cert_file             = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] wsgi.ssl_key_file              = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] wsgi.tcp_keepidle              = 600 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] zvm.ca_file                    = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] zvm.cloud_connector_url        = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] zvm.reachable_timeout          = 300 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_policy.enforce_new_defaults = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_policy.enforce_scope      = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_policy.policy_default_rule = default {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_policy.policy_file        = policy.yaml {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] profiler.connection_string     = messaging:// {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] profiler.enabled               = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] profiler.es_doc_type           = notification {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] profiler.es_scroll_size        = 10000 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] profiler.es_scroll_time        = 2m {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] profiler.filter_error_trace    = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] profiler.hmac_keys             = **** {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] profiler.sentinel_service_name = mymaster {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] profiler.socket_timeout        = 0.1 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] profiler.trace_requests        = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] profiler.trace_sqlalchemy      = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] profiler_jaeger.process_tags   = {} {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] profiler_jaeger.service_name_prefix = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] profiler_otlp.service_name_prefix = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] remote_debug.host              = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] remote_debug.port              = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_rabbit.ssl      = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_notifications.retry = -1 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_messaging_notifications.transport_url = **** {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_limit.auth_section        = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_limit.auth_type           = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_limit.cafile              = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_limit.certfile            = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_limit.collect_timing      = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_limit.connect_retries     = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_limit.connect_retry_delay = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_limit.endpoint_id         = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_limit.endpoint_override   = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_limit.insecure            = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_limit.keyfile             = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_limit.max_version         = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_limit.min_version         = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_limit.region_name         = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_limit.service_name        = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_limit.service_type        = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_limit.split_loggers       = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_limit.status_code_retries = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_limit.status_code_retry_delay = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_limit.timeout             = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_limit.valid_interfaces    = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_limit.version             = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_reports.file_event_handler = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] oslo_reports.log_dir           = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vif_plug_ovs_privileged.group  = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] vif_plug_ovs_privileged.user   = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] os_vif_linux_bridge.flat_interface = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] os_vif_ovs.isolate_vif         = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] os_vif_ovs.per_port_bridge     = False {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] os_brick.lock_path             = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] privsep_osbrick.capabilities   = [21] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] privsep_osbrick.group          = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] privsep_osbrick.helper_command = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] privsep_osbrick.user           = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] nova_sys_admin.group           = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] nova_sys_admin.helper_command  = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] nova_sys_admin.user            = None {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG oslo_service.service [None req-cb7d81e1-a9da-45f8-80a4-628dea219ccf None None] ******************************************************************************** {{(pid=73104) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 26 08:32:37 user nova-compute[73104]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 26 08:32:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Starting native event thread {{(pid=73104) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Starting green dispatch thread {{(pid=73104) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Starting connection event dispatch thread {{(pid=73104) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Connecting to libvirt: qemu:///system {{(pid=73104) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fd0cdbfe7d0> {{(pid=73104) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Aug 26 08:32:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fd0cdbfe7d0> {{(pid=73104) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Aug 26 08:32:37 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Connection event '1' reason 'None'
Aug 26 08:32:37 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 26 08:32:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.mount [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Initialising _HostMountState generation 0 {{(pid=73104) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 26 08:32:45 user nova-compute[73104]: INFO nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Libvirt host capabilities <capabilities>
Aug 26 08:32:45 user nova-compute[73104]:   <host>
Aug 26 08:32:45 user nova-compute[73104]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 26 08:32:45 user nova-compute[73104]:     <cpu>
Aug 26 08:32:45 user nova-compute[73104]:       <arch>x86_64</arch>
Aug 26 08:32:45 user nova-compute[73104]:       <model>IvyBridge-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <vendor>Intel</vendor>
Aug 26 08:32:45 user nova-compute[73104]:       <microcode version='1070'/>
Aug 26 08:32:45 user nova-compute[73104]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 26 08:32:45 user nova-compute[73104]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature name='ss'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature name='vmx'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature name='pcid'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature name='osxsave'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature name='hypervisor'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature name='arat'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature name='tsc_adjust'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature name='md-clear'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature name='stibp'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature name='arch-capabilities'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature name='ssbd'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature name='invtsc'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature name='rsba'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature name='skip-l1dfl-vmentry'/>
Aug 26 08:32:45 user nova-compute[73104]:       <pages unit='KiB' size='4'/>
Aug 26 08:32:45 user nova-compute[73104]:       <pages unit='KiB' size='2048'/>
Aug 26 08:32:45 user nova-compute[73104]:     </cpu>
Aug 26 08:32:45 user nova-compute[73104]:     <power_management>
Aug 26 08:32:45 user nova-compute[73104]:       <suspend_mem/>
Aug 26 08:32:45 user nova-compute[73104]:       <suspend_disk/>
Aug 26 08:32:45 user nova-compute[73104]:       <suspend_hybrid/>
Aug 26 08:32:45 user nova-compute[73104]:     </power_management>
Aug 26 08:32:45 user nova-compute[73104]:     <iommu support='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     <migration_features>
Aug 26 08:32:45 user nova-compute[73104]:       <live/>
Aug 26 08:32:45 user nova-compute[73104]:       <uri_transports>
Aug 26 08:32:45 user nova-compute[73104]:         <uri_transport>tcp</uri_transport>
Aug 26 08:32:45 user nova-compute[73104]:         <uri_transport>rdma</uri_transport>
Aug 26 08:32:45 user nova-compute[73104]:       </uri_transports>
Aug 26 08:32:45 user nova-compute[73104]:     </migration_features>
Aug 26 08:32:45 user nova-compute[73104]:     <topology>
Aug 26 08:32:45 user nova-compute[73104]:       <cells num='2'>
Aug 26 08:32:45 user nova-compute[73104]:         <cell id='0'>
Aug 26 08:32:45 user nova-compute[73104]:           <memory unit='KiB'>8189224</memory>
Aug 26 08:32:45 user nova-compute[73104]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 26 08:32:45 user nova-compute[73104]:           <pages unit='KiB' size='2048'>0</pages>
Aug 26 08:32:45 user nova-compute[73104]:           <distances>
Aug 26 08:32:45 user nova-compute[73104]:             <sibling id='0' value='10'/>
Aug 26 08:32:45 user nova-compute[73104]:             <sibling id='1' value='20'/>
Aug 26 08:32:45 user nova-compute[73104]:           </distances>
Aug 26 08:32:45 user nova-compute[73104]:           <cpus num='6'>
Aug 26 08:32:45 user nova-compute[73104]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 26 08:32:45 user nova-compute[73104]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 26 08:32:45 user nova-compute[73104]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 26 08:32:45 user nova-compute[73104]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 26 08:32:45 user nova-compute[73104]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 26 08:32:45 user nova-compute[73104]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 26 08:32:45 user nova-compute[73104]:           </cpus>
Aug 26 08:32:45 user nova-compute[73104]:         </cell>
Aug 26 08:32:45 user nova-compute[73104]:         <cell id='1'>
Aug 26 08:32:45 user nova-compute[73104]:           <memory unit='KiB'>8206460</memory>
Aug 26 08:32:45 user nova-compute[73104]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 26 08:32:45 user nova-compute[73104]:           <pages unit='KiB' size='2048'>0</pages>
Aug 26 08:32:45 user nova-compute[73104]:           <distances>
Aug 26 08:32:45 user nova-compute[73104]:             <sibling id='0' value='20'/>
Aug 26 08:32:45 user nova-compute[73104]:             <sibling id='1' value='10'/>
Aug 26 08:32:45 user nova-compute[73104]:           </distances>
Aug 26 08:32:45 user nova-compute[73104]:           <cpus num='6'>
Aug 26 08:32:45 user nova-compute[73104]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 26 08:32:45 user nova-compute[73104]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 26 08:32:45 user nova-compute[73104]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 26 08:32:45 user nova-compute[73104]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 26 08:32:45 user nova-compute[73104]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 26 08:32:45 user nova-compute[73104]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 26 08:32:45 user nova-compute[73104]:           </cpus>
Aug 26 08:32:45 user nova-compute[73104]:         </cell>
Aug 26 08:32:45 user nova-compute[73104]:       </cells>
Aug 26 08:32:45 user nova-compute[73104]:     </topology>
Aug 26 08:32:45 user nova-compute[73104]:     <cache>
Aug 26 08:32:45 user nova-compute[73104]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 26 08:32:45 user nova-compute[73104]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 26 08:32:45 user nova-compute[73104]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 26 08:32:45 user nova-compute[73104]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 26 08:32:45 user nova-compute[73104]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 26 08:32:45 user nova-compute[73104]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 26 08:32:45 user nova-compute[73104]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 26 08:32:45 user nova-compute[73104]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 26 08:32:45 user nova-compute[73104]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 26 08:32:45 user nova-compute[73104]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 26 08:32:45 user nova-compute[73104]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 26 08:32:45 user nova-compute[73104]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 26 08:32:45 user nova-compute[73104]:     </cache>
Aug 26 08:32:45 user nova-compute[73104]:     <secmodel>
Aug 26 08:32:45 user nova-compute[73104]:       <model>apparmor</model>
Aug 26 08:32:45 user nova-compute[73104]:       <doi>0</doi>
Aug 26 08:32:45 user nova-compute[73104]:     </secmodel>
Aug 26 08:32:45 user nova-compute[73104]:     <secmodel>
Aug 26 08:32:45 user nova-compute[73104]:       <model>dac</model>
Aug 26 08:32:45 user nova-compute[73104]:       <doi>0</doi>
Aug 26 08:32:45 user nova-compute[73104]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 26 08:32:45 user nova-compute[73104]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 26 08:32:45 user nova-compute[73104]:     </secmodel>
Aug 26 08:32:45 user nova-compute[73104]:   </host>
Aug 26 08:32:45 user nova-compute[73104]:   <guest>
Aug 26 08:32:45 user nova-compute[73104]:     <os_type>hvm</os_type>
Aug 26 08:32:45 user nova-compute[73104]:     <arch name='alpha'>
Aug 26 08:32:45 user nova-compute[73104]:       <wordsize>64</wordsize>
Aug 26 08:32:45 user nova-compute[73104]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>clipper</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <domain type='qemu'/>
Aug 26 08:32:45 user nova-compute[73104]:     </arch>
Aug 26 08:32:45 user nova-compute[73104]:     <features>
Aug 26 08:32:45 user nova-compute[73104]:       <cpuselection/>
Aug 26 08:32:45 user nova-compute[73104]:       <deviceboot/>
Aug 26 08:32:45 user nova-compute[73104]:       <disksnapshot default='on' toggle='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     </features>
Aug 26 08:32:45 user nova-compute[73104]:   </guest>
Aug 26 08:32:45 user nova-compute[73104]:   <guest>
Aug 26 08:32:45 user nova-compute[73104]:     <os_type>hvm</os_type>
Aug 26 08:32:45 user nova-compute[73104]:     <arch name='armv6l'>
Aug 26 08:32:45 user nova-compute[73104]:       <wordsize>32</wordsize>
Aug 26 08:32:45 user nova-compute[73104]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>integratorcp</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>borzoi</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>spitz</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>nuri</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>musca-b1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>versatileab</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>kzm</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>musca-a</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>smdkc210</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>sx1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>z2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>tosa</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>sabrelite</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>realview-eb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>n810</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>n800</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>versatilepb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>terrier</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>mainstone</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>midway</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>musicpal</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>microbit</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>cubieboard</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>verdex</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>netduino2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>raspi2b</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>cheetah</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>highbank</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>akita</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>connex</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>collie</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>raspi0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <domain type='qemu'/>
Aug 26 08:32:45 user nova-compute[73104]:     </arch>
Aug 26 08:32:45 user nova-compute[73104]:     <features>
Aug 26 08:32:45 user nova-compute[73104]:       <cpuselection/>
Aug 26 08:32:45 user nova-compute[73104]:       <deviceboot/>
Aug 26 08:32:45 user nova-compute[73104]:       <disksnapshot default='on' toggle='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     </features>
Aug 26 08:32:45 user nova-compute[73104]:   </guest>
Aug 26 08:32:45 user nova-compute[73104]:   <guest>
Aug 26 08:32:45 user nova-compute[73104]:     <os_type>hvm</os_type>
Aug 26 08:32:45 user nova-compute[73104]:     <arch name='armv7l'>
Aug 26 08:32:45 user nova-compute[73104]:       <wordsize>32</wordsize>
Aug 26 08:32:45 user nova-compute[73104]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>integratorcp</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>borzoi</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>spitz</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>nuri</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>musca-b1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>versatileab</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>kzm</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>musca-a</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>smdkc210</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>sx1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>z2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>tosa</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>sabrelite</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>realview-eb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>n810</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>n800</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>versatilepb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>terrier</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>mainstone</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>midway</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>musicpal</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>microbit</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>cubieboard</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>verdex</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>netduino2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>raspi2b</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>cheetah</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>highbank</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>akita</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>connex</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>collie</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>raspi0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <domain type='qemu'/>
Aug 26 08:32:45 user nova-compute[73104]:     </arch>
Aug 26 08:32:45 user nova-compute[73104]:     <features>
Aug 26 08:32:45 user nova-compute[73104]:       <cpuselection/>
Aug 26 08:32:45 user nova-compute[73104]:       <deviceboot/>
Aug 26 08:32:45 user nova-compute[73104]:       <disksnapshot default='on' toggle='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     </features>
Aug 26 08:32:45 user nova-compute[73104]:   </guest>
Aug 26 08:32:45 user nova-compute[73104]:   <guest>
Aug 26 08:32:45 user nova-compute[73104]:     <os_type>hvm</os_type>
Aug 26 08:32:45 user nova-compute[73104]:     <arch name='aarch64'>
Aug 26 08:32:45 user nova-compute[73104]:       <wordsize>64</wordsize>
Aug 26 08:32:45 user nova-compute[73104]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>integratorcp</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>borzoi</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>spitz</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>nuri</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>musca-b1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>versatileab</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>kzm</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>musca-a</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>smdkc210</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>sx1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>z2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>tosa</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>sabrelite</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>realview-eb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>n810</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>n800</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>versatilepb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>terrier</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>mainstone</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>midway</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>musicpal</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>microbit</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>cubieboard</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>verdex</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>netduino2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>raspi3b</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>raspi2b</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>cheetah</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>highbank</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>akita</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>connex</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>collie</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>raspi0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <domain type='qemu'/>
Aug 26 08:32:45 user nova-compute[73104]:     </arch>
Aug 26 08:32:45 user nova-compute[73104]:     <features>
Aug 26 08:32:45 user nova-compute[73104]:       <acpi default='on' toggle='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:       <cpuselection/>
Aug 26 08:32:45 user nova-compute[73104]:       <deviceboot/>
Aug 26 08:32:45 user nova-compute[73104]:       <disksnapshot default='on' toggle='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     </features>
Aug 26 08:32:45 user nova-compute[73104]:   </guest>
Aug 26 08:32:45 user nova-compute[73104]:   <guest>
Aug 26 08:32:45 user nova-compute[73104]:     <os_type>hvm</os_type>
Aug 26 08:32:45 user nova-compute[73104]:     <arch name='cris'>
Aug 26 08:32:45 user nova-compute[73104]:       <wordsize>32</wordsize>
Aug 26 08:32:45 user nova-compute[73104]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <domain type='qemu'/>
Aug 26 08:32:45 user nova-compute[73104]:     </arch>
Aug 26 08:32:45 user nova-compute[73104]:     <features>
Aug 26 08:32:45 user nova-compute[73104]:       <cpuselection/>
Aug 26 08:32:45 user nova-compute[73104]:       <deviceboot/>
Aug 26 08:32:45 user nova-compute[73104]:       <disksnapshot default='on' toggle='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     </features>
Aug 26 08:32:45 user nova-compute[73104]:   </guest>
Aug 26 08:32:45 user nova-compute[73104]:   <guest>
Aug 26 08:32:45 user nova-compute[73104]:     <os_type>hvm</os_type>
Aug 26 08:32:45 user nova-compute[73104]:     <arch name='i686'>
Aug 26 08:32:45 user nova-compute[73104]:       <wordsize>32</wordsize>
Aug 26 08:32:45 user nova-compute[73104]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>x-remote</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>isapc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>microvm</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <domain type='qemu'/>
Aug 26 08:32:45 user nova-compute[73104]:       <domain type='kvm'/>
Aug 26 08:32:45 user nova-compute[73104]:     </arch>
Aug 26 08:32:45 user nova-compute[73104]:     <features>
Aug 26 08:32:45 user nova-compute[73104]:       <pae/>
Aug 26 08:32:45 user nova-compute[73104]:       <nonpae/>
Aug 26 08:32:45 user nova-compute[73104]:       <acpi default='on' toggle='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:       <apic default='on' toggle='no'/>
Aug 26 08:32:45 user nova-compute[73104]:       <cpuselection/>
Aug 26 08:32:45 user nova-compute[73104]:       <deviceboot/>
Aug 26 08:32:45 user nova-compute[73104]:       <disksnapshot default='on' toggle='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     </features>
Aug 26 08:32:45 user nova-compute[73104]:   </guest>
Aug 26 08:32:45 user nova-compute[73104]:   <guest>
Aug 26 08:32:45 user nova-compute[73104]:     <os_type>hvm</os_type>
Aug 26 08:32:45 user nova-compute[73104]:     <arch name='m68k'>
Aug 26 08:32:45 user nova-compute[73104]:       <wordsize>32</wordsize>
Aug 26 08:32:45 user nova-compute[73104]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>an5206</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>q800</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>next-cube</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <domain type='qemu'/>
Aug 26 08:32:45 user nova-compute[73104]:     </arch>
Aug 26 08:32:45 user nova-compute[73104]:     <features>
Aug 26 08:32:45 user nova-compute[73104]:       <cpuselection/>
Aug 26 08:32:45 user nova-compute[73104]:       <deviceboot/>
Aug 26 08:32:45 user nova-compute[73104]:       <disksnapshot default='on' toggle='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     </features>
Aug 26 08:32:45 user nova-compute[73104]:   </guest>
Aug 26 08:32:45 user nova-compute[73104]:   <guest>
Aug 26 08:32:45 user nova-compute[73104]:     <os_type>hvm</os_type>
Aug 26 08:32:45 user nova-compute[73104]:     <arch name='microblaze'>
Aug 26 08:32:45 user nova-compute[73104]:       <wordsize>32</wordsize>
Aug 26 08:32:45 user nova-compute[73104]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <domain type='qemu'/>
Aug 26 08:32:45 user nova-compute[73104]:     </arch>
Aug 26 08:32:45 user nova-compute[73104]:     <features>
Aug 26 08:32:45 user nova-compute[73104]:       <cpuselection/>
Aug 26 08:32:45 user nova-compute[73104]:       <deviceboot/>
Aug 26 08:32:45 user nova-compute[73104]:       <disksnapshot default='on' toggle='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     </features>
Aug 26 08:32:45 user nova-compute[73104]:   </guest>
Aug 26 08:32:45 user nova-compute[73104]:   <guest>
Aug 26 08:32:45 user nova-compute[73104]:     <os_type>hvm</os_type>
Aug 26 08:32:45 user nova-compute[73104]:     <arch name='microblazeel'>
Aug 26 08:32:45 user nova-compute[73104]:       <wordsize>32</wordsize>
Aug 26 08:32:45 user nova-compute[73104]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <domain type='qemu'/>
Aug 26 08:32:45 user nova-compute[73104]:     </arch>
Aug 26 08:32:45 user nova-compute[73104]:     <features>
Aug 26 08:32:45 user nova-compute[73104]:       <cpuselection/>
Aug 26 08:32:45 user nova-compute[73104]:       <deviceboot/>
Aug 26 08:32:45 user nova-compute[73104]:       <disksnapshot default='on' toggle='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     </features>
Aug 26 08:32:45 user nova-compute[73104]:   </guest>
Aug 26 08:32:45 user nova-compute[73104]:   <guest>
Aug 26 08:32:45 user nova-compute[73104]:     <os_type>hvm</os_type>
Aug 26 08:32:45 user nova-compute[73104]:     <arch name='mips'>
Aug 26 08:32:45 user nova-compute[73104]:       <wordsize>32</wordsize>
Aug 26 08:32:45 user nova-compute[73104]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='16'>malta</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <domain type='qemu'/>
Aug 26 08:32:45 user nova-compute[73104]:     </arch>
Aug 26 08:32:45 user nova-compute[73104]:     <features>
Aug 26 08:32:45 user nova-compute[73104]:       <cpuselection/>
Aug 26 08:32:45 user nova-compute[73104]:       <deviceboot/>
Aug 26 08:32:45 user nova-compute[73104]:       <disksnapshot default='on' toggle='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     </features>
Aug 26 08:32:45 user nova-compute[73104]:   </guest>
Aug 26 08:32:45 user nova-compute[73104]:   <guest>
Aug 26 08:32:45 user nova-compute[73104]:     <os_type>hvm</os_type>
Aug 26 08:32:45 user nova-compute[73104]:     <arch name='mipsel'>
Aug 26 08:32:45 user nova-compute[73104]:       <wordsize>32</wordsize>
Aug 26 08:32:45 user nova-compute[73104]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='16'>malta</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <domain type='qemu'/>
Aug 26 08:32:45 user nova-compute[73104]:     </arch>
Aug 26 08:32:45 user nova-compute[73104]:     <features>
Aug 26 08:32:45 user nova-compute[73104]:       <cpuselection/>
Aug 26 08:32:45 user nova-compute[73104]:       <deviceboot/>
Aug 26 08:32:45 user nova-compute[73104]:       <disksnapshot default='on' toggle='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     </features>
Aug 26 08:32:45 user nova-compute[73104]:   </guest>
Aug 26 08:32:45 user nova-compute[73104]:   <guest>
Aug 26 08:32:45 user nova-compute[73104]:     <os_type>hvm</os_type>
Aug 26 08:32:45 user nova-compute[73104]:     <arch name='mips64'>
Aug 26 08:32:45 user nova-compute[73104]:       <wordsize>64</wordsize>
Aug 26 08:32:45 user nova-compute[73104]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='16'>malta</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>pica61</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>magnum</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <domain type='qemu'/>
Aug 26 08:32:45 user nova-compute[73104]:     </arch>
Aug 26 08:32:45 user nova-compute[73104]:     <features>
Aug 26 08:32:45 user nova-compute[73104]:       <cpuselection/>
Aug 26 08:32:45 user nova-compute[73104]:       <deviceboot/>
Aug 26 08:32:45 user nova-compute[73104]:       <disksnapshot default='on' toggle='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     </features>
Aug 26 08:32:45 user nova-compute[73104]:   </guest>
Aug 26 08:32:45 user nova-compute[73104]:   <guest>
Aug 26 08:32:45 user nova-compute[73104]:     <os_type>hvm</os_type>
Aug 26 08:32:45 user nova-compute[73104]:     <arch name='mips64el'>
Aug 26 08:32:45 user nova-compute[73104]:       <wordsize>64</wordsize>
Aug 26 08:32:45 user nova-compute[73104]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='16'>malta</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>pica61</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>magnum</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='16'>boston</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <domain type='qemu'/>
Aug 26 08:32:45 user nova-compute[73104]:     </arch>
Aug 26 08:32:45 user nova-compute[73104]:     <features>
Aug 26 08:32:45 user nova-compute[73104]:       <cpuselection/>
Aug 26 08:32:45 user nova-compute[73104]:       <deviceboot/>
Aug 26 08:32:45 user nova-compute[73104]:       <disksnapshot default='on' toggle='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     </features>
Aug 26 08:32:45 user nova-compute[73104]:   </guest>
Aug 26 08:32:45 user nova-compute[73104]:   <guest>
Aug 26 08:32:45 user nova-compute[73104]:     <os_type>hvm</os_type>
Aug 26 08:32:45 user nova-compute[73104]:     <arch name='ppc'>
Aug 26 08:32:45 user nova-compute[73104]:       <wordsize>32</wordsize>
Aug 26 08:32:45 user nova-compute[73104]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>g3beige</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>mac99</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='32'>ppce500</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>pegasos2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>sam460ex</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>bamboo</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>40p</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>ref405ep</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>taihu</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <domain type='qemu'/>
Aug 26 08:32:45 user nova-compute[73104]:     </arch>
Aug 26 08:32:45 user nova-compute[73104]:     <features>
Aug 26 08:32:45 user nova-compute[73104]:       <cpuselection/>
Aug 26 08:32:45 user nova-compute[73104]:       <deviceboot/>
Aug 26 08:32:45 user nova-compute[73104]:       <disksnapshot default='on' toggle='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     </features>
Aug 26 08:32:45 user nova-compute[73104]:   </guest>
Aug 26 08:32:45 user nova-compute[73104]:   <guest>
Aug 26 08:32:45 user nova-compute[73104]:     <os_type>hvm</os_type>
Aug 26 08:32:45 user nova-compute[73104]:     <arch name='ppc64'>
Aug 26 08:32:45 user nova-compute[73104]:       <wordsize>64</wordsize>
Aug 26 08:32:45 user nova-compute[73104]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2048'>powernv9</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>taihu</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2048'>powernv10</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='32'>ppce500</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>40p</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>pegasos2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>bamboo</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>g3beige</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>mac99</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>sam460ex</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>ref405ep</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2048'>powernv8</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <domain type='qemu'/>
Aug 26 08:32:45 user nova-compute[73104]:     </arch>
Aug 26 08:32:45 user nova-compute[73104]:     <features>
Aug 26 08:32:45 user nova-compute[73104]:       <cpuselection/>
Aug 26 08:32:45 user nova-compute[73104]:       <deviceboot/>
Aug 26 08:32:45 user nova-compute[73104]:       <disksnapshot default='on' toggle='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     </features>
Aug 26 08:32:45 user nova-compute[73104]:   </guest>
Aug 26 08:32:45 user nova-compute[73104]:   <guest>
Aug 26 08:32:45 user nova-compute[73104]:     <os_type>hvm</os_type>
Aug 26 08:32:45 user nova-compute[73104]:     <arch name='ppc64le'>
Aug 26 08:32:45 user nova-compute[73104]:       <wordsize>64</wordsize>
Aug 26 08:32:45 user nova-compute[73104]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2048'>powernv9</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>taihu</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2048'>powernv10</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='32'>ppce500</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>40p</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>pegasos2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>bamboo</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>g3beige</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>mac99</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>sam460ex</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>ref405ep</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2048'>powernv8</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <domain type='qemu'/>
Aug 26 08:32:45 user nova-compute[73104]:     </arch>
Aug 26 08:32:45 user nova-compute[73104]:     <features>
Aug 26 08:32:45 user nova-compute[73104]:       <cpuselection/>
Aug 26 08:32:45 user nova-compute[73104]:       <deviceboot/>
Aug 26 08:32:45 user nova-compute[73104]:       <disksnapshot default='on' toggle='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     </features>
Aug 26 08:32:45 user nova-compute[73104]:   </guest>
Aug 26 08:32:45 user nova-compute[73104]:   <guest>
Aug 26 08:32:45 user nova-compute[73104]:     <os_type>hvm</os_type>
Aug 26 08:32:45 user nova-compute[73104]:     <arch name='riscv32'>
Aug 26 08:32:45 user nova-compute[73104]:       <wordsize>32</wordsize>
Aug 26 08:32:45 user nova-compute[73104]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='8'>spike</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>opentitan</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='5'>sifive_u</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>sifive_e</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='8'>virt</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <domain type='qemu'/>
Aug 26 08:32:45 user nova-compute[73104]:     </arch>
Aug 26 08:32:45 user nova-compute[73104]:     <features>
Aug 26 08:32:45 user nova-compute[73104]:       <cpuselection/>
Aug 26 08:32:45 user nova-compute[73104]:       <deviceboot/>
Aug 26 08:32:45 user nova-compute[73104]:       <disksnapshot default='on' toggle='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     </features>
Aug 26 08:32:45 user nova-compute[73104]:   </guest>
Aug 26 08:32:45 user nova-compute[73104]:   <guest>
Aug 26 08:32:45 user nova-compute[73104]:     <os_type>hvm</os_type>
Aug 26 08:32:45 user nova-compute[73104]:     <arch name='riscv64'>
Aug 26 08:32:45 user nova-compute[73104]:       <wordsize>64</wordsize>
Aug 26 08:32:45 user nova-compute[73104]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='8'>spike</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='5'>sifive_u</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>shakti_c</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>sifive_e</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='8'>virt</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <domain type='qemu'/>
Aug 26 08:32:45 user nova-compute[73104]:     </arch>
Aug 26 08:32:45 user nova-compute[73104]:     <features>
Aug 26 08:32:45 user nova-compute[73104]:       <cpuselection/>
Aug 26 08:32:45 user nova-compute[73104]:       <deviceboot/>
Aug 26 08:32:45 user nova-compute[73104]:       <disksnapshot default='on' toggle='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     </features>
Aug 26 08:32:45 user nova-compute[73104]:   </guest>
Aug 26 08:32:45 user nova-compute[73104]:   <guest>
Aug 26 08:32:45 user nova-compute[73104]:     <os_type>hvm</os_type>
Aug 26 08:32:45 user nova-compute[73104]:     <arch name='s390x'>
Aug 26 08:32:45 user nova-compute[73104]:       <wordsize>64</wordsize>
Aug 26 08:32:45 user nova-compute[73104]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <domain type='qemu'/>
Aug 26 08:32:45 user nova-compute[73104]:     </arch>
Aug 26 08:32:45 user nova-compute[73104]:     <features>
Aug 26 08:32:45 user nova-compute[73104]:       <cpuselection/>
Aug 26 08:32:45 user nova-compute[73104]:       <deviceboot/>
Aug 26 08:32:45 user nova-compute[73104]:       <disksnapshot default='on' toggle='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     </features>
Aug 26 08:32:45 user nova-compute[73104]:   </guest>
Aug 26 08:32:45 user nova-compute[73104]:   <guest>
Aug 26 08:32:45 user nova-compute[73104]:     <os_type>hvm</os_type>
Aug 26 08:32:45 user nova-compute[73104]:     <arch name='sh4'>
Aug 26 08:32:45 user nova-compute[73104]:       <wordsize>32</wordsize>
Aug 26 08:32:45 user nova-compute[73104]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>shix</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>r2d</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <domain type='qemu'/>
Aug 26 08:32:45 user nova-compute[73104]:     </arch>
Aug 26 08:32:45 user nova-compute[73104]:     <features>
Aug 26 08:32:45 user nova-compute[73104]:       <cpuselection/>
Aug 26 08:32:45 user nova-compute[73104]:       <deviceboot/>
Aug 26 08:32:45 user nova-compute[73104]:       <disksnapshot default='on' toggle='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     </features>
Aug 26 08:32:45 user nova-compute[73104]:   </guest>
Aug 26 08:32:45 user nova-compute[73104]:   <guest>
Aug 26 08:32:45 user nova-compute[73104]:     <os_type>hvm</os_type>
Aug 26 08:32:45 user nova-compute[73104]:     <arch name='sh4eb'>
Aug 26 08:32:45 user nova-compute[73104]:       <wordsize>64</wordsize>
Aug 26 08:32:45 user nova-compute[73104]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>shix</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>r2d</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <domain type='qemu'/>
Aug 26 08:32:45 user nova-compute[73104]:     </arch>
Aug 26 08:32:45 user nova-compute[73104]:     <features>
Aug 26 08:32:45 user nova-compute[73104]:       <cpuselection/>
Aug 26 08:32:45 user nova-compute[73104]:       <deviceboot/>
Aug 26 08:32:45 user nova-compute[73104]:       <disksnapshot default='on' toggle='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     </features>
Aug 26 08:32:45 user nova-compute[73104]:   </guest>
Aug 26 08:32:45 user nova-compute[73104]:   <guest>
Aug 26 08:32:45 user nova-compute[73104]:     <os_type>hvm</os_type>
Aug 26 08:32:45 user nova-compute[73104]:     <arch name='sparc'>
Aug 26 08:32:45 user nova-compute[73104]:       <wordsize>32</wordsize>
Aug 26 08:32:45 user nova-compute[73104]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>SS-5</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>SS-20</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>LX</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>SS-4</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>SS-10</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>Voyager</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <domain type='qemu'/>
Aug 26 08:32:45 user nova-compute[73104]:     </arch>
Aug 26 08:32:45 user nova-compute[73104]:     <features>
Aug 26 08:32:45 user nova-compute[73104]:       <cpuselection/>
Aug 26 08:32:45 user nova-compute[73104]:       <deviceboot/>
Aug 26 08:32:45 user nova-compute[73104]:       <disksnapshot default='on' toggle='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     </features>
Aug 26 08:32:45 user nova-compute[73104]:   </guest>
Aug 26 08:32:45 user nova-compute[73104]:   <guest>
Aug 26 08:32:45 user nova-compute[73104]:     <os_type>hvm</os_type>
Aug 26 08:32:45 user nova-compute[73104]:     <arch name='sparc64'>
Aug 26 08:32:45 user nova-compute[73104]:       <wordsize>64</wordsize>
Aug 26 08:32:45 user nova-compute[73104]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>sun4u</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>niagara</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>sun4v</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <domain type='qemu'/>
Aug 26 08:32:45 user nova-compute[73104]:     </arch>
Aug 26 08:32:45 user nova-compute[73104]:     <features>
Aug 26 08:32:45 user nova-compute[73104]:       <cpuselection/>
Aug 26 08:32:45 user nova-compute[73104]:       <deviceboot/>
Aug 26 08:32:45 user nova-compute[73104]:       <disksnapshot default='on' toggle='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     </features>
Aug 26 08:32:45 user nova-compute[73104]:   </guest>
Aug 26 08:32:45 user nova-compute[73104]:   <guest>
Aug 26 08:32:45 user nova-compute[73104]:     <os_type>hvm</os_type>
Aug 26 08:32:45 user nova-compute[73104]:     <arch name='x86_64'>
Aug 26 08:32:45 user nova-compute[73104]:       <wordsize>64</wordsize>
Aug 26 08:32:45 user nova-compute[73104]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>x-remote</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='1'>isapc</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>microvm</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <domain type='qemu'/>
Aug 26 08:32:45 user nova-compute[73104]:       <domain type='kvm'/>
Aug 26 08:32:45 user nova-compute[73104]:     </arch>
Aug 26 08:32:45 user nova-compute[73104]:     <features>
Aug 26 08:32:45 user nova-compute[73104]:       <acpi default='on' toggle='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:       <apic default='on' toggle='no'/>
Aug 26 08:32:45 user nova-compute[73104]:       <cpuselection/>
Aug 26 08:32:45 user nova-compute[73104]:       <deviceboot/>
Aug 26 08:32:45 user nova-compute[73104]:       <disksnapshot default='on' toggle='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     </features>
Aug 26 08:32:45 user nova-compute[73104]:   </guest>
Aug 26 08:32:45 user nova-compute[73104]:   <guest>
Aug 26 08:32:45 user nova-compute[73104]:     <os_type>hvm</os_type>
Aug 26 08:32:45 user nova-compute[73104]:     <arch name='xtensa'>
Aug 26 08:32:45 user nova-compute[73104]:       <wordsize>32</wordsize>
Aug 26 08:32:45 user nova-compute[73104]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>sim</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='32'>kc705</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='32'>ml605</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='32'>virt</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='32'>lx200</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='32'>lx60</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <domain type='qemu'/>
Aug 26 08:32:45 user nova-compute[73104]:     </arch>
Aug 26 08:32:45 user nova-compute[73104]:     <features>
Aug 26 08:32:45 user nova-compute[73104]:       <cpuselection/>
Aug 26 08:32:45 user nova-compute[73104]:       <deviceboot/>
Aug 26 08:32:45 user nova-compute[73104]:       <disksnapshot default='on' toggle='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     </features>
Aug 26 08:32:45 user nova-compute[73104]:   </guest>
Aug 26 08:32:45 user nova-compute[73104]:   <guest>
Aug 26 08:32:45 user nova-compute[73104]:     <os_type>hvm</os_type>
Aug 26 08:32:45 user nova-compute[73104]:     <arch name='xtensaeb'>
Aug 26 08:32:45 user nova-compute[73104]:       <wordsize>32</wordsize>
Aug 26 08:32:45 user nova-compute[73104]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='4'>sim</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='32'>kc705</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='32'>ml605</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='32'>virt</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='32'>lx200</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='32'>lx60</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 26 08:32:45 user nova-compute[73104]:       <domain type='qemu'/>
Aug 26 08:32:45 user nova-compute[73104]:     </arch>
Aug 26 08:32:45 user nova-compute[73104]:     <features>
Aug 26 08:32:45 user nova-compute[73104]:       <cpuselection/>
Aug 26 08:32:45 user nova-compute[73104]:       <deviceboot/>
Aug 26 08:32:45 user nova-compute[73104]:       <disksnapshot default='on' toggle='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     </features>
Aug 26 08:32:45 user nova-compute[73104]:   </guest>
Aug 26 08:32:45 user nova-compute[73104]: </capabilities>
Aug 26 08:32:45 user nova-compute[73104]: 
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73104) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73104) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=73104) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73104) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73104) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73104) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73104) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73104) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73104) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73104) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73104) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'q35', 'ubuntu', 'pc'} {{(pid=73104) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 26 08:32:45 user nova-compute[73104]: <domainCapabilities>
Aug 26 08:32:45 user nova-compute[73104]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 08:32:45 user nova-compute[73104]:   <domain>kvm</domain>
Aug 26 08:32:45 user nova-compute[73104]:   <machine>pc-q35-jammy</machine>
Aug 26 08:32:45 user nova-compute[73104]:   <arch>i686</arch>
Aug 26 08:32:45 user nova-compute[73104]:   <vcpu max='288'/>
Aug 26 08:32:45 user nova-compute[73104]:   <iothreads supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:   <os supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:     <enum name='firmware'/>
Aug 26 08:32:45 user nova-compute[73104]:     <loader supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='type'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>rom</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>pflash</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='readonly'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>yes</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>no</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='secure'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>no</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </loader>
Aug 26 08:32:45 user nova-compute[73104]:   </os>
Aug 26 08:32:45 user nova-compute[73104]:   <cpu>
Aug 26 08:32:45 user nova-compute[73104]:     <mode name='host-passthrough' supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='hostPassthroughMigratable'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>off</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </mode>
Aug 26 08:32:45 user nova-compute[73104]:     <mode name='maximum' supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='maximumMigratable'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>on</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>off</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </mode>
Aug 26 08:32:45 user nova-compute[73104]:     <mode name='host-model' supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <vendor>Intel</vendor>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='ss'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='vmx'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='pcid'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='hypervisor'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='arat'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='umip'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='md-clear'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='stibp'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='ssbd'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='ibpb'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='ibrs'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='amd-stibp'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='disable' name='erms'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='disable' name='lm'/>
Aug 26 08:32:45 user nova-compute[73104]:     </mode>
Aug 26 08:32:45 user nova-compute[73104]:     <mode name='custom' supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>qemu64</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>qemu32</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>phenom</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>pentium3</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>pentium2</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>pentium</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>n270</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>kvm64</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>kvm32</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>coreduo</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>core2duo</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>athlon</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Westmere</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Snowridge</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Server</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Client</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>SandyBridge</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Penryn</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G5</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G4</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G3</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G2</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G1</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Nehalem</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>IvyBridge</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Icelake-Server</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Haswell</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>EPYC-Rome</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>EPYC-Milan</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>EPYC</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Dhyana</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Cooperlake</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Conroe</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Broadwell</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>486</model>
Aug 26 08:32:45 user nova-compute[73104]:     </mode>
Aug 26 08:32:45 user nova-compute[73104]:   </cpu>
Aug 26 08:32:45 user nova-compute[73104]:   <memoryBacking supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:     <enum name='sourceType'>
Aug 26 08:32:45 user nova-compute[73104]:       <value>file</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>anonymous</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>memfd</value>
Aug 26 08:32:45 user nova-compute[73104]:     </enum>
Aug 26 08:32:45 user nova-compute[73104]:   </memoryBacking>
Aug 26 08:32:45 user nova-compute[73104]:   <devices>
Aug 26 08:32:45 user nova-compute[73104]:     <disk supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='diskDevice'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>disk</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>cdrom</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>floppy</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>lun</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='bus'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>fdc</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>scsi</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>usb</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>sata</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='model'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio-transitional</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio-non-transitional</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </disk>
Aug 26 08:32:45 user nova-compute[73104]:     <graphics supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='type'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>sdl</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>vnc</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>spice</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>egl-headless</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </graphics>
Aug 26 08:32:45 user nova-compute[73104]:     <video supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='modelType'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>vga</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>cirrus</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>vmvga</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>qxl</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>none</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>bochs</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>ramfb</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </video>
Aug 26 08:32:45 user nova-compute[73104]:     <hostdev supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='mode'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>subsystem</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='startupPolicy'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>default</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>mandatory</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>requisite</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>optional</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='subsysType'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>usb</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>pci</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>scsi</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='capsType'/>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='pciBackend'/>
Aug 26 08:32:45 user nova-compute[73104]:     </hostdev>
Aug 26 08:32:45 user nova-compute[73104]:     <rng supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='model'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio-transitional</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio-non-transitional</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='backendModel'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>random</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>egd</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>builtin</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </rng>
Aug 26 08:32:45 user nova-compute[73104]:     <filesystem supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='driverType'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>path</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>handle</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtiofs</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </filesystem>
Aug 26 08:32:45 user nova-compute[73104]:     <tpm supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='model'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>tpm-tis</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>tpm-crb</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='backendModel'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>passthrough</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>emulator</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </tpm>
Aug 26 08:32:45 user nova-compute[73104]:   </devices>
Aug 26 08:32:45 user nova-compute[73104]:   <features>
Aug 26 08:32:45 user nova-compute[73104]:     <gic supported='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     <vmcoreinfo supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:     <genid supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:     <backingStoreInput supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:     <backup supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:     <sev supported='no'/>
Aug 26 08:32:45 user nova-compute[73104]:   </features>
Aug 26 08:32:45 user nova-compute[73104]: </domainCapabilities>
Aug 26 08:32:45 user nova-compute[73104]:  {{(pid=73104) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 26 08:32:45 user nova-compute[73104]: <domainCapabilities>
Aug 26 08:32:45 user nova-compute[73104]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 08:32:45 user nova-compute[73104]:   <domain>kvm</domain>
Aug 26 08:32:45 user nova-compute[73104]:   <machine>pc-q35-6.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:   <arch>i686</arch>
Aug 26 08:32:45 user nova-compute[73104]:   <vcpu max='288'/>
Aug 26 08:32:45 user nova-compute[73104]:   <iothreads supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:   <os supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:     <enum name='firmware'/>
Aug 26 08:32:45 user nova-compute[73104]:     <loader supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='type'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>rom</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>pflash</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='readonly'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>yes</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>no</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='secure'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>no</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </loader>
Aug 26 08:32:45 user nova-compute[73104]:   </os>
Aug 26 08:32:45 user nova-compute[73104]:   <cpu>
Aug 26 08:32:45 user nova-compute[73104]:     <mode name='host-passthrough' supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='hostPassthroughMigratable'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>off</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </mode>
Aug 26 08:32:45 user nova-compute[73104]:     <mode name='maximum' supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='maximumMigratable'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>on</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>off</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </mode>
Aug 26 08:32:45 user nova-compute[73104]:     <mode name='host-model' supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <vendor>Intel</vendor>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='ss'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='vmx'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='pcid'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='hypervisor'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='arat'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='umip'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='md-clear'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='stibp'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='ssbd'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='ibpb'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='ibrs'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='amd-stibp'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='disable' name='erms'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='disable' name='lm'/>
Aug 26 08:32:45 user nova-compute[73104]:     </mode>
Aug 26 08:32:45 user nova-compute[73104]:     <mode name='custom' supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>qemu64</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>qemu32</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>phenom</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>pentium3</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>pentium2</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>pentium</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>n270</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>kvm64</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>kvm32</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>coreduo</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>core2duo</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>athlon</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Westmere</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Snowridge</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Server</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Client</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>SandyBridge</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Penryn</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G5</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G4</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G3</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G2</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G1</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Nehalem</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>IvyBridge</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Icelake-Server</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Haswell</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>EPYC-Rome</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>EPYC-Milan</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>EPYC</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Dhyana</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Cooperlake</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Conroe</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Broadwell</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>486</model>
Aug 26 08:32:45 user nova-compute[73104]:     </mode>
Aug 26 08:32:45 user nova-compute[73104]:   </cpu>
Aug 26 08:32:45 user nova-compute[73104]:   <memoryBacking supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:     <enum name='sourceType'>
Aug 26 08:32:45 user nova-compute[73104]:       <value>file</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>anonymous</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>memfd</value>
Aug 26 08:32:45 user nova-compute[73104]:     </enum>
Aug 26 08:32:45 user nova-compute[73104]:   </memoryBacking>
Aug 26 08:32:45 user nova-compute[73104]:   <devices>
Aug 26 08:32:45 user nova-compute[73104]:     <disk supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='diskDevice'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>disk</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>cdrom</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>floppy</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>lun</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='bus'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>fdc</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>scsi</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>usb</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>sata</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='model'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio-transitional</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio-non-transitional</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </disk>
Aug 26 08:32:45 user nova-compute[73104]:     <graphics supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='type'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>sdl</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>vnc</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>spice</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>egl-headless</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </graphics>
Aug 26 08:32:45 user nova-compute[73104]:     <video supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='modelType'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>vga</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>cirrus</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>vmvga</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>qxl</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>none</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>bochs</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>ramfb</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </video>
Aug 26 08:32:45 user nova-compute[73104]:     <hostdev supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='mode'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>subsystem</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='startupPolicy'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>default</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>mandatory</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>requisite</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>optional</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='subsysType'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>usb</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>pci</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>scsi</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='capsType'/>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='pciBackend'/>
Aug 26 08:32:45 user nova-compute[73104]:     </hostdev>
Aug 26 08:32:45 user nova-compute[73104]:     <rng supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='model'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio-transitional</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio-non-transitional</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='backendModel'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>random</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>egd</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>builtin</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </rng>
Aug 26 08:32:45 user nova-compute[73104]:     <filesystem supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='driverType'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>path</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>handle</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtiofs</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </filesystem>
Aug 26 08:32:45 user nova-compute[73104]:     <tpm supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='model'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>tpm-tis</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>tpm-crb</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='backendModel'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>passthrough</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>emulator</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </tpm>
Aug 26 08:32:45 user nova-compute[73104]:   </devices>
Aug 26 08:32:45 user nova-compute[73104]:   <features>
Aug 26 08:32:45 user nova-compute[73104]:     <gic supported='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     <vmcoreinfo supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:     <genid supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:     <backingStoreInput supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:     <backup supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:     <sev supported='no'/>
Aug 26 08:32:45 user nova-compute[73104]:   </features>
Aug 26 08:32:45 user nova-compute[73104]: </domainCapabilities>
Aug 26 08:32:45 user nova-compute[73104]:  {{(pid=73104) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 26 08:32:45 user nova-compute[73104]: <domainCapabilities>
Aug 26 08:32:45 user nova-compute[73104]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 08:32:45 user nova-compute[73104]:   <domain>kvm</domain>
Aug 26 08:32:45 user nova-compute[73104]:   <machine>pc-i440fx-jammy</machine>
Aug 26 08:32:45 user nova-compute[73104]:   <arch>i686</arch>
Aug 26 08:32:45 user nova-compute[73104]:   <vcpu max='255'/>
Aug 26 08:32:45 user nova-compute[73104]:   <iothreads supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:   <os supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:     <enum name='firmware'/>
Aug 26 08:32:45 user nova-compute[73104]:     <loader supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='type'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>rom</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>pflash</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='readonly'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>yes</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>no</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='secure'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>no</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </loader>
Aug 26 08:32:45 user nova-compute[73104]:   </os>
Aug 26 08:32:45 user nova-compute[73104]:   <cpu>
Aug 26 08:32:45 user nova-compute[73104]:     <mode name='host-passthrough' supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='hostPassthroughMigratable'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>off</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </mode>
Aug 26 08:32:45 user nova-compute[73104]:     <mode name='maximum' supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='maximumMigratable'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>on</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>off</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </mode>
Aug 26 08:32:45 user nova-compute[73104]:     <mode name='host-model' supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <vendor>Intel</vendor>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='ss'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='vmx'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='pcid'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='hypervisor'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='arat'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='umip'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='md-clear'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='stibp'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='ssbd'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='ibpb'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='ibrs'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='amd-stibp'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='disable' name='erms'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='disable' name='lm'/>
Aug 26 08:32:45 user nova-compute[73104]:     </mode>
Aug 26 08:32:45 user nova-compute[73104]:     <mode name='custom' supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>qemu64</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>qemu32</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>phenom</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>pentium3</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>pentium2</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>pentium</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>n270</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>kvm64</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>kvm32</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>coreduo</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>core2duo</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>athlon</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Westmere</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Snowridge</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Server</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Client</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>SandyBridge</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Penryn</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G5</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G4</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G3</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G2</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G1</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Nehalem</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>IvyBridge</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Icelake-Server</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Haswell</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>EPYC-Rome</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>EPYC-Milan</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>EPYC</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Dhyana</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Cooperlake</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Conroe</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Broadwell</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>486</model>
Aug 26 08:32:45 user nova-compute[73104]:     </mode>
Aug 26 08:32:45 user nova-compute[73104]:   </cpu>
Aug 26 08:32:45 user nova-compute[73104]:   <memoryBacking supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:     <enum name='sourceType'>
Aug 26 08:32:45 user nova-compute[73104]:       <value>file</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>anonymous</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>memfd</value>
Aug 26 08:32:45 user nova-compute[73104]:     </enum>
Aug 26 08:32:45 user nova-compute[73104]:   </memoryBacking>
Aug 26 08:32:45 user nova-compute[73104]:   <devices>
Aug 26 08:32:45 user nova-compute[73104]:     <disk supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='diskDevice'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>disk</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>cdrom</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>floppy</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>lun</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='bus'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>ide</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>fdc</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>scsi</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>usb</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>sata</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='model'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio-transitional</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio-non-transitional</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </disk>
Aug 26 08:32:45 user nova-compute[73104]:     <graphics supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='type'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>sdl</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>vnc</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>spice</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>egl-headless</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </graphics>
Aug 26 08:32:45 user nova-compute[73104]:     <video supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='modelType'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>vga</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>cirrus</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>vmvga</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>qxl</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>none</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>bochs</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>ramfb</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </video>
Aug 26 08:32:45 user nova-compute[73104]:     <hostdev supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='mode'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>subsystem</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='startupPolicy'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>default</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>mandatory</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>requisite</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>optional</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='subsysType'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>usb</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>pci</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>scsi</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='capsType'/>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='pciBackend'/>
Aug 26 08:32:45 user nova-compute[73104]:     </hostdev>
Aug 26 08:32:45 user nova-compute[73104]:     <rng supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='model'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio-transitional</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio-non-transitional</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='backendModel'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>random</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>egd</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>builtin</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </rng>
Aug 26 08:32:45 user nova-compute[73104]:     <filesystem supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='driverType'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>path</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>handle</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtiofs</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </filesystem>
Aug 26 08:32:45 user nova-compute[73104]:     <tpm supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='model'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>tpm-tis</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>tpm-crb</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='backendModel'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>passthrough</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>emulator</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </tpm>
Aug 26 08:32:45 user nova-compute[73104]:   </devices>
Aug 26 08:32:45 user nova-compute[73104]:   <features>
Aug 26 08:32:45 user nova-compute[73104]:     <gic supported='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     <vmcoreinfo supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:     <genid supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:     <backingStoreInput supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:     <backup supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:     <sev supported='no'/>
Aug 26 08:32:45 user nova-compute[73104]:   </features>
Aug 26 08:32:45 user nova-compute[73104]: </domainCapabilities>
Aug 26 08:32:45 user nova-compute[73104]:  {{(pid=73104) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 26 08:32:45 user nova-compute[73104]: <domainCapabilities>
Aug 26 08:32:45 user nova-compute[73104]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 08:32:45 user nova-compute[73104]:   <domain>kvm</domain>
Aug 26 08:32:45 user nova-compute[73104]:   <machine>pc-i440fx-6.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:   <arch>i686</arch>
Aug 26 08:32:45 user nova-compute[73104]:   <vcpu max='255'/>
Aug 26 08:32:45 user nova-compute[73104]:   <iothreads supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:   <os supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:     <enum name='firmware'/>
Aug 26 08:32:45 user nova-compute[73104]:     <loader supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='type'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>rom</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>pflash</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='readonly'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>yes</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>no</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='secure'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>no</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </loader>
Aug 26 08:32:45 user nova-compute[73104]:   </os>
Aug 26 08:32:45 user nova-compute[73104]:   <cpu>
Aug 26 08:32:45 user nova-compute[73104]:     <mode name='host-passthrough' supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='hostPassthroughMigratable'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>off</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </mode>
Aug 26 08:32:45 user nova-compute[73104]:     <mode name='maximum' supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='maximumMigratable'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>on</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>off</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </mode>
Aug 26 08:32:45 user nova-compute[73104]:     <mode name='host-model' supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <vendor>Intel</vendor>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='ss'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='vmx'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='pcid'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='hypervisor'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='arat'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='umip'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='md-clear'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='stibp'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='ssbd'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='ibpb'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='ibrs'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='amd-stibp'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='disable' name='erms'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='disable' name='lm'/>
Aug 26 08:32:45 user nova-compute[73104]:     </mode>
Aug 26 08:32:45 user nova-compute[73104]:     <mode name='custom' supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>qemu64</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>qemu32</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>phenom</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>pentium3</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>pentium2</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>pentium</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>n270</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>kvm64</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>kvm32</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>coreduo</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>core2duo</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>athlon</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Westmere</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Snowridge</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Server</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Client</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>SandyBridge</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Penryn</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G5</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G4</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G3</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G2</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G1</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Nehalem</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>IvyBridge</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Icelake-Server</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Haswell</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>EPYC-Rome</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>EPYC-Milan</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>EPYC</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Dhyana</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Cooperlake</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Conroe</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Broadwell</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>486</model>
Aug 26 08:32:45 user nova-compute[73104]:     </mode>
Aug 26 08:32:45 user nova-compute[73104]:   </cpu>
Aug 26 08:32:45 user nova-compute[73104]:   <memoryBacking supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:     <enum name='sourceType'>
Aug 26 08:32:45 user nova-compute[73104]:       <value>file</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>anonymous</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>memfd</value>
Aug 26 08:32:45 user nova-compute[73104]:     </enum>
Aug 26 08:32:45 user nova-compute[73104]:   </memoryBacking>
Aug 26 08:32:45 user nova-compute[73104]:   <devices>
Aug 26 08:32:45 user nova-compute[73104]:     <disk supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='diskDevice'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>disk</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>cdrom</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>floppy</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>lun</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='bus'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>ide</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>fdc</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>scsi</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>usb</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>sata</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='model'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio-transitional</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio-non-transitional</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </disk>
Aug 26 08:32:45 user nova-compute[73104]:     <graphics supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='type'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>sdl</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>vnc</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>spice</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>egl-headless</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </graphics>
Aug 26 08:32:45 user nova-compute[73104]:     <video supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='modelType'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>vga</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>cirrus</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>vmvga</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>qxl</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>none</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>bochs</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>ramfb</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </video>
Aug 26 08:32:45 user nova-compute[73104]:     <hostdev supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='mode'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>subsystem</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='startupPolicy'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>default</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>mandatory</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>requisite</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>optional</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='subsysType'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>usb</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>pci</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>scsi</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='capsType'/>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='pciBackend'/>
Aug 26 08:32:45 user nova-compute[73104]:     </hostdev>
Aug 26 08:32:45 user nova-compute[73104]:     <rng supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='model'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio-transitional</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio-non-transitional</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='backendModel'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>random</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>egd</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>builtin</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </rng>
Aug 26 08:32:45 user nova-compute[73104]:     <filesystem supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='driverType'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>path</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>handle</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtiofs</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </filesystem>
Aug 26 08:32:45 user nova-compute[73104]:     <tpm supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='model'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>tpm-tis</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>tpm-crb</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='backendModel'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>passthrough</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>emulator</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </tpm>
Aug 26 08:32:45 user nova-compute[73104]:   </devices>
Aug 26 08:32:45 user nova-compute[73104]:   <features>
Aug 26 08:32:45 user nova-compute[73104]:     <gic supported='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     <vmcoreinfo supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:     <genid supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:     <backingStoreInput supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:     <backup supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:     <sev supported='no'/>
Aug 26 08:32:45 user nova-compute[73104]:   </features>
Aug 26 08:32:45 user nova-compute[73104]: </domainCapabilities>
Aug 26 08:32:45 user nova-compute[73104]:  {{(pid=73104) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=73104) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73104) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73104) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73104) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73104) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73104) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73104) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73104) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73104) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73104) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73104) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73104) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73104) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73104) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73104) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73104) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73104) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=73104) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73104) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73104) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73104) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=73104) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73104) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73104) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73104) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73104) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73104) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73104) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73104) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73104) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73104) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73104) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73104) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73104) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73104) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73104) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73104) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73104) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'q35', 'ubuntu', 'pc'} {{(pid=73104) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 26 08:32:45 user nova-compute[73104]: <domainCapabilities>
Aug 26 08:32:45 user nova-compute[73104]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 08:32:45 user nova-compute[73104]:   <domain>kvm</domain>
Aug 26 08:32:45 user nova-compute[73104]:   <machine>pc-q35-jammy</machine>
Aug 26 08:32:45 user nova-compute[73104]:   <arch>x86_64</arch>
Aug 26 08:32:45 user nova-compute[73104]:   <vcpu max='288'/>
Aug 26 08:32:45 user nova-compute[73104]:   <iothreads supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:   <os supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:     <enum name='firmware'>
Aug 26 08:32:45 user nova-compute[73104]:       <value>efi</value>
Aug 26 08:32:45 user nova-compute[73104]:     </enum>
Aug 26 08:32:45 user nova-compute[73104]:     <loader supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='type'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>rom</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>pflash</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='readonly'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>yes</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>no</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='secure'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>yes</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>no</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </loader>
Aug 26 08:32:45 user nova-compute[73104]:   </os>
Aug 26 08:32:45 user nova-compute[73104]:   <cpu>
Aug 26 08:32:45 user nova-compute[73104]:     <mode name='host-passthrough' supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='hostPassthroughMigratable'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>on</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>off</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </mode>
Aug 26 08:32:45 user nova-compute[73104]:     <mode name='maximum' supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='maximumMigratable'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>on</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>off</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </mode>
Aug 26 08:32:45 user nova-compute[73104]:     <mode name='host-model' supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <vendor>Intel</vendor>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='ss'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='vmx'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='pcid'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='hypervisor'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='arat'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='umip'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='md-clear'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='stibp'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='ssbd'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='invtsc'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='ibpb'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='ibrs'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='amd-stibp'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='rsba'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='disable' name='erms'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 08:32:45 user nova-compute[73104]:     </mode>
Aug 26 08:32:45 user nova-compute[73104]:     <mode name='custom' supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>qemu64</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>qemu32</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>phenom</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>pentium3</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>pentium2</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>pentium</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>n270</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>kvm64</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>kvm32</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>coreduo</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>core2duo</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>athlon</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>Westmere</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Snowridge</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Server</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Client</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>SandyBridge</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>Penryn</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G5</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G4</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G3</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G2</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>Opteron_G1</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>Nehalem</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>IvyBridge</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Icelake-Server</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Haswell</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>EPYC-Rome</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>EPYC-Milan</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>EPYC</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Dhyana</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Cooperlake</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>Conroe</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Broadwell</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>486</model>
Aug 26 08:32:45 user nova-compute[73104]:     </mode>
Aug 26 08:32:45 user nova-compute[73104]:   </cpu>
Aug 26 08:32:45 user nova-compute[73104]:   <memoryBacking supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:     <enum name='sourceType'>
Aug 26 08:32:45 user nova-compute[73104]:       <value>file</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>anonymous</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>memfd</value>
Aug 26 08:32:45 user nova-compute[73104]:     </enum>
Aug 26 08:32:45 user nova-compute[73104]:   </memoryBacking>
Aug 26 08:32:45 user nova-compute[73104]:   <devices>
Aug 26 08:32:45 user nova-compute[73104]:     <disk supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='diskDevice'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>disk</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>cdrom</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>floppy</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>lun</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='bus'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>fdc</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>scsi</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>usb</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>sata</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='model'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio-transitional</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio-non-transitional</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </disk>
Aug 26 08:32:45 user nova-compute[73104]:     <graphics supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='type'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>sdl</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>vnc</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>spice</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>egl-headless</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </graphics>
Aug 26 08:32:45 user nova-compute[73104]:     <video supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='modelType'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>vga</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>cirrus</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>vmvga</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>qxl</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>none</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>bochs</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>ramfb</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </video>
Aug 26 08:32:45 user nova-compute[73104]:     <hostdev supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='mode'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>subsystem</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='startupPolicy'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>default</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>mandatory</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>requisite</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>optional</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='subsysType'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>usb</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>pci</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>scsi</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='capsType'/>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='pciBackend'/>
Aug 26 08:32:45 user nova-compute[73104]:     </hostdev>
Aug 26 08:32:45 user nova-compute[73104]:     <rng supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='model'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio-transitional</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio-non-transitional</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='backendModel'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>random</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>egd</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>builtin</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </rng>
Aug 26 08:32:45 user nova-compute[73104]:     <filesystem supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='driverType'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>path</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>handle</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtiofs</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </filesystem>
Aug 26 08:32:45 user nova-compute[73104]:     <tpm supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='model'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>tpm-tis</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>tpm-crb</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='backendModel'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>passthrough</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>emulator</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </tpm>
Aug 26 08:32:45 user nova-compute[73104]:   </devices>
Aug 26 08:32:45 user nova-compute[73104]:   <features>
Aug 26 08:32:45 user nova-compute[73104]:     <gic supported='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     <vmcoreinfo supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:     <genid supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:     <backingStoreInput supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:     <backup supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:     <sev supported='no'/>
Aug 26 08:32:45 user nova-compute[73104]:   </features>
Aug 26 08:32:45 user nova-compute[73104]: </domainCapabilities>
Aug 26 08:32:45 user nova-compute[73104]:  {{(pid=73104) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 26 08:32:45 user nova-compute[73104]: <domainCapabilities>
Aug 26 08:32:45 user nova-compute[73104]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 08:32:45 user nova-compute[73104]:   <domain>kvm</domain>
Aug 26 08:32:45 user nova-compute[73104]:   <machine>pc-q35-6.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:   <arch>x86_64</arch>
Aug 26 08:32:45 user nova-compute[73104]:   <vcpu max='288'/>
Aug 26 08:32:45 user nova-compute[73104]:   <iothreads supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:   <os supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:     <enum name='firmware'>
Aug 26 08:32:45 user nova-compute[73104]:       <value>efi</value>
Aug 26 08:32:45 user nova-compute[73104]:     </enum>
Aug 26 08:32:45 user nova-compute[73104]:     <loader supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='type'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>rom</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>pflash</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='readonly'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>yes</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>no</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='secure'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>yes</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>no</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </loader>
Aug 26 08:32:45 user nova-compute[73104]:   </os>
Aug 26 08:32:45 user nova-compute[73104]:   <cpu>
Aug 26 08:32:45 user nova-compute[73104]:     <mode name='host-passthrough' supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='hostPassthroughMigratable'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>on</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>off</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </mode>
Aug 26 08:32:45 user nova-compute[73104]:     <mode name='maximum' supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='maximumMigratable'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>on</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>off</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </mode>
Aug 26 08:32:45 user nova-compute[73104]:     <mode name='host-model' supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <vendor>Intel</vendor>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='ss'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='vmx'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='pcid'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='hypervisor'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='arat'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='umip'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='md-clear'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='stibp'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='ssbd'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='invtsc'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='ibpb'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='ibrs'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='amd-stibp'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='rsba'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='disable' name='erms'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 08:32:45 user nova-compute[73104]:     </mode>
Aug 26 08:32:45 user nova-compute[73104]:     <mode name='custom' supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>qemu64</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>qemu32</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>phenom</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>pentium3</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>pentium2</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>pentium</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>n270</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>kvm64</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>kvm32</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>coreduo</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>core2duo</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>athlon</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>Westmere</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Snowridge</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Server</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Client</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>SandyBridge</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>Penryn</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G5</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G4</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G3</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G2</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>Opteron_G1</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>Nehalem</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>IvyBridge</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Icelake-Server</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Haswell</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>EPYC-Rome</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>EPYC-Milan</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>EPYC</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Dhyana</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Cooperlake</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>Conroe</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Broadwell</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>486</model>
Aug 26 08:32:45 user nova-compute[73104]:     </mode>
Aug 26 08:32:45 user nova-compute[73104]:   </cpu>
Aug 26 08:32:45 user nova-compute[73104]:   <memoryBacking supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:     <enum name='sourceType'>
Aug 26 08:32:45 user nova-compute[73104]:       <value>file</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>anonymous</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>memfd</value>
Aug 26 08:32:45 user nova-compute[73104]:     </enum>
Aug 26 08:32:45 user nova-compute[73104]:   </memoryBacking>
Aug 26 08:32:45 user nova-compute[73104]:   <devices>
Aug 26 08:32:45 user nova-compute[73104]:     <disk supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='diskDevice'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>disk</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>cdrom</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>floppy</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>lun</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='bus'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>fdc</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>scsi</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>usb</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>sata</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='model'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio-transitional</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio-non-transitional</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </disk>
Aug 26 08:32:45 user nova-compute[73104]:     <graphics supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='type'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>sdl</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>vnc</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>spice</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>egl-headless</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </graphics>
Aug 26 08:32:45 user nova-compute[73104]:     <video supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='modelType'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>vga</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>cirrus</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>vmvga</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>qxl</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>none</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>bochs</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>ramfb</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </video>
Aug 26 08:32:45 user nova-compute[73104]:     <hostdev supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='mode'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>subsystem</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='startupPolicy'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>default</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>mandatory</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>requisite</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>optional</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='subsysType'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>usb</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>pci</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>scsi</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='capsType'/>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='pciBackend'/>
Aug 26 08:32:45 user nova-compute[73104]:     </hostdev>
Aug 26 08:32:45 user nova-compute[73104]:     <rng supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='model'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio-transitional</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio-non-transitional</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='backendModel'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>random</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>egd</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>builtin</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </rng>
Aug 26 08:32:45 user nova-compute[73104]:     <filesystem supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='driverType'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>path</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>handle</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtiofs</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </filesystem>
Aug 26 08:32:45 user nova-compute[73104]:     <tpm supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='model'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>tpm-tis</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>tpm-crb</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='backendModel'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>passthrough</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>emulator</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </tpm>
Aug 26 08:32:45 user nova-compute[73104]:   </devices>
Aug 26 08:32:45 user nova-compute[73104]:   <features>
Aug 26 08:32:45 user nova-compute[73104]:     <gic supported='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     <vmcoreinfo supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:     <genid supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:     <backingStoreInput supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:     <backup supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:     <sev supported='no'/>
Aug 26 08:32:45 user nova-compute[73104]:   </features>
Aug 26 08:32:45 user nova-compute[73104]: </domainCapabilities>
Aug 26 08:32:45 user nova-compute[73104]:  {{(pid=73104) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 26 08:32:45 user nova-compute[73104]: <domainCapabilities>
Aug 26 08:32:45 user nova-compute[73104]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 08:32:45 user nova-compute[73104]:   <domain>kvm</domain>
Aug 26 08:32:45 user nova-compute[73104]:   <machine>pc-i440fx-jammy</machine>
Aug 26 08:32:45 user nova-compute[73104]:   <arch>x86_64</arch>
Aug 26 08:32:45 user nova-compute[73104]:   <vcpu max='255'/>
Aug 26 08:32:45 user nova-compute[73104]:   <iothreads supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:   <os supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:     <enum name='firmware'>
Aug 26 08:32:45 user nova-compute[73104]:       <value>efi</value>
Aug 26 08:32:45 user nova-compute[73104]:     </enum>
Aug 26 08:32:45 user nova-compute[73104]:     <loader supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='type'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>rom</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>pflash</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='readonly'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>yes</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>no</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='secure'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>no</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </loader>
Aug 26 08:32:45 user nova-compute[73104]:   </os>
Aug 26 08:32:45 user nova-compute[73104]:   <cpu>
Aug 26 08:32:45 user nova-compute[73104]:     <mode name='host-passthrough' supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='hostPassthroughMigratable'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>on</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>off</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </mode>
Aug 26 08:32:45 user nova-compute[73104]:     <mode name='maximum' supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='maximumMigratable'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>on</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>off</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </mode>
Aug 26 08:32:45 user nova-compute[73104]:     <mode name='host-model' supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <vendor>Intel</vendor>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='ss'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='vmx'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='pcid'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='hypervisor'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='arat'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='umip'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='md-clear'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='stibp'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='ssbd'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='invtsc'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='ibpb'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='ibrs'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='amd-stibp'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='rsba'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='disable' name='erms'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 08:32:45 user nova-compute[73104]:     </mode>
Aug 26 08:32:45 user nova-compute[73104]:     <mode name='custom' supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>qemu64</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>qemu32</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>phenom</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>pentium3</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>pentium2</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>pentium</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>n270</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>kvm64</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>kvm32</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>coreduo</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>core2duo</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>athlon</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>Westmere</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Snowridge</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Server</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Client</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>SandyBridge</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>Penryn</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G5</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G4</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G3</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G2</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>Opteron_G1</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>Nehalem</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>IvyBridge</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Icelake-Server</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Haswell</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>EPYC-Rome</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>EPYC-Milan</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>EPYC</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Dhyana</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Cooperlake</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>Conroe</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Broadwell</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>486</model>
Aug 26 08:32:45 user nova-compute[73104]:     </mode>
Aug 26 08:32:45 user nova-compute[73104]:   </cpu>
Aug 26 08:32:45 user nova-compute[73104]:   <memoryBacking supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:     <enum name='sourceType'>
Aug 26 08:32:45 user nova-compute[73104]:       <value>file</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>anonymous</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>memfd</value>
Aug 26 08:32:45 user nova-compute[73104]:     </enum>
Aug 26 08:32:45 user nova-compute[73104]:   </memoryBacking>
Aug 26 08:32:45 user nova-compute[73104]:   <devices>
Aug 26 08:32:45 user nova-compute[73104]:     <disk supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='diskDevice'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>disk</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>cdrom</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>floppy</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>lun</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='bus'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>ide</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>fdc</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>scsi</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>usb</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>sata</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='model'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio-transitional</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio-non-transitional</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </disk>
Aug 26 08:32:45 user nova-compute[73104]:     <graphics supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='type'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>sdl</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>vnc</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>spice</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>egl-headless</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </graphics>
Aug 26 08:32:45 user nova-compute[73104]:     <video supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='modelType'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>vga</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>cirrus</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>vmvga</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>qxl</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>none</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>bochs</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>ramfb</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </video>
Aug 26 08:32:45 user nova-compute[73104]:     <hostdev supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='mode'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>subsystem</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='startupPolicy'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>default</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>mandatory</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>requisite</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>optional</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='subsysType'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>usb</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>pci</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>scsi</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='capsType'/>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='pciBackend'/>
Aug 26 08:32:45 user nova-compute[73104]:     </hostdev>
Aug 26 08:32:45 user nova-compute[73104]:     <rng supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='model'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio-transitional</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio-non-transitional</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='backendModel'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>random</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>egd</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>builtin</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </rng>
Aug 26 08:32:45 user nova-compute[73104]:     <filesystem supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='driverType'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>path</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>handle</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtiofs</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </filesystem>
Aug 26 08:32:45 user nova-compute[73104]:     <tpm supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='model'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>tpm-tis</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>tpm-crb</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='backendModel'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>passthrough</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>emulator</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </tpm>
Aug 26 08:32:45 user nova-compute[73104]:   </devices>
Aug 26 08:32:45 user nova-compute[73104]:   <features>
Aug 26 08:32:45 user nova-compute[73104]:     <gic supported='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     <vmcoreinfo supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:     <genid supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:     <backingStoreInput supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:     <backup supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:     <sev supported='no'/>
Aug 26 08:32:45 user nova-compute[73104]:   </features>
Aug 26 08:32:45 user nova-compute[73104]: </domainCapabilities>
Aug 26 08:32:45 user nova-compute[73104]:  {{(pid=73104) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 26 08:32:45 user nova-compute[73104]: <domainCapabilities>
Aug 26 08:32:45 user nova-compute[73104]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 08:32:45 user nova-compute[73104]:   <domain>kvm</domain>
Aug 26 08:32:45 user nova-compute[73104]:   <machine>pc-i440fx-6.2</machine>
Aug 26 08:32:45 user nova-compute[73104]:   <arch>x86_64</arch>
Aug 26 08:32:45 user nova-compute[73104]:   <vcpu max='255'/>
Aug 26 08:32:45 user nova-compute[73104]:   <iothreads supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:   <os supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:     <enum name='firmware'>
Aug 26 08:32:45 user nova-compute[73104]:       <value>efi</value>
Aug 26 08:32:45 user nova-compute[73104]:     </enum>
Aug 26 08:32:45 user nova-compute[73104]:     <loader supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='type'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>rom</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>pflash</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='readonly'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>yes</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>no</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='secure'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>no</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </loader>
Aug 26 08:32:45 user nova-compute[73104]:   </os>
Aug 26 08:32:45 user nova-compute[73104]:   <cpu>
Aug 26 08:32:45 user nova-compute[73104]:     <mode name='host-passthrough' supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='hostPassthroughMigratable'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>on</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>off</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </mode>
Aug 26 08:32:45 user nova-compute[73104]:     <mode name='maximum' supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='maximumMigratable'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>on</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>off</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </mode>
Aug 26 08:32:45 user nova-compute[73104]:     <mode name='host-model' supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <vendor>Intel</vendor>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='ss'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='vmx'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='pcid'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='hypervisor'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='arat'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='umip'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='md-clear'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='stibp'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='ssbd'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='invtsc'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='ibpb'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='ibrs'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='amd-stibp'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='rsba'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='disable' name='erms'/>
Aug 26 08:32:45 user nova-compute[73104]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 08:32:45 user nova-compute[73104]:     </mode>
Aug 26 08:32:45 user nova-compute[73104]:     <mode name='custom' supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>qemu64</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>qemu32</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>phenom</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>pentium3</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>pentium2</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>pentium</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>n270</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>kvm64</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>kvm32</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>coreduo</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>core2duo</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>athlon</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>Westmere</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Snowridge</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Server</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Skylake-Client</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>SandyBridge</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>Penryn</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G5</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G4</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G3</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Opteron_G2</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>Opteron_G1</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>Nehalem</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>IvyBridge</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Icelake-Server</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Haswell</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>EPYC-Rome</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>EPYC-Milan</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>EPYC</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Dhyana</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Cooperlake</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>Conroe</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='no'>Broadwell</model>
Aug 26 08:32:45 user nova-compute[73104]:       <model usable='yes'>486</model>
Aug 26 08:32:45 user nova-compute[73104]:     </mode>
Aug 26 08:32:45 user nova-compute[73104]:   </cpu>
Aug 26 08:32:45 user nova-compute[73104]:   <memoryBacking supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:     <enum name='sourceType'>
Aug 26 08:32:45 user nova-compute[73104]:       <value>file</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>anonymous</value>
Aug 26 08:32:45 user nova-compute[73104]:       <value>memfd</value>
Aug 26 08:32:45 user nova-compute[73104]:     </enum>
Aug 26 08:32:45 user nova-compute[73104]:   </memoryBacking>
Aug 26 08:32:45 user nova-compute[73104]:   <devices>
Aug 26 08:32:45 user nova-compute[73104]:     <disk supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='diskDevice'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>disk</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>cdrom</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>floppy</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>lun</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='bus'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>ide</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>fdc</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>scsi</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>usb</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>sata</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='model'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio-transitional</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio-non-transitional</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </disk>
Aug 26 08:32:45 user nova-compute[73104]:     <graphics supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='type'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>sdl</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>vnc</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>spice</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>egl-headless</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </graphics>
Aug 26 08:32:45 user nova-compute[73104]:     <video supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='modelType'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>vga</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>cirrus</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>vmvga</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>qxl</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>none</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>bochs</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>ramfb</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </video>
Aug 26 08:32:45 user nova-compute[73104]:     <hostdev supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='mode'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>subsystem</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='startupPolicy'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>default</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>mandatory</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>requisite</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>optional</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='subsysType'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>usb</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>pci</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>scsi</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='capsType'/>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='pciBackend'/>
Aug 26 08:32:45 user nova-compute[73104]:     </hostdev>
Aug 26 08:32:45 user nova-compute[73104]:     <rng supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='model'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio-transitional</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtio-non-transitional</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='backendModel'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>random</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>egd</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>builtin</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </rng>
Aug 26 08:32:45 user nova-compute[73104]:     <filesystem supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='driverType'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>path</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>handle</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>virtiofs</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </filesystem>
Aug 26 08:32:45 user nova-compute[73104]:     <tpm supported='yes'>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='model'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>tpm-tis</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>tpm-crb</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:       <enum name='backendModel'>
Aug 26 08:32:45 user nova-compute[73104]:         <value>passthrough</value>
Aug 26 08:32:45 user nova-compute[73104]:         <value>emulator</value>
Aug 26 08:32:45 user nova-compute[73104]:       </enum>
Aug 26 08:32:45 user nova-compute[73104]:     </tpm>
Aug 26 08:32:45 user nova-compute[73104]:   </devices>
Aug 26 08:32:45 user nova-compute[73104]:   <features>
Aug 26 08:32:45 user nova-compute[73104]:     <gic supported='no'/>
Aug 26 08:32:45 user nova-compute[73104]:     <vmcoreinfo supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:     <genid supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:     <backingStoreInput supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:     <backup supported='yes'/>
Aug 26 08:32:45 user nova-compute[73104]:     <sev supported='no'/>
Aug 26 08:32:45 user nova-compute[73104]:   </features>
Aug 26 08:32:45 user nova-compute[73104]: </domainCapabilities>
Aug 26 08:32:45 user nova-compute[73104]:  {{(pid=73104) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73104) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73104) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73104) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73104) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Checking secure boot support for host arch (x86_64) {{(pid=73104) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 26 08:32:45 user nova-compute[73104]: INFO nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Secure Boot support detected
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] cpu compare xml: <cpu match="exact">
Aug 26 08:32:45 user nova-compute[73104]:   <model>Nehalem</model>
Aug 26 08:32:45 user nova-compute[73104]: </cpu>
Aug 26 08:32:45 user nova-compute[73104]:  {{(pid=73104) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 26 08:32:45 user nova-compute[73104]: INFO nova.virt.node [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Generated node identity 8a2a2397-4d47-4524-8146-84db4225a812
Aug 26 08:32:45 user nova-compute[73104]: INFO nova.virt.node [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Wrote node identity 8a2a2397-4d47-4524-8146-84db4225a812 to /opt/stack/data/nova/compute_id
Aug 26 08:32:45 user nova-compute[73104]: WARNING nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Compute nodes ['8a2a2397-4d47-4524-8146-84db4225a812'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 26 08:32:45 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 26 08:32:45 user nova-compute[73104]: WARNING nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 26 08:32:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 08:32:45 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:32:45 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:32:45 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Hypervisor/Node resource view: name=user free_ram=10812MB free_disk=25.231761932373047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:32:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:32:45 user nova-compute[73104]: WARNING nova.compute.resource_tracker [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] No compute node record for user:8a2a2397-4d47-4524-8146-84db4225a812: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 8a2a2397-4d47-4524-8146-84db4225a812 could not be found.
Aug 26 08:32:45 user nova-compute[73104]: INFO nova.compute.resource_tracker [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Compute node record created for user:user with uuid: 8a2a2397-4d47-4524-8146-84db4225a812
Aug 26 08:32:46 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 08:32:46 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 08:32:46 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [req-21c06175-e737-4c8f-acdc-723aec73c6c7] Created resource provider record via placement API for resource provider with UUID 8a2a2397-4d47-4524-8146-84db4225a812 and name user.
Aug 26 08:32:46 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73104) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 26 08:32:46 user nova-compute[73104]: INFO nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] kernel doesn't support AMD SEV
Aug 26 08:32:46 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Updating inventory in ProviderTree for provider 8a2a2397-4d47-4524-8146-84db4225a812 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 08:32:46 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:32:46 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Libvirt baseline CPU <cpu>
Aug 26 08:32:46 user nova-compute[73104]:   <arch>x86_64</arch>
Aug 26 08:32:46 user nova-compute[73104]:   <model>Nehalem</model>
Aug 26 08:32:46 user nova-compute[73104]:   <vendor>Intel</vendor>
Aug 26 08:32:46 user nova-compute[73104]:   <topology sockets="6" cores="1" threads="1"/>
Aug 26 08:32:46 user nova-compute[73104]: </cpu>
Aug 26 08:32:46 user nova-compute[73104]:  {{(pid=73104) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 26 08:32:46 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Updated inventory for provider 8a2a2397-4d47-4524-8146-84db4225a812 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 26 08:32:46 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Updating resource provider 8a2a2397-4d47-4524-8146-84db4225a812 generation from 0 to 1 during operation: update_inventory {{(pid=73104) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 26 08:32:46 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Updating inventory in ProviderTree for provider 8a2a2397-4d47-4524-8146-84db4225a812 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 08:32:46 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Updating resource provider 8a2a2397-4d47-4524-8146-84db4225a812 generation from 1 to 2 during operation: update_traits {{(pid=73104) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 26 08:32:46 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 08:32:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.638s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:32:46 user nova-compute[73104]: DEBUG nova.service [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Creating RPC server for service compute {{(pid=73104) start /opt/stack/nova/nova/service.py:182}}
Aug 26 08:32:46 user nova-compute[73104]: DEBUG nova.service [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Join ServiceGroup membership for this service compute {{(pid=73104) start /opt/stack/nova/nova/service.py:199}}
Aug 26 08:32:46 user nova-compute[73104]: DEBUG nova.servicegroup.drivers.db [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73104) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 26 08:32:47 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:32:47 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:33:37 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:33:37 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:33:37 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 08:33:37 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Rebuilding the list of instances to heal {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 08:33:37 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Didn't find any instances for network info cache update. {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 08:33:37 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:33:37 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:33:37 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:33:37 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:33:37 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:33:37 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:33:37 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 08:33:37 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:33:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:33:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:33:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:33:37 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 08:33:37 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:33:37 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:33:37 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=10222MB free_disk=25.135482788085938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 08:33:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:33:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:33:37 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 08:33:37 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 08:33:37 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:33:37 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:33:37 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 08:33:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:34:37 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:34:37 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:34:37 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 08:34:37 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Rebuilding the list of instances to heal {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 08:34:37 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Didn't find any instances for network info cache update. {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 08:34:37 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:34:38 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:34:38 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:34:38 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 08:34:39 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:34:39 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:34:39 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:34:39 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:34:39 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:34:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:34:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:34:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:34:39 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 08:34:39 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:34:39 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:34:39 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=10132MB free_disk=25.182159423828125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 08:34:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:34:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:34:39 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 08:34:39 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 08:34:39 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:34:39 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:34:39 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 08:34:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.106s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:35:37 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:35:37 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 08:35:37 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Rebuilding the list of instances to heal {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 08:35:37 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Didn't find any instances for network info cache update. {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 08:35:38 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:35:38 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 08:35:39 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:35:39 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:35:40 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:35:41 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:35:41 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:35:41 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:35:41 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:35:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:35:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:35:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:35:41 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 08:35:41 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:35:41 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:35:41 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=10137MB free_disk=24.965782165527344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 08:35:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:35:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:35:41 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 08:35:41 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 08:35:41 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:35:41 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:35:41 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 08:35:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:36:38 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:36:38 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 08:36:38 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Rebuilding the list of instances to heal {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 08:36:38 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Didn't find any instances for network info cache update. {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 08:36:40 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:36:40 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:36:40 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:36:40 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 08:36:41 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:36:42 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:36:42 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:36:42 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:36:42 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:36:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:36:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:36:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:36:42 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 08:36:42 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:36:42 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:36:42 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=9404MB free_disk=24.98894500732422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 08:36:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:36:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:36:42 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 08:36:42 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 08:36:42 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:36:42 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:36:42 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 08:36:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:36:43 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:36:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Acquiring lock "dcec7631-b94f-4dbf-b85d-e8ad9c6396b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:36:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lock "dcec7631-b94f-4dbf-b85d-e8ad9c6396b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:36:48 user nova-compute[73104]: DEBUG nova.compute.manager [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:36:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:36:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:36:48 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:36:48 user nova-compute[73104]: INFO nova.compute.claims [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Claim successful on node user
Aug 26 08:36:48 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:36:48 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:36:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:36:48 user nova-compute[73104]: DEBUG nova.compute.manager [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:36:49 user nova-compute[73104]: DEBUG nova.compute.manager [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:36:49 user nova-compute[73104]: DEBUG nova.network.neutron [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:36:49 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:36:49 user nova-compute[73104]: DEBUG nova.compute.manager [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:36:49 user nova-compute[73104]: DEBUG nova.compute.manager [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:36:49 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:36:49 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Creating image(s)
Aug 26 08:36:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Acquiring lock "/opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:36:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lock "/opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:36:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lock "/opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:36:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:36:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:36:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5.part --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:36:50 user nova-compute[73104]: DEBUG nova.policy [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7ceab3a9cd7496fae6a08b9ea8cc513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0141c91ef45e4bf23a4b1cc4eb029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:36:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5.part --force-share --output=json" returned: 0 in 0.181s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:36:50 user nova-compute[73104]: DEBUG nova.virt.images [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] e28116ef-1f27-40e2-be41-f8cc5c10ee86 was qcow2, converting to raw {{(pid=73104) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 08:36:50 user nova-compute[73104]: DEBUG nova.privsep.utils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73104) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 08:36:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5.part /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5.converted {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:36:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5.part /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5.converted" returned: 0 in 0.609s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:36:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5.converted --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:36:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:36:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.715s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:36:50 user nova-compute[73104]: INFO oslo.privsep.daemon [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpfccrvhqz/privsep.sock']
Aug 26 08:36:50 user sudo[82368]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpfccrvhqz/privsep.sock
Aug 26 08:36:50 user sudo[82368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 26 08:36:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Acquiring lock "995a2bd3-4c54-4217-ae9f-056353008547" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:36:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Lock "995a2bd3-4c54-4217-ae9f-056353008547" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:36:51 user nova-compute[73104]: DEBUG nova.compute.manager [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:36:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:36:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:36:52 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:36:52 user nova-compute[73104]: INFO nova.compute.claims [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Claim successful on node user
Aug 26 08:36:52 user nova-compute[73104]: DEBUG nova.network.neutron [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Successfully created port: be09acc4-f1a1-40a1-bfab-90b23ac8000c {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:36:52 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:36:52 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:36:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.303s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:36:52 user nova-compute[73104]: DEBUG nova.compute.manager [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:36:52 user nova-compute[73104]: DEBUG nova.compute.manager [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:36:52 user nova-compute[73104]: DEBUG nova.network.neutron [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:36:52 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:36:52 user nova-compute[73104]: DEBUG nova.compute.manager [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:36:52 user nova-compute[73104]: DEBUG nova.compute.manager [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:36:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:36:52 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Creating image(s)
Aug 26 08:36:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Acquiring lock "/opt/stack/data/nova/instances/995a2bd3-4c54-4217-ae9f-056353008547/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:36:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Lock "/opt/stack/data/nova/instances/995a2bd3-4c54-4217-ae9f-056353008547/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:36:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Lock "/opt/stack/data/nova/instances/995a2bd3-4c54-4217-ae9f-056353008547/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:36:52 user nova-compute[73104]: DEBUG nova.policy [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'caf726272cda444f9c0b3608c65ddbf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a18c60d10444189783f4d50d2e6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:36:52 user sudo[82368]: pam_unix(sudo:session): session closed for user root
Aug 26 08:36:52 user nova-compute[73104]: INFO oslo.privsep.daemon [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Spawned new privsep daemon via rootwrap
Aug 26 08:36:52 user nova-compute[73104]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 08:36:52 user nova-compute[73104]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 08:36:52 user nova-compute[73104]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 26 08:36:52 user nova-compute[73104]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82376
Aug 26 08:36:52 user nova-compute[73104]: WARNING oslo_privsep.priv_context [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] privsep daemon already running
Aug 26 08:36:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:36:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:36:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.228s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:36:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:36:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:36:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:36:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.233s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:36:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:36:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.183s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:36:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/995a2bd3-4c54-4217-ae9f-056353008547/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:36:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/995a2bd3-4c54-4217-ae9f-056353008547/disk 1073741824" returned: 0 in 0.052s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:36:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:36:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:36:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.234s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:36:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:36:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.162s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:36:53 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Checking if we can resize image /opt/stack/data/nova/instances/995a2bd3-4c54-4217-ae9f-056353008547/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 08:36:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995a2bd3-4c54-4217-ae9f-056353008547/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:36:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.174s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:36:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:36:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk 1073741824" returned: 0 in 0.052s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:36:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:36:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:36:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995a2bd3-4c54-4217-ae9f-056353008547/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:36:53 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Cannot resize image /opt/stack/data/nova/instances/995a2bd3-4c54-4217-ae9f-056353008547/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 08:36:53 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:36:53 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Ensure instance console log exists: /opt/stack/data/nova/instances/995a2bd3-4c54-4217-ae9f-056353008547/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:36:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:36:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:36:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:36:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.218s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:36:54 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 08:36:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:36:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:36:54 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Cannot resize image /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 08:36:54 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:36:54 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Ensure instance console log exists: /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:36:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:36:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:36:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:36:54 user nova-compute[73104]: DEBUG nova.network.neutron [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Successfully created port: 911335fb-63d7-4381-ac34-a47bb61d2b7e {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:36:55 user nova-compute[73104]: DEBUG nova.network.neutron [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Successfully updated port: be09acc4-f1a1-40a1-bfab-90b23ac8000c {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:36:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Acquiring lock "refresh_cache-dcec7631-b94f-4dbf-b85d-e8ad9c6396b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:36:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Acquired lock "refresh_cache-dcec7631-b94f-4dbf-b85d-e8ad9c6396b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:36:55 user nova-compute[73104]: DEBUG nova.network.neutron [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:36:55 user nova-compute[73104]: DEBUG nova.network.neutron [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:36:55 user nova-compute[73104]: DEBUG nova.compute.manager [req-f32bc5f8-acc6-4823-8265-f4f8ff6b9476 req-95811d7f-4f8b-4532-85da-41ebb6fee036 service nova] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Received event network-changed-be09acc4-f1a1-40a1-bfab-90b23ac8000c {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:36:55 user nova-compute[73104]: DEBUG nova.compute.manager [req-f32bc5f8-acc6-4823-8265-f4f8ff6b9476 req-95811d7f-4f8b-4532-85da-41ebb6fee036 service nova] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Refreshing instance network info cache due to event network-changed-be09acc4-f1a1-40a1-bfab-90b23ac8000c. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:36:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f32bc5f8-acc6-4823-8265-f4f8ff6b9476 req-95811d7f-4f8b-4532-85da-41ebb6fee036 service nova] Acquiring lock "refresh_cache-dcec7631-b94f-4dbf-b85d-e8ad9c6396b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:36:56 user nova-compute[73104]: DEBUG nova.network.neutron [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Successfully updated port: 911335fb-63d7-4381-ac34-a47bb61d2b7e {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:36:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Acquiring lock "refresh_cache-995a2bd3-4c54-4217-ae9f-056353008547" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:36:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Acquired lock "refresh_cache-995a2bd3-4c54-4217-ae9f-056353008547" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:36:56 user nova-compute[73104]: DEBUG nova.network.neutron [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:36:56 user nova-compute[73104]: DEBUG nova.network.neutron [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Updating instance_info_cache with network_info: [{"id": "be09acc4-f1a1-40a1-bfab-90b23ac8000c", "address": "fa:16:3e:f0:64:0b", "network": {"id": "c6ce9852-f528-4ac1-aa7a-be833ed25137", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2003310403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a0141c91ef45e4bf23a4b1cc4eb029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe09acc4-f1", "ovs_interfaceid": "be09acc4-f1a1-40a1-bfab-90b23ac8000c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:36:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Releasing lock "refresh_cache-dcec7631-b94f-4dbf-b85d-e8ad9c6396b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:36:56 user nova-compute[73104]: DEBUG nova.compute.manager [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Instance network_info: |[{"id": "be09acc4-f1a1-40a1-bfab-90b23ac8000c", "address": "fa:16:3e:f0:64:0b", "network": {"id": "c6ce9852-f528-4ac1-aa7a-be833ed25137", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2003310403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a0141c91ef45e4bf23a4b1cc4eb029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe09acc4-f1", "ovs_interfaceid": "be09acc4-f1a1-40a1-bfab-90b23ac8000c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:36:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f32bc5f8-acc6-4823-8265-f4f8ff6b9476 req-95811d7f-4f8b-4532-85da-41ebb6fee036 service nova] Acquired lock "refresh_cache-dcec7631-b94f-4dbf-b85d-e8ad9c6396b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:36:56 user nova-compute[73104]: DEBUG nova.network.neutron [req-f32bc5f8-acc6-4823-8265-f4f8ff6b9476 req-95811d7f-4f8b-4532-85da-41ebb6fee036 service nova] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Refreshing network info cache for port be09acc4-f1a1-40a1-bfab-90b23ac8000c {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:36:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Start _get_guest_xml network_info=[{"id": "be09acc4-f1a1-40a1-bfab-90b23ac8000c", "address": "fa:16:3e:f0:64:0b", "network": {"id": "c6ce9852-f528-4ac1-aa7a-be833ed25137", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2003310403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a0141c91ef45e4bf23a4b1cc4eb029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe09acc4-f1", "ovs_interfaceid": "be09acc4-f1a1-40a1-bfab-90b23ac8000c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:36:56 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:36:56 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:36:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:36:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:36:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:36:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:36:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:36:56 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:36:56 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:36:56 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:36:56 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:36:56 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:36:56 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:36:56 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:36:56 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:36:56 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:36:56 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:36:56 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:36:56 user nova-compute[73104]: DEBUG nova.privsep.utils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73104) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 08:36:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:36:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1292953899',display_name='tempest-ServersNegativeTestJSON-server-1292953899',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1292953899',id=1,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35a0141c91ef45e4bf23a4b1cc4eb029',ramdisk_id='',reservation_id='r-1j366f9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1313163796',owner_user_name='tempest-ServersNegativeTestJSON-1313163796-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:36:49Z,user_data=None,user_id='d7ceab3a9cd7496fae6a08b9ea8cc513',uuid=dcec7631-b94f-4dbf-b85d-e8ad9c6396b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be09acc4-f1a1-40a1-bfab-90b23ac8000c", "address": "fa:16:3e:f0:64:0b", "network": {"id": "c6ce9852-f528-4ac1-aa7a-be833ed25137", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2003310403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a0141c91ef45e4bf23a4b1cc4eb029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe09acc4-f1", "ovs_interfaceid": "be09acc4-f1a1-40a1-bfab-90b23ac8000c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:36:56 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Converting VIF {"id": "be09acc4-f1a1-40a1-bfab-90b23ac8000c", "address": "fa:16:3e:f0:64:0b", "network": {"id": "c6ce9852-f528-4ac1-aa7a-be833ed25137", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2003310403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a0141c91ef45e4bf23a4b1cc4eb029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe09acc4-f1", "ovs_interfaceid": "be09acc4-f1a1-40a1-bfab-90b23ac8000c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:36:56 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:64:0b,bridge_name='br-int',has_traffic_filtering=True,id=be09acc4-f1a1-40a1-bfab-90b23ac8000c,network=Network(c6ce9852-f528-4ac1-aa7a-be833ed25137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe09acc4-f1') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:36:56 user nova-compute[73104]: DEBUG nova.objects.instance [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lazy-loading 'pci_devices' on Instance uuid dcec7631-b94f-4dbf-b85d-e8ad9c6396b7 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:36:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:36:56 user nova-compute[73104]:   <uuid>dcec7631-b94f-4dbf-b85d-e8ad9c6396b7</uuid>
Aug 26 08:36:56 user nova-compute[73104]:   <name>instance-00000001</name>
Aug 26 08:36:56 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:36:56 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:36:56 user nova-compute[73104]:   <metadata>
Aug 26 08:36:56 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:36:56 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:36:56 user nova-compute[73104]:       <nova:name>tempest-ServersNegativeTestJSON-server-1292953899</nova:name>
Aug 26 08:36:56 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:36:56</nova:creationTime>
Aug 26 08:36:56 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:36:56 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:36:56 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:36:56 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:36:56 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:36:56 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:36:56 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:36:56 user nova-compute[73104]:       <nova:owner>
Aug 26 08:36:56 user nova-compute[73104]:         <nova:user uuid="d7ceab3a9cd7496fae6a08b9ea8cc513">tempest-ServersNegativeTestJSON-1313163796-project-member</nova:user>
Aug 26 08:36:56 user nova-compute[73104]:         <nova:project uuid="35a0141c91ef45e4bf23a4b1cc4eb029">tempest-ServersNegativeTestJSON-1313163796</nova:project>
Aug 26 08:36:56 user nova-compute[73104]:       </nova:owner>
Aug 26 08:36:56 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:36:56 user nova-compute[73104]:       <nova:ports>
Aug 26 08:36:56 user nova-compute[73104]:         <nova:port uuid="be09acc4-f1a1-40a1-bfab-90b23ac8000c">
Aug 26 08:36:56 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 08:36:56 user nova-compute[73104]:         </nova:port>
Aug 26 08:36:56 user nova-compute[73104]:       </nova:ports>
Aug 26 08:36:56 user nova-compute[73104]:     </nova:instance>
Aug 26 08:36:56 user nova-compute[73104]:   </metadata>
Aug 26 08:36:56 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:36:56 user nova-compute[73104]:     <system>
Aug 26 08:36:56 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:36:56 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:36:56 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:36:56 user nova-compute[73104]:       <entry name="serial">dcec7631-b94f-4dbf-b85d-e8ad9c6396b7</entry>
Aug 26 08:36:56 user nova-compute[73104]:       <entry name="uuid">dcec7631-b94f-4dbf-b85d-e8ad9c6396b7</entry>
Aug 26 08:36:56 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:36:56 user nova-compute[73104]:     </system>
Aug 26 08:36:56 user nova-compute[73104]:   </sysinfo>
Aug 26 08:36:56 user nova-compute[73104]:   <os>
Aug 26 08:36:56 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:36:56 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:36:56 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:36:56 user nova-compute[73104]:   </os>
Aug 26 08:36:56 user nova-compute[73104]:   <features>
Aug 26 08:36:56 user nova-compute[73104]:     <acpi/>
Aug 26 08:36:56 user nova-compute[73104]:     <apic/>
Aug 26 08:36:56 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:36:56 user nova-compute[73104]:   </features>
Aug 26 08:36:56 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:36:56 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:36:56 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:36:56 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:36:56 user nova-compute[73104]:   </clock>
Aug 26 08:36:56 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:36:56 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:36:56 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:36:56 user nova-compute[73104]:   </cpu>
Aug 26 08:36:56 user nova-compute[73104]:   <devices>
Aug 26 08:36:56 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:36:56 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:36:56 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk"/>
Aug 26 08:36:56 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:36:56 user nova-compute[73104]:     </disk>
Aug 26 08:36:56 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:36:56 user nova-compute[73104]:       <mac address="fa:16:3e:f0:64:0b"/>
Aug 26 08:36:56 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:36:56 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:36:56 user nova-compute[73104]:       <target dev="tapbe09acc4-f1"/>
Aug 26 08:36:56 user nova-compute[73104]:     </interface>
Aug 26 08:36:56 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:36:56 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/console.log" append="off"/>
Aug 26 08:36:56 user nova-compute[73104]:     </serial>
Aug 26 08:36:56 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:36:56 user nova-compute[73104]:     <video>
Aug 26 08:36:56 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:36:56 user nova-compute[73104]:     </video>
Aug 26 08:36:56 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:36:56 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:36:56 user nova-compute[73104]:     </rng>
Aug 26 08:36:56 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:36:56 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:36:56 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:36:56 user nova-compute[73104]:     </memballoon>
Aug 26 08:36:56 user nova-compute[73104]:   </devices>
Aug 26 08:36:56 user nova-compute[73104]: </domain>
Aug 26 08:36:56 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:36:57 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:36:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1292953899',display_name='tempest-ServersNegativeTestJSON-server-1292953899',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1292953899',id=1,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35a0141c91ef45e4bf23a4b1cc4eb029',ramdisk_id='',reservation_id='r-1j366f9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1313163796',owner_user_name='tempest-ServersNegativeTestJSON-1313163796-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:36:49Z,user_data=None,user_id='d7ceab3a9cd7496fae6a08b9ea8cc513',uuid=dcec7631-b94f-4dbf-b85d-e8ad9c6396b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be09acc4-f1a1-40a1-bfab-90b23ac8000c", "address": "fa:16:3e:f0:64:0b", "network": {"id": "c6ce9852-f528-4ac1-aa7a-be833ed25137", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2003310403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a0141c91ef45e4bf23a4b1cc4eb029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe09acc4-f1", "ovs_interfaceid": "be09acc4-f1a1-40a1-bfab-90b23ac8000c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:36:57 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Converting VIF {"id": "be09acc4-f1a1-40a1-bfab-90b23ac8000c", "address": "fa:16:3e:f0:64:0b", "network": {"id": "c6ce9852-f528-4ac1-aa7a-be833ed25137", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2003310403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a0141c91ef45e4bf23a4b1cc4eb029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe09acc4-f1", "ovs_interfaceid": "be09acc4-f1a1-40a1-bfab-90b23ac8000c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:36:57 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:64:0b,bridge_name='br-int',has_traffic_filtering=True,id=be09acc4-f1a1-40a1-bfab-90b23ac8000c,network=Network(c6ce9852-f528-4ac1-aa7a-be833ed25137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe09acc4-f1') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:36:57 user nova-compute[73104]: DEBUG os_vif [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:64:0b,bridge_name='br-int',has_traffic_filtering=True,id=be09acc4-f1a1-40a1-bfab-90b23ac8000c,network=Network(c6ce9852-f528-4ac1-aa7a-be833ed25137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe09acc4-f1') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:36:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Created schema index Interface.name {{(pid=73104) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 26 08:36:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Created schema index Port.name {{(pid=73104) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 26 08:36:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Created schema index Bridge.name {{(pid=73104) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 26 08:36:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 08:36:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [POLLOUT] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:36:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 08:36:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:36:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:36:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:36:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:36:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:36:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:36:57 user nova-compute[73104]: INFO oslo.privsep.daemon [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmppfes1abx/privsep.sock']
Aug 26 08:36:57 user sudo[82421]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmppfes1abx/privsep.sock
Aug 26 08:36:57 user sudo[82421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 26 08:36:57 user nova-compute[73104]: DEBUG nova.compute.manager [req-ccbedbe3-d37b-4798-b281-055fbcd5ea6e req-e17091ee-2313-4c2b-a96b-854405b33f2f service nova] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Received event network-changed-911335fb-63d7-4381-ac34-a47bb61d2b7e {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:36:57 user nova-compute[73104]: DEBUG nova.compute.manager [req-ccbedbe3-d37b-4798-b281-055fbcd5ea6e req-e17091ee-2313-4c2b-a96b-854405b33f2f service nova] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Refreshing instance network info cache due to event network-changed-911335fb-63d7-4381-ac34-a47bb61d2b7e. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:36:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ccbedbe3-d37b-4798-b281-055fbcd5ea6e req-e17091ee-2313-4c2b-a96b-854405b33f2f service nova] Acquiring lock "refresh_cache-995a2bd3-4c54-4217-ae9f-056353008547" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:36:57 user nova-compute[73104]: DEBUG nova.network.neutron [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:36:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "94de2062-7017-44fe-8df0-0a3cd63d5498" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:36:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:36:57 user nova-compute[73104]: DEBUG nova.compute.manager [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:36:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:36:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:36:57 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:36:57 user nova-compute[73104]: INFO nova.compute.claims [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Claim successful on node user
Aug 26 08:36:57 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:36:57 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:36:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.327s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:36:57 user nova-compute[73104]: DEBUG nova.compute.manager [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:36:57 user nova-compute[73104]: DEBUG nova.compute.manager [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:36:57 user nova-compute[73104]: DEBUG nova.network.neutron [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:36:57 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:36:58 user nova-compute[73104]: DEBUG nova.compute.manager [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:36:58 user nova-compute[73104]: DEBUG nova.compute.manager [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:36:58 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:36:58 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Creating image(s)
Aug 26 08:36:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "/opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:36:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "/opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:36:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "/opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:36:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:36:58 user nova-compute[73104]: DEBUG nova.policy [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db3ae37701df47a5b35026fe3857bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770daa2e8b274a9b828e489c1573ced4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:36:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:36:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.161s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:36:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:36:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:36:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:36:58 user nova-compute[73104]: DEBUG nova.network.neutron [req-f32bc5f8-acc6-4823-8265-f4f8ff6b9476 req-95811d7f-4f8b-4532-85da-41ebb6fee036 service nova] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Updated VIF entry in instance network info cache for port be09acc4-f1a1-40a1-bfab-90b23ac8000c. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:36:58 user nova-compute[73104]: DEBUG nova.network.neutron [req-f32bc5f8-acc6-4823-8265-f4f8ff6b9476 req-95811d7f-4f8b-4532-85da-41ebb6fee036 service nova] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Updating instance_info_cache with network_info: [{"id": "be09acc4-f1a1-40a1-bfab-90b23ac8000c", "address": "fa:16:3e:f0:64:0b", "network": {"id": "c6ce9852-f528-4ac1-aa7a-be833ed25137", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2003310403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a0141c91ef45e4bf23a4b1cc4eb029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe09acc4-f1", "ovs_interfaceid": "be09acc4-f1a1-40a1-bfab-90b23ac8000c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:36:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f32bc5f8-acc6-4823-8265-f4f8ff6b9476 req-95811d7f-4f8b-4532-85da-41ebb6fee036 service nova] Releasing lock "refresh_cache-dcec7631-b94f-4dbf-b85d-e8ad9c6396b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:36:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.160s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:36:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:36:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk 1073741824" returned: 0 in 0.052s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:36:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:36:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:36:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.192s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:36:58 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 08:36:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:36:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:36:58 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Cannot resize image /opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 08:36:58 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:36:58 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Ensure instance console log exists: /opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:36:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:36:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:36:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:36:59 user sudo[82421]: pam_unix(sudo:session): session closed for user root
Aug 26 08:36:59 user nova-compute[73104]: INFO oslo.privsep.daemon [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Spawned new privsep daemon via rootwrap
Aug 26 08:36:59 user nova-compute[73104]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 08:36:59 user nova-compute[73104]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 08:36:59 user nova-compute[73104]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 26 08:36:59 user nova-compute[73104]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82437
Aug 26 08:36:59 user nova-compute[73104]: DEBUG nova.network.neutron [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Updating instance_info_cache with network_info: [{"id": "911335fb-63d7-4381-ac34-a47bb61d2b7e", "address": "fa:16:3e:a3:26:d9", "network": {"id": "377250a7-e055-47b7-b42d-10b634024239", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-158207792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "723a18c60d10444189783f4d50d2e6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap911335fb-63", "ovs_interfaceid": "911335fb-63d7-4381-ac34-a47bb61d2b7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Releasing lock "refresh_cache-995a2bd3-4c54-4217-ae9f-056353008547" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG nova.compute.manager [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Instance network_info: |[{"id": "911335fb-63d7-4381-ac34-a47bb61d2b7e", "address": "fa:16:3e:a3:26:d9", "network": {"id": "377250a7-e055-47b7-b42d-10b634024239", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-158207792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "723a18c60d10444189783f4d50d2e6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap911335fb-63", "ovs_interfaceid": "911335fb-63d7-4381-ac34-a47bb61d2b7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ccbedbe3-d37b-4798-b281-055fbcd5ea6e req-e17091ee-2313-4c2b-a96b-854405b33f2f service nova] Acquired lock "refresh_cache-995a2bd3-4c54-4217-ae9f-056353008547" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG nova.network.neutron [req-ccbedbe3-d37b-4798-b281-055fbcd5ea6e req-e17091ee-2313-4c2b-a96b-854405b33f2f service nova] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Refreshing network info cache for port 911335fb-63d7-4381-ac34-a47bb61d2b7e {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Start _get_guest_xml network_info=[{"id": "911335fb-63d7-4381-ac34-a47bb61d2b7e", "address": "fa:16:3e:a3:26:d9", "network": {"id": "377250a7-e055-47b7-b42d-10b634024239", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-158207792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "723a18c60d10444189783f4d50d2e6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap911335fb-63", "ovs_interfaceid": "911335fb-63d7-4381-ac34-a47bb61d2b7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:36:59 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:36:59 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:36:59 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-522228798',display_name='tempest-DeleteServersTestJSON-server-522228798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-522228798',id=2,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='723a18c60d10444189783f4d50d2e6a7',ramdisk_id='',reservation_id='r-oum0sotf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1633599130',owner_user_name='tempest-DeleteServersTestJSON-1633599130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:36:53Z,user_data=None,user_id='caf726272cda444f9c0b3608c65ddbf1',uuid=995a2bd3-4c54-4217-ae9f-056353008547,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "911335fb-63d7-4381-ac34-a47bb61d2b7e", "address": "fa:16:3e:a3:26:d9", "network": {"id": "377250a7-e055-47b7-b42d-10b634024239", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-158207792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "723a18c60d10444189783f4d50d2e6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap911335fb-63", "ovs_interfaceid": "911335fb-63d7-4381-ac34-a47bb61d2b7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Converting VIF {"id": "911335fb-63d7-4381-ac34-a47bb61d2b7e", "address": "fa:16:3e:a3:26:d9", "network": {"id": "377250a7-e055-47b7-b42d-10b634024239", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-158207792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "723a18c60d10444189783f4d50d2e6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap911335fb-63", "ovs_interfaceid": "911335fb-63d7-4381-ac34-a47bb61d2b7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:26:d9,bridge_name='br-int',has_traffic_filtering=True,id=911335fb-63d7-4381-ac34-a47bb61d2b7e,network=Network(377250a7-e055-47b7-b42d-10b634024239),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap911335fb-63') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG nova.objects.instance [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Lazy-loading 'pci_devices' on Instance uuid 995a2bd3-4c54-4217-ae9f-056353008547 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:36:59 user nova-compute[73104]:   <uuid>995a2bd3-4c54-4217-ae9f-056353008547</uuid>
Aug 26 08:36:59 user nova-compute[73104]:   <name>instance-00000002</name>
Aug 26 08:36:59 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:36:59 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:36:59 user nova-compute[73104]:   <metadata>
Aug 26 08:36:59 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:36:59 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:36:59 user nova-compute[73104]:       <nova:name>tempest-DeleteServersTestJSON-server-522228798</nova:name>
Aug 26 08:36:59 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:36:59</nova:creationTime>
Aug 26 08:36:59 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:36:59 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:36:59 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:36:59 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:36:59 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:36:59 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:36:59 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:36:59 user nova-compute[73104]:       <nova:owner>
Aug 26 08:36:59 user nova-compute[73104]:         <nova:user uuid="caf726272cda444f9c0b3608c65ddbf1">tempest-DeleteServersTestJSON-1633599130-project-member</nova:user>
Aug 26 08:36:59 user nova-compute[73104]:         <nova:project uuid="723a18c60d10444189783f4d50d2e6a7">tempest-DeleteServersTestJSON-1633599130</nova:project>
Aug 26 08:36:59 user nova-compute[73104]:       </nova:owner>
Aug 26 08:36:59 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:36:59 user nova-compute[73104]:       <nova:ports>
Aug 26 08:36:59 user nova-compute[73104]:         <nova:port uuid="911335fb-63d7-4381-ac34-a47bb61d2b7e">
Aug 26 08:36:59 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 08:36:59 user nova-compute[73104]:         </nova:port>
Aug 26 08:36:59 user nova-compute[73104]:       </nova:ports>
Aug 26 08:36:59 user nova-compute[73104]:     </nova:instance>
Aug 26 08:36:59 user nova-compute[73104]:   </metadata>
Aug 26 08:36:59 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:36:59 user nova-compute[73104]:     <system>
Aug 26 08:36:59 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:36:59 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:36:59 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:36:59 user nova-compute[73104]:       <entry name="serial">995a2bd3-4c54-4217-ae9f-056353008547</entry>
Aug 26 08:36:59 user nova-compute[73104]:       <entry name="uuid">995a2bd3-4c54-4217-ae9f-056353008547</entry>
Aug 26 08:36:59 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:36:59 user nova-compute[73104]:     </system>
Aug 26 08:36:59 user nova-compute[73104]:   </sysinfo>
Aug 26 08:36:59 user nova-compute[73104]:   <os>
Aug 26 08:36:59 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:36:59 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:36:59 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:36:59 user nova-compute[73104]:   </os>
Aug 26 08:36:59 user nova-compute[73104]:   <features>
Aug 26 08:36:59 user nova-compute[73104]:     <acpi/>
Aug 26 08:36:59 user nova-compute[73104]:     <apic/>
Aug 26 08:36:59 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:36:59 user nova-compute[73104]:   </features>
Aug 26 08:36:59 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:36:59 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:36:59 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:36:59 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:36:59 user nova-compute[73104]:   </clock>
Aug 26 08:36:59 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:36:59 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:36:59 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:36:59 user nova-compute[73104]:   </cpu>
Aug 26 08:36:59 user nova-compute[73104]:   <devices>
Aug 26 08:36:59 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:36:59 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:36:59 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/995a2bd3-4c54-4217-ae9f-056353008547/disk"/>
Aug 26 08:36:59 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:36:59 user nova-compute[73104]:     </disk>
Aug 26 08:36:59 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:36:59 user nova-compute[73104]:       <mac address="fa:16:3e:a3:26:d9"/>
Aug 26 08:36:59 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:36:59 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:36:59 user nova-compute[73104]:       <target dev="tap911335fb-63"/>
Aug 26 08:36:59 user nova-compute[73104]:     </interface>
Aug 26 08:36:59 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:36:59 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/995a2bd3-4c54-4217-ae9f-056353008547/console.log" append="off"/>
Aug 26 08:36:59 user nova-compute[73104]:     </serial>
Aug 26 08:36:59 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:36:59 user nova-compute[73104]:     <video>
Aug 26 08:36:59 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:36:59 user nova-compute[73104]:     </video>
Aug 26 08:36:59 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:36:59 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:36:59 user nova-compute[73104]:     </rng>
Aug 26 08:36:59 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:36:59 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:36:59 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:36:59 user nova-compute[73104]:     </memballoon>
Aug 26 08:36:59 user nova-compute[73104]:   </devices>
Aug 26 08:36:59 user nova-compute[73104]: </domain>
Aug 26 08:36:59 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-522228798',display_name='tempest-DeleteServersTestJSON-server-522228798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-522228798',id=2,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='723a18c60d10444189783f4d50d2e6a7',ramdisk_id='',reservation_id='r-oum0sotf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1633599130',owner_user_name='tempest-DeleteServersTestJSON-1633599130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:36:53Z,user_data=None,user_id='caf726272cda444f9c0b3608c65ddbf1',uuid=995a2bd3-4c54-4217-ae9f-056353008547,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "911335fb-63d7-4381-ac34-a47bb61d2b7e", "address": "fa:16:3e:a3:26:d9", "network": {"id": "377250a7-e055-47b7-b42d-10b634024239", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-158207792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "723a18c60d10444189783f4d50d2e6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap911335fb-63", "ovs_interfaceid": "911335fb-63d7-4381-ac34-a47bb61d2b7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Converting VIF {"id": "911335fb-63d7-4381-ac34-a47bb61d2b7e", "address": "fa:16:3e:a3:26:d9", "network": {"id": "377250a7-e055-47b7-b42d-10b634024239", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-158207792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "723a18c60d10444189783f4d50d2e6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap911335fb-63", "ovs_interfaceid": "911335fb-63d7-4381-ac34-a47bb61d2b7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:26:d9,bridge_name='br-int',has_traffic_filtering=True,id=911335fb-63d7-4381-ac34-a47bb61d2b7e,network=Network(377250a7-e055-47b7-b42d-10b634024239),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap911335fb-63') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG os_vif [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:26:d9,bridge_name='br-int',has_traffic_filtering=True,id=911335fb-63d7-4381-ac34-a47bb61d2b7e,network=Network(377250a7-e055-47b7-b42d-10b634024239),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap911335fb-63') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe09acc4-f1, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbe09acc4-f1, col_values=(('external_ids', {'iface-id': 'be09acc4-f1a1-40a1-bfab-90b23ac8000c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:64:0b', 'vm-uuid': 'dcec7631-b94f-4dbf-b85d-e8ad9c6396b7'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:36:59 user nova-compute[73104]: INFO os_vif [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:64:0b,bridge_name='br-int',has_traffic_filtering=True,id=be09acc4-f1a1-40a1-bfab-90b23ac8000c,network=Network(c6ce9852-f528-4ac1-aa7a-be833ed25137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe09acc4-f1')
Aug 26 08:36:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap911335fb-63, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap911335fb-63, col_values=(('external_ids', {'iface-id': '911335fb-63d7-4381-ac34-a47bb61d2b7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:26:d9', 'vm-uuid': '995a2bd3-4c54-4217-ae9f-056353008547'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:36:59 user nova-compute[73104]: INFO os_vif [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:26:d9,bridge_name='br-int',has_traffic_filtering=True,id=911335fb-63d7-4381-ac34-a47bb61d2b7e,network=Network(377250a7-e055-47b7-b42d-10b634024239),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap911335fb-63')
Aug 26 08:36:59 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] No VIF found with MAC fa:16:3e:f0:64:0b, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:36:59 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] No VIF found with MAC fa:16:3e:a3:26:d9, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:37:00 user nova-compute[73104]: DEBUG nova.network.neutron [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Successfully created port: 4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:37:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "13200b79-17a6-4c18-87da-653311946a04" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "13200b79-17a6-4c18-87da-653311946a04" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:01 user nova-compute[73104]: DEBUG nova.compute.manager [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:37:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:01 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:37:01 user nova-compute[73104]: INFO nova.compute.claims [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Claim successful on node user
Aug 26 08:37:01 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:37:01 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:37:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:01 user nova-compute[73104]: DEBUG nova.compute.manager [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:37:01 user nova-compute[73104]: DEBUG nova.network.neutron [req-ccbedbe3-d37b-4798-b281-055fbcd5ea6e req-e17091ee-2313-4c2b-a96b-854405b33f2f service nova] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Updated VIF entry in instance network info cache for port 911335fb-63d7-4381-ac34-a47bb61d2b7e. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:37:01 user nova-compute[73104]: DEBUG nova.network.neutron [req-ccbedbe3-d37b-4798-b281-055fbcd5ea6e req-e17091ee-2313-4c2b-a96b-854405b33f2f service nova] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Updating instance_info_cache with network_info: [{"id": "911335fb-63d7-4381-ac34-a47bb61d2b7e", "address": "fa:16:3e:a3:26:d9", "network": {"id": "377250a7-e055-47b7-b42d-10b634024239", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-158207792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "723a18c60d10444189783f4d50d2e6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap911335fb-63", "ovs_interfaceid": "911335fb-63d7-4381-ac34-a47bb61d2b7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:37:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ccbedbe3-d37b-4798-b281-055fbcd5ea6e req-e17091ee-2313-4c2b-a96b-854405b33f2f service nova] Releasing lock "refresh_cache-995a2bd3-4c54-4217-ae9f-056353008547" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:37:02 user nova-compute[73104]: DEBUG nova.compute.manager [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:37:02 user nova-compute[73104]: DEBUG nova.network.neutron [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:37:02 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:37:02 user nova-compute[73104]: DEBUG nova.compute.manager [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:37:02 user nova-compute[73104]: DEBUG nova.compute.manager [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:37:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:37:02 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Creating image(s)
Aug 26 08:37:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "/opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "/opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "/opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:02 user nova-compute[73104]: DEBUG nova.policy [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '062587ed00ae457889f884346c99e11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad68e5623014e2fb3f10ba92d388291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:37:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.228s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.190s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/disk 1073741824" returned: 0 in 0.060s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.187s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:02 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Checking if we can resize image /opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 08:37:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:03 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Cannot resize image /opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 08:37:03 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:37:03 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Ensure instance console log exists: /opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:37:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:03 user nova-compute[73104]: DEBUG nova.network.neutron [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Successfully updated port: 4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:37:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "refresh_cache-94de2062-7017-44fe-8df0-0a3cd63d5498" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:37:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquired lock "refresh_cache-94de2062-7017-44fe-8df0-0a3cd63d5498" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:37:03 user nova-compute[73104]: DEBUG nova.network.neutron [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:37:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquiring lock "385c6d93-907d-42d7-9b43-479e6caf66f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:03 user nova-compute[73104]: DEBUG nova.compute.manager [req-c056ffbf-f3b6-47ed-be90-edbdebf3cbe0 req-fb87a753-27c3-4d51-bbc5-6bc625366b5c service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Received event network-changed-4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:37:03 user nova-compute[73104]: DEBUG nova.compute.manager [req-c056ffbf-f3b6-47ed-be90-edbdebf3cbe0 req-fb87a753-27c3-4d51-bbc5-6bc625366b5c service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Refreshing instance network info cache due to event network-changed-4a3e387d-f638-43fc-bdef-4c0b608d29d4. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:37:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c056ffbf-f3b6-47ed-be90-edbdebf3cbe0 req-fb87a753-27c3-4d51-bbc5-6bc625366b5c service nova] Acquiring lock "refresh_cache-94de2062-7017-44fe-8df0-0a3cd63d5498" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:37:03 user nova-compute[73104]: DEBUG nova.compute.manager [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:37:04 user nova-compute[73104]: DEBUG nova.network.neutron [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:37:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:04 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:37:04 user nova-compute[73104]: INFO nova.compute.claims [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Claim successful on node user
Aug 26 08:37:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:04 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:37:04 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:37:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.581s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:04 user nova-compute[73104]: DEBUG nova.compute.manager [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:37:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:04 user nova-compute[73104]: DEBUG nova.compute.manager [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:37:04 user nova-compute[73104]: DEBUG nova.network.neutron [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:37:04 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:37:04 user nova-compute[73104]: DEBUG nova.compute.manager [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039025.0181913, 995a2bd3-4c54-4217-ae9f-056353008547 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:37:05 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] VM Resumed (Lifecycle Event)
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.compute.manager [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.compute.manager [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:37:05 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Creating image(s)
Aug 26 08:37:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquiring lock "/opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "/opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "/opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.080s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:37:05 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Instance spawned successfully.
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.compute.manager [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:05 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Instance spawned successfully.
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:37:05 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039025.0244548, 995a2bd3-4c54-4217-ae9f-056353008547 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:37:05 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] VM Started (Lifecycle Event)
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.196s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.policy [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a4e9fc4dcaaf4aa1aaa51245217b4ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8c266ecf8444919a4a2ed73b784b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:37:05 user nova-compute[73104]: INFO nova.compute.manager [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Took 12.71 seconds to spawn the instance on the hypervisor.
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.compute.manager [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:37:05 user nova-compute[73104]: INFO nova.compute.manager [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Took 16.28 seconds to spawn the instance on the hypervisor.
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.compute.manager [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:05 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039025.234359, dcec7631-b94f-4dbf-b85d-e8ad9c6396b7 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:37:05 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] VM Resumed (Lifecycle Event)
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.273s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:05 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039025.2366138, dcec7631-b94f-4dbf-b85d-e8ad9c6396b7 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:37:05 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] VM Started (Lifecycle Event)
Aug 26 08:37:05 user nova-compute[73104]: INFO nova.compute.manager [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Took 17.31 seconds to build instance.
Aug 26 08:37:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk 1073741824" returned: 0 in 0.114s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.397s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:05 user nova-compute[73104]: INFO nova.compute.manager [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Took 13.76 seconds to build instance.
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-222018ae-2f75-4c10-8cb1-7952f6fda89a tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lock "dcec7631-b94f-4dbf-b85d-e8ad9c6396b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.721s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:37:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-48c5dab2-9ae5-4d68-aa52-55dd0b459822 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Lock "995a2bd3-4c54-4217-ae9f-056353008547" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.944s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.299s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Checking if we can resize image /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.network.neutron [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Updating instance_info_cache with network_info: [{"id": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "address": "fa:16:3e:65:0d:e0", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a3e387d-f6", "ovs_interfaceid": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Releasing lock "refresh_cache-94de2062-7017-44fe-8df0-0a3cd63d5498" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.compute.manager [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Instance network_info: |[{"id": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "address": "fa:16:3e:65:0d:e0", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a3e387d-f6", "ovs_interfaceid": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c056ffbf-f3b6-47ed-be90-edbdebf3cbe0 req-fb87a753-27c3-4d51-bbc5-6bc625366b5c service nova] Acquired lock "refresh_cache-94de2062-7017-44fe-8df0-0a3cd63d5498" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.network.neutron [req-c056ffbf-f3b6-47ed-be90-edbdebf3cbe0 req-fb87a753-27c3-4d51-bbc5-6bc625366b5c service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Refreshing network info cache for port 4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Start _get_guest_xml network_info=[{"id": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "address": "fa:16:3e:65:0d:e0", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a3e387d-f6", "ovs_interfaceid": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:37:06 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:37:06 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-123632046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-123632046',id=3,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPi19fyJwWFBGW+j/nwVTdr8vlXHUgdkMaN5yhtSAh87HkLJ/UmDNji3VEqtFmHeRNmvggGbQx0WylavGyvgQRZOyai6wn1O5pmvdVkCKfZS5FYzwTtABxlMMyHIP1kb8A==',key_name='tempest-keypair-1165821836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='770daa2e8b274a9b828e489c1573ced4',ramdisk_id='',reservation_id='r-2y3651sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2062858766',owner_user_name='tempest-AttachVolumeShelveTestJSON-2062858766-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:36:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db3ae37701df47a5b35026fe3857bc51',uuid=94de2062-7017-44fe-8df0-0a3cd63d5498,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "address": "fa:16:3e:65:0d:e0", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a3e387d-f6", "ovs_interfaceid": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Converting VIF {"id": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "address": "fa:16:3e:65:0d:e0", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a3e387d-f6", "ovs_interfaceid": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:0d:e0,bridge_name='br-int',has_traffic_filtering=True,id=4a3e387d-f638-43fc-bdef-4c0b608d29d4,network=Network(38f7ec35-12eb-46fe-a425-51ee854d804d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a3e387d-f6') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.objects.instance [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lazy-loading 'pci_devices' on Instance uuid 94de2062-7017-44fe-8df0-0a3cd63d5498 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Cannot resize image /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Ensure instance console log exists: /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:37:06 user nova-compute[73104]:   <uuid>94de2062-7017-44fe-8df0-0a3cd63d5498</uuid>
Aug 26 08:37:06 user nova-compute[73104]:   <name>instance-00000003</name>
Aug 26 08:37:06 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:37:06 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:37:06 user nova-compute[73104]:   <metadata>
Aug 26 08:37:06 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:37:06 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:37:06 user nova-compute[73104]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-123632046</nova:name>
Aug 26 08:37:06 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:37:06</nova:creationTime>
Aug 26 08:37:06 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:37:06 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:37:06 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:37:06 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:37:06 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:37:06 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:37:06 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:37:06 user nova-compute[73104]:       <nova:owner>
Aug 26 08:37:06 user nova-compute[73104]:         <nova:user uuid="db3ae37701df47a5b35026fe3857bc51">tempest-AttachVolumeShelveTestJSON-2062858766-project-member</nova:user>
Aug 26 08:37:06 user nova-compute[73104]:         <nova:project uuid="770daa2e8b274a9b828e489c1573ced4">tempest-AttachVolumeShelveTestJSON-2062858766</nova:project>
Aug 26 08:37:06 user nova-compute[73104]:       </nova:owner>
Aug 26 08:37:06 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:37:06 user nova-compute[73104]:       <nova:ports>
Aug 26 08:37:06 user nova-compute[73104]:         <nova:port uuid="4a3e387d-f638-43fc-bdef-4c0b608d29d4">
Aug 26 08:37:06 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 08:37:06 user nova-compute[73104]:         </nova:port>
Aug 26 08:37:06 user nova-compute[73104]:       </nova:ports>
Aug 26 08:37:06 user nova-compute[73104]:     </nova:instance>
Aug 26 08:37:06 user nova-compute[73104]:   </metadata>
Aug 26 08:37:06 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:37:06 user nova-compute[73104]:     <system>
Aug 26 08:37:06 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:37:06 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:37:06 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:37:06 user nova-compute[73104]:       <entry name="serial">94de2062-7017-44fe-8df0-0a3cd63d5498</entry>
Aug 26 08:37:06 user nova-compute[73104]:       <entry name="uuid">94de2062-7017-44fe-8df0-0a3cd63d5498</entry>
Aug 26 08:37:06 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:37:06 user nova-compute[73104]:     </system>
Aug 26 08:37:06 user nova-compute[73104]:   </sysinfo>
Aug 26 08:37:06 user nova-compute[73104]:   <os>
Aug 26 08:37:06 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:37:06 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:37:06 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:37:06 user nova-compute[73104]:   </os>
Aug 26 08:37:06 user nova-compute[73104]:   <features>
Aug 26 08:37:06 user nova-compute[73104]:     <acpi/>
Aug 26 08:37:06 user nova-compute[73104]:     <apic/>
Aug 26 08:37:06 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:37:06 user nova-compute[73104]:   </features>
Aug 26 08:37:06 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:37:06 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:37:06 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:37:06 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:37:06 user nova-compute[73104]:   </clock>
Aug 26 08:37:06 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:37:06 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:37:06 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:37:06 user nova-compute[73104]:   </cpu>
Aug 26 08:37:06 user nova-compute[73104]:   <devices>
Aug 26 08:37:06 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:37:06 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:37:06 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk"/>
Aug 26 08:37:06 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:37:06 user nova-compute[73104]:     </disk>
Aug 26 08:37:06 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:37:06 user nova-compute[73104]:       <mac address="fa:16:3e:65:0d:e0"/>
Aug 26 08:37:06 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:37:06 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:37:06 user nova-compute[73104]:       <target dev="tap4a3e387d-f6"/>
Aug 26 08:37:06 user nova-compute[73104]:     </interface>
Aug 26 08:37:06 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:37:06 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/console.log" append="off"/>
Aug 26 08:37:06 user nova-compute[73104]:     </serial>
Aug 26 08:37:06 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:37:06 user nova-compute[73104]:     <video>
Aug 26 08:37:06 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:37:06 user nova-compute[73104]:     </video>
Aug 26 08:37:06 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:37:06 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:37:06 user nova-compute[73104]:     </rng>
Aug 26 08:37:06 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:37:06 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:37:06 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:37:06 user nova-compute[73104]:     </memballoon>
Aug 26 08:37:06 user nova-compute[73104]:   </devices>
Aug 26 08:37:06 user nova-compute[73104]: </domain>
Aug 26 08:37:06 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-123632046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-123632046',id=3,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPi19fyJwWFBGW+j/nwVTdr8vlXHUgdkMaN5yhtSAh87HkLJ/UmDNji3VEqtFmHeRNmvggGbQx0WylavGyvgQRZOyai6wn1O5pmvdVkCKfZS5FYzwTtABxlMMyHIP1kb8A==',key_name='tempest-keypair-1165821836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='770daa2e8b274a9b828e489c1573ced4',ramdisk_id='',reservation_id='r-2y3651sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2062858766',owner_user_name='tempest-AttachVolumeShelveTestJSON-2062858766-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:36:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db3ae37701df47a5b35026fe3857bc51',uuid=94de2062-7017-44fe-8df0-0a3cd63d5498,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "address": "fa:16:3e:65:0d:e0", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a3e387d-f6", "ovs_interfaceid": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Converting VIF {"id": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "address": "fa:16:3e:65:0d:e0", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a3e387d-f6", "ovs_interfaceid": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:0d:e0,bridge_name='br-int',has_traffic_filtering=True,id=4a3e387d-f638-43fc-bdef-4c0b608d29d4,network=Network(38f7ec35-12eb-46fe-a425-51ee854d804d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a3e387d-f6') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG os_vif [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:0d:e0,bridge_name='br-int',has_traffic_filtering=True,id=4a3e387d-f638-43fc-bdef-4c0b608d29d4,network=Network(38f7ec35-12eb-46fe-a425-51ee854d804d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a3e387d-f6') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a3e387d-f6, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4a3e387d-f6, col_values=(('external_ids', {'iface-id': '4a3e387d-f638-43fc-bdef-4c0b608d29d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:0d:e0', 'vm-uuid': '94de2062-7017-44fe-8df0-0a3cd63d5498'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:06 user nova-compute[73104]: INFO os_vif [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:0d:e0,bridge_name='br-int',has_traffic_filtering=True,id=4a3e387d-f638-43fc-bdef-4c0b608d29d4,network=Network(38f7ec35-12eb-46fe-a425-51ee854d804d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a3e387d-f6')
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.network.neutron [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Successfully created port: 76ccf91d-d705-4512-8bd8-d6747105f390 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:37:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] No VIF found with MAC fa:16:3e:65:0d:e0, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:37:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:08 user nova-compute[73104]: DEBUG nova.network.neutron [req-c056ffbf-f3b6-47ed-be90-edbdebf3cbe0 req-fb87a753-27c3-4d51-bbc5-6bc625366b5c service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Updated VIF entry in instance network info cache for port 4a3e387d-f638-43fc-bdef-4c0b608d29d4. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:37:08 user nova-compute[73104]: DEBUG nova.network.neutron [req-c056ffbf-f3b6-47ed-be90-edbdebf3cbe0 req-fb87a753-27c3-4d51-bbc5-6bc625366b5c service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Updating instance_info_cache with network_info: [{"id": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "address": "fa:16:3e:65:0d:e0", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a3e387d-f6", "ovs_interfaceid": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:37:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c056ffbf-f3b6-47ed-be90-edbdebf3cbe0 req-fb87a753-27c3-4d51-bbc5-6bc625366b5c service nova] Releasing lock "refresh_cache-94de2062-7017-44fe-8df0-0a3cd63d5498" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:37:08 user nova-compute[73104]: DEBUG nova.network.neutron [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Successfully created port: d4692900-c165-487d-9847-383fcf1d2270 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:37:09 user nova-compute[73104]: DEBUG nova.network.neutron [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Successfully updated port: 76ccf91d-d705-4512-8bd8-d6747105f390 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:37:09 user nova-compute[73104]: DEBUG nova.compute.manager [req-d3a246db-1148-4103-9124-c378d5e11f56 req-393c087a-798c-4f3b-9ee1-e9a2da1afb9f service nova] [instance: 13200b79-17a6-4c18-87da-653311946a04] Received event network-changed-76ccf91d-d705-4512-8bd8-d6747105f390 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:37:09 user nova-compute[73104]: DEBUG nova.compute.manager [req-d3a246db-1148-4103-9124-c378d5e11f56 req-393c087a-798c-4f3b-9ee1-e9a2da1afb9f service nova] [instance: 13200b79-17a6-4c18-87da-653311946a04] Refreshing instance network info cache due to event network-changed-76ccf91d-d705-4512-8bd8-d6747105f390. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:37:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d3a246db-1148-4103-9124-c378d5e11f56 req-393c087a-798c-4f3b-9ee1-e9a2da1afb9f service nova] Acquiring lock "refresh_cache-13200b79-17a6-4c18-87da-653311946a04" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:37:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d3a246db-1148-4103-9124-c378d5e11f56 req-393c087a-798c-4f3b-9ee1-e9a2da1afb9f service nova] Acquired lock "refresh_cache-13200b79-17a6-4c18-87da-653311946a04" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:37:09 user nova-compute[73104]: DEBUG nova.network.neutron [req-d3a246db-1148-4103-9124-c378d5e11f56 req-393c087a-798c-4f3b-9ee1-e9a2da1afb9f service nova] [instance: 13200b79-17a6-4c18-87da-653311946a04] Refreshing network info cache for port 76ccf91d-d705-4512-8bd8-d6747105f390 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:37:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "refresh_cache-13200b79-17a6-4c18-87da-653311946a04" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:37:09 user nova-compute[73104]: DEBUG nova.network.neutron [req-d3a246db-1148-4103-9124-c378d5e11f56 req-393c087a-798c-4f3b-9ee1-e9a2da1afb9f service nova] [instance: 13200b79-17a6-4c18-87da-653311946a04] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:37:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:10 user nova-compute[73104]: DEBUG nova.network.neutron [req-d3a246db-1148-4103-9124-c378d5e11f56 req-393c087a-798c-4f3b-9ee1-e9a2da1afb9f service nova] [instance: 13200b79-17a6-4c18-87da-653311946a04] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:37:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d3a246db-1148-4103-9124-c378d5e11f56 req-393c087a-798c-4f3b-9ee1-e9a2da1afb9f service nova] Releasing lock "refresh_cache-13200b79-17a6-4c18-87da-653311946a04" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:37:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquired lock "refresh_cache-13200b79-17a6-4c18-87da-653311946a04" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:37:10 user nova-compute[73104]: DEBUG nova.network.neutron [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:37:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:10 user nova-compute[73104]: DEBUG nova.network.neutron [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:37:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.network.neutron [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Updating instance_info_cache with network_info: [{"id": "76ccf91d-d705-4512-8bd8-d6747105f390", "address": "fa:16:3e:16:f1:1c", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ccf91d-d7", "ovs_interfaceid": "76ccf91d-d705-4512-8bd8-d6747105f390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Releasing lock "refresh_cache-13200b79-17a6-4c18-87da-653311946a04" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.compute.manager [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Instance network_info: |[{"id": "76ccf91d-d705-4512-8bd8-d6747105f390", "address": "fa:16:3e:16:f1:1c", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ccf91d-d7", "ovs_interfaceid": "76ccf91d-d705-4512-8bd8-d6747105f390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Start _get_guest_xml network_info=[{"id": "76ccf91d-d705-4512-8bd8-d6747105f390", "address": "fa:16:3e:16:f1:1c", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ccf91d-d7", "ovs_interfaceid": "76ccf91d-d705-4512-8bd8-d6747105f390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:37:11 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:37:11 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1718925409',display_name='tempest-AttachVolumeNegativeTest-server-1718925409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1718925409',id=4,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNabyOeHzYWuTgs4Gz325I5C6StKC5gsKQMUFIL+mwErPQHgTXVX0IxTTA/sxPJCNyRDDt3qaNhlXynGeXpIRFjQqLiBWgWe43CGGhyYC2LpBA0tPmFxO+1yNJyhbJvXA==',key_name='tempest-keypair-1494365081',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ad68e5623014e2fb3f10ba92d388291',ramdisk_id='',reservation_id='r-vr36mgg9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1286694855',owner_user_name='tempest-AttachVolumeNegativeTest-1286694855-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:37:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='062587ed00ae457889f884346c99e11b',uuid=13200b79-17a6-4c18-87da-653311946a04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76ccf91d-d705-4512-8bd8-d6747105f390", "address": "fa:16:3e:16:f1:1c", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ccf91d-d7", "ovs_interfaceid": "76ccf91d-d705-4512-8bd8-d6747105f390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Converting VIF {"id": "76ccf91d-d705-4512-8bd8-d6747105f390", "address": "fa:16:3e:16:f1:1c", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ccf91d-d7", "ovs_interfaceid": "76ccf91d-d705-4512-8bd8-d6747105f390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:f1:1c,bridge_name='br-int',has_traffic_filtering=True,id=76ccf91d-d705-4512-8bd8-d6747105f390,network=Network(ea6c6ce0-85a4-40db-96e2-ca078887ab66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ccf91d-d7') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.objects.instance [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lazy-loading 'pci_devices' on Instance uuid 13200b79-17a6-4c18-87da-653311946a04 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:37:11 user nova-compute[73104]:   <uuid>13200b79-17a6-4c18-87da-653311946a04</uuid>
Aug 26 08:37:11 user nova-compute[73104]:   <name>instance-00000004</name>
Aug 26 08:37:11 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:37:11 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:37:11 user nova-compute[73104]:   <metadata>
Aug 26 08:37:11 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:37:11 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:37:11 user nova-compute[73104]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1718925409</nova:name>
Aug 26 08:37:11 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:37:11</nova:creationTime>
Aug 26 08:37:11 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:37:11 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:37:11 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:37:11 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:37:11 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:37:11 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:37:11 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:37:11 user nova-compute[73104]:       <nova:owner>
Aug 26 08:37:11 user nova-compute[73104]:         <nova:user uuid="062587ed00ae457889f884346c99e11b">tempest-AttachVolumeNegativeTest-1286694855-project-member</nova:user>
Aug 26 08:37:11 user nova-compute[73104]:         <nova:project uuid="4ad68e5623014e2fb3f10ba92d388291">tempest-AttachVolumeNegativeTest-1286694855</nova:project>
Aug 26 08:37:11 user nova-compute[73104]:       </nova:owner>
Aug 26 08:37:11 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:37:11 user nova-compute[73104]:       <nova:ports>
Aug 26 08:37:11 user nova-compute[73104]:         <nova:port uuid="76ccf91d-d705-4512-8bd8-d6747105f390">
Aug 26 08:37:11 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 08:37:11 user nova-compute[73104]:         </nova:port>
Aug 26 08:37:11 user nova-compute[73104]:       </nova:ports>
Aug 26 08:37:11 user nova-compute[73104]:     </nova:instance>
Aug 26 08:37:11 user nova-compute[73104]:   </metadata>
Aug 26 08:37:11 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:37:11 user nova-compute[73104]:     <system>
Aug 26 08:37:11 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:37:11 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:37:11 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:37:11 user nova-compute[73104]:       <entry name="serial">13200b79-17a6-4c18-87da-653311946a04</entry>
Aug 26 08:37:11 user nova-compute[73104]:       <entry name="uuid">13200b79-17a6-4c18-87da-653311946a04</entry>
Aug 26 08:37:11 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:37:11 user nova-compute[73104]:     </system>
Aug 26 08:37:11 user nova-compute[73104]:   </sysinfo>
Aug 26 08:37:11 user nova-compute[73104]:   <os>
Aug 26 08:37:11 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:37:11 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:37:11 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:37:11 user nova-compute[73104]:   </os>
Aug 26 08:37:11 user nova-compute[73104]:   <features>
Aug 26 08:37:11 user nova-compute[73104]:     <acpi/>
Aug 26 08:37:11 user nova-compute[73104]:     <apic/>
Aug 26 08:37:11 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:37:11 user nova-compute[73104]:   </features>
Aug 26 08:37:11 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:37:11 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:37:11 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:37:11 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:37:11 user nova-compute[73104]:   </clock>
Aug 26 08:37:11 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:37:11 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:37:11 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:37:11 user nova-compute[73104]:   </cpu>
Aug 26 08:37:11 user nova-compute[73104]:   <devices>
Aug 26 08:37:11 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:37:11 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:37:11 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/disk"/>
Aug 26 08:37:11 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:37:11 user nova-compute[73104]:     </disk>
Aug 26 08:37:11 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:37:11 user nova-compute[73104]:       <mac address="fa:16:3e:16:f1:1c"/>
Aug 26 08:37:11 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:37:11 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:37:11 user nova-compute[73104]:       <target dev="tap76ccf91d-d7"/>
Aug 26 08:37:11 user nova-compute[73104]:     </interface>
Aug 26 08:37:11 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:37:11 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/console.log" append="off"/>
Aug 26 08:37:11 user nova-compute[73104]:     </serial>
Aug 26 08:37:11 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:37:11 user nova-compute[73104]:     <video>
Aug 26 08:37:11 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:37:11 user nova-compute[73104]:     </video>
Aug 26 08:37:11 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:37:11 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:37:11 user nova-compute[73104]:     </rng>
Aug 26 08:37:11 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:37:11 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:37:11 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:37:11 user nova-compute[73104]:     </memballoon>
Aug 26 08:37:11 user nova-compute[73104]:   </devices>
Aug 26 08:37:11 user nova-compute[73104]: </domain>
Aug 26 08:37:11 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1718925409',display_name='tempest-AttachVolumeNegativeTest-server-1718925409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1718925409',id=4,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNabyOeHzYWuTgs4Gz325I5C6StKC5gsKQMUFIL+mwErPQHgTXVX0IxTTA/sxPJCNyRDDt3qaNhlXynGeXpIRFjQqLiBWgWe43CGGhyYC2LpBA0tPmFxO+1yNJyhbJvXA==',key_name='tempest-keypair-1494365081',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ad68e5623014e2fb3f10ba92d388291',ramdisk_id='',reservation_id='r-vr36mgg9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1286694855',owner_user_name='tempest-AttachVolumeNegativeTest-1286694855-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:37:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='062587ed00ae457889f884346c99e11b',uuid=13200b79-17a6-4c18-87da-653311946a04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76ccf91d-d705-4512-8bd8-d6747105f390", "address": "fa:16:3e:16:f1:1c", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ccf91d-d7", "ovs_interfaceid": "76ccf91d-d705-4512-8bd8-d6747105f390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Converting VIF {"id": "76ccf91d-d705-4512-8bd8-d6747105f390", "address": "fa:16:3e:16:f1:1c", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ccf91d-d7", "ovs_interfaceid": "76ccf91d-d705-4512-8bd8-d6747105f390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:f1:1c,bridge_name='br-int',has_traffic_filtering=True,id=76ccf91d-d705-4512-8bd8-d6747105f390,network=Network(ea6c6ce0-85a4-40db-96e2-ca078887ab66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ccf91d-d7') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG os_vif [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:f1:1c,bridge_name='br-int',has_traffic_filtering=True,id=76ccf91d-d705-4512-8bd8-d6747105f390,network=Network(ea6c6ce0-85a4-40db-96e2-ca078887ab66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ccf91d-d7') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039031.5425663, 94de2062-7017-44fe-8df0-0a3cd63d5498 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:37:11 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] VM Resumed (Lifecycle Event)
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.compute.manager [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76ccf91d-d7, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap76ccf91d-d7, col_values=(('external_ids', {'iface-id': '76ccf91d-d705-4512-8bd8-d6747105f390', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:f1:1c', 'vm-uuid': '13200b79-17a6-4c18-87da-653311946a04'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:37:11 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Instance spawned successfully.
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:11 user nova-compute[73104]: INFO os_vif [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:f1:1c,bridge_name='br-int',has_traffic_filtering=True,id=76ccf91d-d705-4512-8bd8-d6747105f390,network=Network(ea6c6ce0-85a4-40db-96e2-ca078887ab66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ccf91d-d7')
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] No VIF found with MAC fa:16:3e:16:f1:1c, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:37:11 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039031.5428011, 94de2062-7017-44fe-8df0-0a3cd63d5498 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:37:11 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] VM Started (Lifecycle Event)
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:37:11 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:37:11 user nova-compute[73104]: INFO nova.compute.manager [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Took 13.71 seconds to spawn the instance on the hypervisor.
Aug 26 08:37:11 user nova-compute[73104]: DEBUG nova.compute.manager [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:37:12 user nova-compute[73104]: DEBUG nova.network.neutron [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Successfully updated port: d4692900-c165-487d-9847-383fcf1d2270 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:37:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquiring lock "refresh_cache-385c6d93-907d-42d7-9b43-479e6caf66f9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:37:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquired lock "refresh_cache-385c6d93-907d-42d7-9b43-479e6caf66f9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:37:12 user nova-compute[73104]: DEBUG nova.network.neutron [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:37:12 user nova-compute[73104]: INFO nova.compute.manager [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Took 14.61 seconds to build instance.
Aug 26 08:37:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e1caba57-6192-4105-b6d2-f126281cfcaa tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.849s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:12 user nova-compute[73104]: DEBUG nova.compute.manager [req-2de0031e-8200-47a8-b9f4-e77e52ad2458 req-50d10547-2c98-4d21-a9ef-9010cb349706 service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Received event network-changed-d4692900-c165-487d-9847-383fcf1d2270 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:37:12 user nova-compute[73104]: DEBUG nova.compute.manager [req-2de0031e-8200-47a8-b9f4-e77e52ad2458 req-50d10547-2c98-4d21-a9ef-9010cb349706 service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Refreshing instance network info cache due to event network-changed-d4692900-c165-487d-9847-383fcf1d2270. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:37:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2de0031e-8200-47a8-b9f4-e77e52ad2458 req-50d10547-2c98-4d21-a9ef-9010cb349706 service nova] Acquiring lock "refresh_cache-385c6d93-907d-42d7-9b43-479e6caf66f9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:37:12 user nova-compute[73104]: DEBUG nova.network.neutron [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:37:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:12 user nova-compute[73104]: DEBUG nova.compute.manager [req-c7c95465-5859-4af2-8a28-dab3c831f84b req-40e3b517-fcbd-48a6-ab73-7bffd061bfed service nova] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Received event network-vif-plugged-911335fb-63d7-4381-ac34-a47bb61d2b7e {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:37:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c7c95465-5859-4af2-8a28-dab3c831f84b req-40e3b517-fcbd-48a6-ab73-7bffd061bfed service nova] Acquiring lock "995a2bd3-4c54-4217-ae9f-056353008547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c7c95465-5859-4af2-8a28-dab3c831f84b req-40e3b517-fcbd-48a6-ab73-7bffd061bfed service nova] Lock "995a2bd3-4c54-4217-ae9f-056353008547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c7c95465-5859-4af2-8a28-dab3c831f84b req-40e3b517-fcbd-48a6-ab73-7bffd061bfed service nova] Lock "995a2bd3-4c54-4217-ae9f-056353008547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:12 user nova-compute[73104]: DEBUG nova.compute.manager [req-c7c95465-5859-4af2-8a28-dab3c831f84b req-40e3b517-fcbd-48a6-ab73-7bffd061bfed service nova] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] No waiting events found dispatching network-vif-plugged-911335fb-63d7-4381-ac34-a47bb61d2b7e {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:37:12 user nova-compute[73104]: WARNING nova.compute.manager [req-c7c95465-5859-4af2-8a28-dab3c831f84b req-40e3b517-fcbd-48a6-ab73-7bffd061bfed service nova] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Received unexpected event network-vif-plugged-911335fb-63d7-4381-ac34-a47bb61d2b7e for instance with vm_state active and task_state None.
Aug 26 08:37:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:13 user nova-compute[73104]: DEBUG nova.network.neutron [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Updating instance_info_cache with network_info: [{"id": "d4692900-c165-487d-9847-383fcf1d2270", "address": "fa:16:3e:b9:37:34", "network": {"id": "9aad8a32-d93f-45ef-be53-f84cebd194b1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2017537149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc8c266ecf8444919a4a2ed73b784b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4692900-c1", "ovs_interfaceid": "d4692900-c165-487d-9847-383fcf1d2270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:37:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Releasing lock "refresh_cache-385c6d93-907d-42d7-9b43-479e6caf66f9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:37:13 user nova-compute[73104]: DEBUG nova.compute.manager [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Instance network_info: |[{"id": "d4692900-c165-487d-9847-383fcf1d2270", "address": "fa:16:3e:b9:37:34", "network": {"id": "9aad8a32-d93f-45ef-be53-f84cebd194b1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2017537149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc8c266ecf8444919a4a2ed73b784b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4692900-c1", "ovs_interfaceid": "d4692900-c165-487d-9847-383fcf1d2270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:37:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2de0031e-8200-47a8-b9f4-e77e52ad2458 req-50d10547-2c98-4d21-a9ef-9010cb349706 service nova] Acquired lock "refresh_cache-385c6d93-907d-42d7-9b43-479e6caf66f9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:37:13 user nova-compute[73104]: DEBUG nova.network.neutron [req-2de0031e-8200-47a8-b9f4-e77e52ad2458 req-50d10547-2c98-4d21-a9ef-9010cb349706 service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Refreshing network info cache for port d4692900-c165-487d-9847-383fcf1d2270 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:37:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Start _get_guest_xml network_info=[{"id": "d4692900-c165-487d-9847-383fcf1d2270", "address": "fa:16:3e:b9:37:34", "network": {"id": "9aad8a32-d93f-45ef-be53-f84cebd194b1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2017537149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc8c266ecf8444919a4a2ed73b784b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4692900-c1", "ovs_interfaceid": "d4692900-c165-487d-9847-383fcf1d2270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:37:14 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:37:14 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:37:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1752100953',display_name='tempest-ServerActionsTestOtherB-server-1752100953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1752100953',id=5,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNCl9FBP9XyWyY8/M5Nn5mUzz1vqHS13H5r5WR3mIkiFM7rzl4Rl7e+CWZJ8183D5yYr3nZra0DCol7pvB/KJevg8WITrJ9KzKNvGMc/QWpgMb9Lbrm7qPNUJRloZ083Q==',key_name='tempest-keypair-1221674543',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc8c266ecf8444919a4a2ed73b784b53',ramdisk_id='',reservation_id='r-w3k6rkik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-905162429',owner_user_name='tempest-ServerActionsTestOtherB-905162429-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:37:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4e9fc4dcaaf4aa1aaa51245217b4ded',uuid=385c6d93-907d-42d7-9b43-479e6caf66f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4692900-c165-487d-9847-383fcf1d2270", "address": "fa:16:3e:b9:37:34", "network": {"id": "9aad8a32-d93f-45ef-be53-f84cebd194b1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2017537149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc8c266ecf8444919a4a2ed73b784b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4692900-c1", "ovs_interfaceid": "d4692900-c165-487d-9847-383fcf1d2270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Converting VIF {"id": "d4692900-c165-487d-9847-383fcf1d2270", "address": "fa:16:3e:b9:37:34", "network": {"id": "9aad8a32-d93f-45ef-be53-f84cebd194b1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2017537149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc8c266ecf8444919a4a2ed73b784b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4692900-c1", "ovs_interfaceid": "d4692900-c165-487d-9847-383fcf1d2270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:37:34,bridge_name='br-int',has_traffic_filtering=True,id=d4692900-c165-487d-9847-383fcf1d2270,network=Network(9aad8a32-d93f-45ef-be53-f84cebd194b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4692900-c1') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG nova.objects.instance [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lazy-loading 'pci_devices' on Instance uuid 385c6d93-907d-42d7-9b43-479e6caf66f9 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:37:14 user nova-compute[73104]:   <uuid>385c6d93-907d-42d7-9b43-479e6caf66f9</uuid>
Aug 26 08:37:14 user nova-compute[73104]:   <name>instance-00000005</name>
Aug 26 08:37:14 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:37:14 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:37:14 user nova-compute[73104]:   <metadata>
Aug 26 08:37:14 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:37:14 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:37:14 user nova-compute[73104]:       <nova:name>tempest-ServerActionsTestOtherB-server-1752100953</nova:name>
Aug 26 08:37:14 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:37:14</nova:creationTime>
Aug 26 08:37:14 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:37:14 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:37:14 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:37:14 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:37:14 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:37:14 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:37:14 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:37:14 user nova-compute[73104]:       <nova:owner>
Aug 26 08:37:14 user nova-compute[73104]:         <nova:user uuid="a4e9fc4dcaaf4aa1aaa51245217b4ded">tempest-ServerActionsTestOtherB-905162429-project-member</nova:user>
Aug 26 08:37:14 user nova-compute[73104]:         <nova:project uuid="bc8c266ecf8444919a4a2ed73b784b53">tempest-ServerActionsTestOtherB-905162429</nova:project>
Aug 26 08:37:14 user nova-compute[73104]:       </nova:owner>
Aug 26 08:37:14 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:37:14 user nova-compute[73104]:       <nova:ports>
Aug 26 08:37:14 user nova-compute[73104]:         <nova:port uuid="d4692900-c165-487d-9847-383fcf1d2270">
Aug 26 08:37:14 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 08:37:14 user nova-compute[73104]:         </nova:port>
Aug 26 08:37:14 user nova-compute[73104]:       </nova:ports>
Aug 26 08:37:14 user nova-compute[73104]:     </nova:instance>
Aug 26 08:37:14 user nova-compute[73104]:   </metadata>
Aug 26 08:37:14 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:37:14 user nova-compute[73104]:     <system>
Aug 26 08:37:14 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:37:14 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:37:14 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:37:14 user nova-compute[73104]:       <entry name="serial">385c6d93-907d-42d7-9b43-479e6caf66f9</entry>
Aug 26 08:37:14 user nova-compute[73104]:       <entry name="uuid">385c6d93-907d-42d7-9b43-479e6caf66f9</entry>
Aug 26 08:37:14 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:37:14 user nova-compute[73104]:     </system>
Aug 26 08:37:14 user nova-compute[73104]:   </sysinfo>
Aug 26 08:37:14 user nova-compute[73104]:   <os>
Aug 26 08:37:14 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:37:14 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:37:14 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:37:14 user nova-compute[73104]:   </os>
Aug 26 08:37:14 user nova-compute[73104]:   <features>
Aug 26 08:37:14 user nova-compute[73104]:     <acpi/>
Aug 26 08:37:14 user nova-compute[73104]:     <apic/>
Aug 26 08:37:14 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:37:14 user nova-compute[73104]:   </features>
Aug 26 08:37:14 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:37:14 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:37:14 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:37:14 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:37:14 user nova-compute[73104]:   </clock>
Aug 26 08:37:14 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:37:14 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:37:14 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:37:14 user nova-compute[73104]:   </cpu>
Aug 26 08:37:14 user nova-compute[73104]:   <devices>
Aug 26 08:37:14 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:37:14 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:37:14 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk"/>
Aug 26 08:37:14 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:37:14 user nova-compute[73104]:     </disk>
Aug 26 08:37:14 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:37:14 user nova-compute[73104]:       <mac address="fa:16:3e:b9:37:34"/>
Aug 26 08:37:14 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:37:14 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:37:14 user nova-compute[73104]:       <target dev="tapd4692900-c1"/>
Aug 26 08:37:14 user nova-compute[73104]:     </interface>
Aug 26 08:37:14 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:37:14 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/console.log" append="off"/>
Aug 26 08:37:14 user nova-compute[73104]:     </serial>
Aug 26 08:37:14 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:37:14 user nova-compute[73104]:     <video>
Aug 26 08:37:14 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:37:14 user nova-compute[73104]:     </video>
Aug 26 08:37:14 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:37:14 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:37:14 user nova-compute[73104]:     </rng>
Aug 26 08:37:14 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:37:14 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:37:14 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:37:14 user nova-compute[73104]:     </memballoon>
Aug 26 08:37:14 user nova-compute[73104]:   </devices>
Aug 26 08:37:14 user nova-compute[73104]: </domain>
Aug 26 08:37:14 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1752100953',display_name='tempest-ServerActionsTestOtherB-server-1752100953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1752100953',id=5,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNCl9FBP9XyWyY8/M5Nn5mUzz1vqHS13H5r5WR3mIkiFM7rzl4Rl7e+CWZJ8183D5yYr3nZra0DCol7pvB/KJevg8WITrJ9KzKNvGMc/QWpgMb9Lbrm7qPNUJRloZ083Q==',key_name='tempest-keypair-1221674543',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc8c266ecf8444919a4a2ed73b784b53',ramdisk_id='',reservation_id='r-w3k6rkik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-905162429',owner_user_name='tempest-ServerActionsTestOtherB-905162429-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:37:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4e9fc4dcaaf4aa1aaa51245217b4ded',uuid=385c6d93-907d-42d7-9b43-479e6caf66f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4692900-c165-487d-9847-383fcf1d2270", "address": "fa:16:3e:b9:37:34", "network": {"id": "9aad8a32-d93f-45ef-be53-f84cebd194b1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2017537149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc8c266ecf8444919a4a2ed73b784b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4692900-c1", "ovs_interfaceid": "d4692900-c165-487d-9847-383fcf1d2270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Converting VIF {"id": "d4692900-c165-487d-9847-383fcf1d2270", "address": "fa:16:3e:b9:37:34", "network": {"id": "9aad8a32-d93f-45ef-be53-f84cebd194b1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2017537149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc8c266ecf8444919a4a2ed73b784b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4692900-c1", "ovs_interfaceid": "d4692900-c165-487d-9847-383fcf1d2270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:37:34,bridge_name='br-int',has_traffic_filtering=True,id=d4692900-c165-487d-9847-383fcf1d2270,network=Network(9aad8a32-d93f-45ef-be53-f84cebd194b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4692900-c1') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG os_vif [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:37:34,bridge_name='br-int',has_traffic_filtering=True,id=d4692900-c165-487d-9847-383fcf1d2270,network=Network(9aad8a32-d93f-45ef-be53-f84cebd194b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4692900-c1') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4692900-c1, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd4692900-c1, col_values=(('external_ids', {'iface-id': 'd4692900-c165-487d-9847-383fcf1d2270', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:37:34', 'vm-uuid': '385c6d93-907d-42d7-9b43-479e6caf66f9'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:14 user nova-compute[73104]: INFO os_vif [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:37:34,bridge_name='br-int',has_traffic_filtering=True,id=d4692900-c165-487d-9847-383fcf1d2270,network=Network(9aad8a32-d93f-45ef-be53-f84cebd194b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4692900-c1')
Aug 26 08:37:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] No VIF found with MAC fa:16:3e:b9:37:34, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG nova.compute.manager [req-c45402c4-fbbb-40a0-b79e-4c530e4d55df req-45608e0a-306c-47a8-9fda-df264a1a7bc5 service nova] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Received event network-vif-plugged-911335fb-63d7-4381-ac34-a47bb61d2b7e {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c45402c4-fbbb-40a0-b79e-4c530e4d55df req-45608e0a-306c-47a8-9fda-df264a1a7bc5 service nova] Acquiring lock "995a2bd3-4c54-4217-ae9f-056353008547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c45402c4-fbbb-40a0-b79e-4c530e4d55df req-45608e0a-306c-47a8-9fda-df264a1a7bc5 service nova] Lock "995a2bd3-4c54-4217-ae9f-056353008547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c45402c4-fbbb-40a0-b79e-4c530e4d55df req-45608e0a-306c-47a8-9fda-df264a1a7bc5 service nova] Lock "995a2bd3-4c54-4217-ae9f-056353008547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:14 user nova-compute[73104]: DEBUG nova.compute.manager [req-c45402c4-fbbb-40a0-b79e-4c530e4d55df req-45608e0a-306c-47a8-9fda-df264a1a7bc5 service nova] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] No waiting events found dispatching network-vif-plugged-911335fb-63d7-4381-ac34-a47bb61d2b7e {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:37:14 user nova-compute[73104]: WARNING nova.compute.manager [req-c45402c4-fbbb-40a0-b79e-4c530e4d55df req-45608e0a-306c-47a8-9fda-df264a1a7bc5 service nova] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Received unexpected event network-vif-plugged-911335fb-63d7-4381-ac34-a47bb61d2b7e for instance with vm_state active and task_state None.
Aug 26 08:37:15 user nova-compute[73104]: DEBUG nova.network.neutron [req-2de0031e-8200-47a8-b9f4-e77e52ad2458 req-50d10547-2c98-4d21-a9ef-9010cb349706 service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Updated VIF entry in instance network info cache for port d4692900-c165-487d-9847-383fcf1d2270. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:37:15 user nova-compute[73104]: DEBUG nova.network.neutron [req-2de0031e-8200-47a8-b9f4-e77e52ad2458 req-50d10547-2c98-4d21-a9ef-9010cb349706 service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Updating instance_info_cache with network_info: [{"id": "d4692900-c165-487d-9847-383fcf1d2270", "address": "fa:16:3e:b9:37:34", "network": {"id": "9aad8a32-d93f-45ef-be53-f84cebd194b1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2017537149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc8c266ecf8444919a4a2ed73b784b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4692900-c1", "ovs_interfaceid": "d4692900-c165-487d-9847-383fcf1d2270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:37:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2de0031e-8200-47a8-b9f4-e77e52ad2458 req-50d10547-2c98-4d21-a9ef-9010cb349706 service nova] Releasing lock "refresh_cache-385c6d93-907d-42d7-9b43-479e6caf66f9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:37:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:16 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039036.681712, 13200b79-17a6-4c18-87da-653311946a04 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:37:16 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 13200b79-17a6-4c18-87da-653311946a04] VM Resumed (Lifecycle Event)
Aug 26 08:37:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:37:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:37:16 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 13200b79-17a6-4c18-87da-653311946a04] Instance spawned successfully.
Aug 26 08:37:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:37:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 13200b79-17a6-4c18-87da-653311946a04] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:37:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 13200b79-17a6-4c18-87da-653311946a04] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:37:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:16 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 13200b79-17a6-4c18-87da-653311946a04] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:37:16 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039036.6894298, 13200b79-17a6-4c18-87da-653311946a04 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:37:16 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 13200b79-17a6-4c18-87da-653311946a04] VM Started (Lifecycle Event)
Aug 26 08:37:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 13200b79-17a6-4c18-87da-653311946a04] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:37:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 13200b79-17a6-4c18-87da-653311946a04] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:37:16 user nova-compute[73104]: INFO nova.compute.manager [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Took 14.55 seconds to spawn the instance on the hypervisor.
Aug 26 08:37:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:37:16 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 13200b79-17a6-4c18-87da-653311946a04] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:37:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:16 user nova-compute[73104]: INFO nova.compute.manager [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Took 15.58 seconds to build instance.
Aug 26 08:37:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cf66e263-9b36-4929-b368-065696f2f35d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "13200b79-17a6-4c18-87da-653311946a04" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.755s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:17 user nova-compute[73104]: DEBUG nova.compute.manager [req-ec39f41a-117f-4f83-bb48-cd01b9742901 req-18d7bcef-42d2-49bb-a18b-bde87d1e51f3 service nova] [instance: 13200b79-17a6-4c18-87da-653311946a04] Received event network-vif-plugged-76ccf91d-d705-4512-8bd8-d6747105f390 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:37:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ec39f41a-117f-4f83-bb48-cd01b9742901 req-18d7bcef-42d2-49bb-a18b-bde87d1e51f3 service nova] Acquiring lock "13200b79-17a6-4c18-87da-653311946a04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ec39f41a-117f-4f83-bb48-cd01b9742901 req-18d7bcef-42d2-49bb-a18b-bde87d1e51f3 service nova] Lock "13200b79-17a6-4c18-87da-653311946a04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ec39f41a-117f-4f83-bb48-cd01b9742901 req-18d7bcef-42d2-49bb-a18b-bde87d1e51f3 service nova] Lock "13200b79-17a6-4c18-87da-653311946a04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:17 user nova-compute[73104]: DEBUG nova.compute.manager [req-ec39f41a-117f-4f83-bb48-cd01b9742901 req-18d7bcef-42d2-49bb-a18b-bde87d1e51f3 service nova] [instance: 13200b79-17a6-4c18-87da-653311946a04] No waiting events found dispatching network-vif-plugged-76ccf91d-d705-4512-8bd8-d6747105f390 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:37:17 user nova-compute[73104]: WARNING nova.compute.manager [req-ec39f41a-117f-4f83-bb48-cd01b9742901 req-18d7bcef-42d2-49bb-a18b-bde87d1e51f3 service nova] [instance: 13200b79-17a6-4c18-87da-653311946a04] Received unexpected event network-vif-plugged-76ccf91d-d705-4512-8bd8-d6747105f390 for instance with vm_state active and task_state None.
Aug 26 08:37:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:18 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039038.7316961, 385c6d93-907d-42d7-9b43-479e6caf66f9 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:37:18 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] VM Resumed (Lifecycle Event)
Aug 26 08:37:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:18 user nova-compute[73104]: DEBUG nova.compute.manager [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:37:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:37:18 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Instance spawned successfully.
Aug 26 08:37:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:37:18 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:37:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:18 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:37:18 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:37:18 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039038.745174, 385c6d93-907d-42d7-9b43-479e6caf66f9 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:37:18 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] VM Started (Lifecycle Event)
Aug 26 08:37:18 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:37:18 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:37:18 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:37:19 user nova-compute[73104]: INFO nova.compute.manager [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Took 14.02 seconds to spawn the instance on the hypervisor.
Aug 26 08:37:19 user nova-compute[73104]: DEBUG nova.compute.manager [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:37:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:19 user nova-compute[73104]: INFO nova.compute.manager [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Took 15.17 seconds to build instance.
Aug 26 08:37:19 user nova-compute[73104]: DEBUG nova.compute.manager [req-85c89e87-6d4f-4345-84db-5e1dd6f839c2 req-1d750aa1-f8c7-4920-aafa-3aa9650e484d service nova] [instance: 13200b79-17a6-4c18-87da-653311946a04] Received event network-vif-plugged-76ccf91d-d705-4512-8bd8-d6747105f390 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:37:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-85c89e87-6d4f-4345-84db-5e1dd6f839c2 req-1d750aa1-f8c7-4920-aafa-3aa9650e484d service nova] Acquiring lock "13200b79-17a6-4c18-87da-653311946a04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-85c89e87-6d4f-4345-84db-5e1dd6f839c2 req-1d750aa1-f8c7-4920-aafa-3aa9650e484d service nova] Lock "13200b79-17a6-4c18-87da-653311946a04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-85c89e87-6d4f-4345-84db-5e1dd6f839c2 req-1d750aa1-f8c7-4920-aafa-3aa9650e484d service nova] Lock "13200b79-17a6-4c18-87da-653311946a04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:19 user nova-compute[73104]: DEBUG nova.compute.manager [req-85c89e87-6d4f-4345-84db-5e1dd6f839c2 req-1d750aa1-f8c7-4920-aafa-3aa9650e484d service nova] [instance: 13200b79-17a6-4c18-87da-653311946a04] No waiting events found dispatching network-vif-plugged-76ccf91d-d705-4512-8bd8-d6747105f390 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:37:19 user nova-compute[73104]: WARNING nova.compute.manager [req-85c89e87-6d4f-4345-84db-5e1dd6f839c2 req-1d750aa1-f8c7-4920-aafa-3aa9650e484d service nova] [instance: 13200b79-17a6-4c18-87da-653311946a04] Received unexpected event network-vif-plugged-76ccf91d-d705-4512-8bd8-d6747105f390 for instance with vm_state active and task_state None.
Aug 26 08:37:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-99f1a62b-cef6-4646-975f-8c4c5eba0004 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.334s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Acquiring lock "afe2c15e-4e27-47f3-8b0b-426f4b8619d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lock "afe2c15e-4e27-47f3-8b0b-426f4b8619d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:20 user nova-compute[73104]: DEBUG nova.compute.manager [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:37:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:20 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:37:20 user nova-compute[73104]: INFO nova.compute.claims [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Claim successful on node user
Aug 26 08:37:20 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:37:20 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:37:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.790s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:21 user nova-compute[73104]: DEBUG nova.compute.manager [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:37:21 user nova-compute[73104]: DEBUG nova.compute.manager [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:37:21 user nova-compute[73104]: DEBUG nova.network.neutron [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:37:21 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 26 08:37:21 user nova-compute[73104]: DEBUG nova.compute.manager [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:37:21 user nova-compute[73104]: DEBUG nova.compute.manager [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:37:21 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:37:21 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Creating image(s)
Aug 26 08:37:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Acquiring lock "/opt/stack/data/nova/instances/afe2c15e-4e27-47f3-8b0b-426f4b8619d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lock "/opt/stack/data/nova/instances/afe2c15e-4e27-47f3-8b0b-426f4b8619d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lock "/opt/stack/data/nova/instances/afe2c15e-4e27-47f3-8b0b-426f4b8619d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Acquiring lock "bf1ce7c6ad730b661c6512df2e2024b1720f8631" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lock "bf1ce7c6ad730b661c6512df2e2024b1720f8631" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:22 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf1ce7c6ad730b661c6512df2e2024b1720f8631.part --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:22 user nova-compute[73104]: DEBUG nova.policy [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a60dca728ca341b2a6908ba984a799e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfab4672f4f4303839a67b98699cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:37:22 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf1ce7c6ad730b661c6512df2e2024b1720f8631.part --force-share --output=json" returned: 0 in 0.299s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:22 user nova-compute[73104]: DEBUG nova.virt.images [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] e401a7c1-a4d7-4a65-ac53-540cca411897 was qcow2, converting to raw {{(pid=73104) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 08:37:22 user nova-compute[73104]: DEBUG nova.privsep.utils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73104) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 08:37:22 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bf1ce7c6ad730b661c6512df2e2024b1720f8631.part /opt/stack/data/nova/instances/_base/bf1ce7c6ad730b661c6512df2e2024b1720f8631.converted {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:22 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bf1ce7c6ad730b661c6512df2e2024b1720f8631.part /opt/stack/data/nova/instances/_base/bf1ce7c6ad730b661c6512df2e2024b1720f8631.converted" returned: 0 in 0.287s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:22 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf1ce7c6ad730b661c6512df2e2024b1720f8631.converted --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf1ce7c6ad730b661c6512df2e2024b1720f8631.converted --force-share --output=json" returned: 0 in 0.226s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lock "bf1ce7c6ad730b661c6512df2e2024b1720f8631" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.414s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf1ce7c6ad730b661c6512df2e2024b1720f8631 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf1ce7c6ad730b661c6512df2e2024b1720f8631 --force-share --output=json" returned: 0 in 0.250s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Acquiring lock "bf1ce7c6ad730b661c6512df2e2024b1720f8631" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lock "bf1ce7c6ad730b661c6512df2e2024b1720f8631" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf1ce7c6ad730b661c6512df2e2024b1720f8631 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:23 user nova-compute[73104]: DEBUG nova.network.neutron [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Successfully created port: 54d197ce-aea5-41ab-b450-e86a182c8bc4 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:37:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf1ce7c6ad730b661c6512df2e2024b1720f8631 --force-share --output=json" returned: 0 in 0.280s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf1ce7c6ad730b661c6512df2e2024b1720f8631,backing_fmt=raw /opt/stack/data/nova/instances/afe2c15e-4e27-47f3-8b0b-426f4b8619d1/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf1ce7c6ad730b661c6512df2e2024b1720f8631,backing_fmt=raw /opt/stack/data/nova/instances/afe2c15e-4e27-47f3-8b0b-426f4b8619d1/disk 1073741824" returned: 0 in 0.069s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lock "bf1ce7c6ad730b661c6512df2e2024b1720f8631" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.358s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf1ce7c6ad730b661c6512df2e2024b1720f8631 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf1ce7c6ad730b661c6512df2e2024b1720f8631 --force-share --output=json" returned: 0 in 0.192s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:23 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Checking if we can resize image /opt/stack/data/nova/instances/afe2c15e-4e27-47f3-8b0b-426f4b8619d1/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 08:37:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe2c15e-4e27-47f3-8b0b-426f4b8619d1/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe2c15e-4e27-47f3-8b0b-426f4b8619d1/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:24 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Cannot resize image /opt/stack/data/nova/instances/afe2c15e-4e27-47f3-8b0b-426f4b8619d1/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 08:37:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:37:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Ensure instance console log exists: /opt/stack/data/nova/instances/afe2c15e-4e27-47f3-8b0b-426f4b8619d1/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:37:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:24 user nova-compute[73104]: DEBUG nova.network.neutron [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Successfully updated port: 54d197ce-aea5-41ab-b450-e86a182c8bc4 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:37:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Acquiring lock "refresh_cache-afe2c15e-4e27-47f3-8b0b-426f4b8619d1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:37:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Acquired lock "refresh_cache-afe2c15e-4e27-47f3-8b0b-426f4b8619d1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:37:24 user nova-compute[73104]: DEBUG nova.network.neutron [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:37:24 user nova-compute[73104]: DEBUG nova.compute.manager [req-f02104d8-9c74-4c6b-accd-c1953105a1dd req-94ef3f13-a6a9-4dd9-a669-ff14db8db0d3 service nova] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Received event network-changed-54d197ce-aea5-41ab-b450-e86a182c8bc4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:37:24 user nova-compute[73104]: DEBUG nova.compute.manager [req-f02104d8-9c74-4c6b-accd-c1953105a1dd req-94ef3f13-a6a9-4dd9-a669-ff14db8db0d3 service nova] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Refreshing instance network info cache due to event network-changed-54d197ce-aea5-41ab-b450-e86a182c8bc4. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:37:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f02104d8-9c74-4c6b-accd-c1953105a1dd req-94ef3f13-a6a9-4dd9-a669-ff14db8db0d3 service nova] Acquiring lock "refresh_cache-afe2c15e-4e27-47f3-8b0b-426f4b8619d1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:37:24 user nova-compute[73104]: DEBUG nova.network.neutron [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG nova.network.neutron [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Updating instance_info_cache with network_info: [{"id": "54d197ce-aea5-41ab-b450-e86a182c8bc4", "address": "fa:16:3e:66:74:06", "network": {"id": "e0ff8c51-555a-4539-8408-7efee217025c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1595132883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dfab4672f4f4303839a67b98699cae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54d197ce-ae", "ovs_interfaceid": "54d197ce-aea5-41ab-b450-e86a182c8bc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Releasing lock "refresh_cache-afe2c15e-4e27-47f3-8b0b-426f4b8619d1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG nova.compute.manager [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Instance network_info: |[{"id": "54d197ce-aea5-41ab-b450-e86a182c8bc4", "address": "fa:16:3e:66:74:06", "network": {"id": "e0ff8c51-555a-4539-8408-7efee217025c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1595132883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dfab4672f4f4303839a67b98699cae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54d197ce-ae", "ovs_interfaceid": "54d197ce-aea5-41ab-b450-e86a182c8bc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f02104d8-9c74-4c6b-accd-c1953105a1dd req-94ef3f13-a6a9-4dd9-a669-ff14db8db0d3 service nova] Acquired lock "refresh_cache-afe2c15e-4e27-47f3-8b0b-426f4b8619d1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG nova.network.neutron [req-f02104d8-9c74-4c6b-accd-c1953105a1dd req-94ef3f13-a6a9-4dd9-a669-ff14db8db0d3 service nova] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Refreshing network info cache for port 54d197ce-aea5-41ab-b450-e86a182c8bc4 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Start _get_guest_xml network_info=[{"id": "54d197ce-aea5-41ab-b450-e86a182c8bc4", "address": "fa:16:3e:66:74:06", "network": {"id": "e0ff8c51-555a-4539-8408-7efee217025c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1595132883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dfab4672f4f4303839a67b98699cae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54d197ce-ae", "ovs_interfaceid": "54d197ce-aea5-41ab-b450-e86a182c8bc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:37:13Z,direct_url=<?>,disk_format='qcow2',id=e401a7c1-a4d7-4a65-ac53-540cca411897,min_disk=0,min_ram=0,name='',owner='6a78a3609444495b89a585833b9cb86d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:37:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'scsi', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/sda', 'device_type': 'disk', 'image_id': 'e401a7c1-a4d7-4a65-ac53-540cca411897'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:37:25 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:37:25 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:37:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:37:13Z,direct_url=<?>,disk_format='qcow2',id=e401a7c1-a4d7-4a65-ac53-540cca411897,min_disk=0,min_ram=0,name='',owner='6a78a3609444495b89a585833b9cb86d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:37:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:37:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1322977777',display_name='tempest-AttachSCSIVolumeTestJSON-server-1322977777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1322977777',id=6,image_ref='e401a7c1-a4d7-4a65-ac53-540cca411897',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5Cij8zzsqNQ3suHvcWHlj8vdwh3bDjHGyHymq20YHDioVhNYfec41mqWnzYQQBxAZyfs+RvLmFx6OgsuZnRz3xWUzUTO240PiMzhHbQBoji/KTOh75/CQeig0NkNHfQA==',key_name='tempest-keypair-502951310',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3dfab4672f4f4303839a67b98699cae5',ramdisk_id='',reservation_id='r-76pw76wt',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e401a7c1-a4d7-4a65-ac53-540cca411897',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-662982876',owner_user_name='tempest-AttachSCSIVolumeTestJSON-662982876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:37:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a60dca728ca341b2a6908ba984a799e4',uuid=afe2c15e-4e27-47f3-8b0b-426f4b8619d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54d197ce-aea5-41ab-b450-e86a182c8bc4", "address": "fa:16:3e:66:74:06", "network": {"id": "e0ff8c51-555a-4539-8408-7efee217025c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1595132883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dfab4672f4f4303839a67b98699cae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54d197ce-ae", "ovs_interfaceid": "54d197ce-aea5-41ab-b450-e86a182c8bc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Converting VIF {"id": "54d197ce-aea5-41ab-b450-e86a182c8bc4", "address": "fa:16:3e:66:74:06", "network": {"id": "e0ff8c51-555a-4539-8408-7efee217025c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1595132883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dfab4672f4f4303839a67b98699cae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54d197ce-ae", "ovs_interfaceid": "54d197ce-aea5-41ab-b450-e86a182c8bc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:74:06,bridge_name='br-int',has_traffic_filtering=True,id=54d197ce-aea5-41ab-b450-e86a182c8bc4,network=Network(e0ff8c51-555a-4539-8408-7efee217025c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54d197ce-ae') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG nova.objects.instance [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lazy-loading 'pci_devices' on Instance uuid afe2c15e-4e27-47f3-8b0b-426f4b8619d1 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:37:25 user nova-compute[73104]:   <uuid>afe2c15e-4e27-47f3-8b0b-426f4b8619d1</uuid>
Aug 26 08:37:25 user nova-compute[73104]:   <name>instance-00000006</name>
Aug 26 08:37:25 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:37:25 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:37:25 user nova-compute[73104]:   <metadata>
Aug 26 08:37:25 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:37:25 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:37:25 user nova-compute[73104]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1322977777</nova:name>
Aug 26 08:37:25 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:37:25</nova:creationTime>
Aug 26 08:37:25 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:37:25 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:37:25 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:37:25 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:37:25 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:37:25 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:37:25 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:37:25 user nova-compute[73104]:       <nova:owner>
Aug 26 08:37:25 user nova-compute[73104]:         <nova:user uuid="a60dca728ca341b2a6908ba984a799e4">tempest-AttachSCSIVolumeTestJSON-662982876-project-member</nova:user>
Aug 26 08:37:25 user nova-compute[73104]:         <nova:project uuid="3dfab4672f4f4303839a67b98699cae5">tempest-AttachSCSIVolumeTestJSON-662982876</nova:project>
Aug 26 08:37:25 user nova-compute[73104]:       </nova:owner>
Aug 26 08:37:25 user nova-compute[73104]:       <nova:root type="image" uuid="e401a7c1-a4d7-4a65-ac53-540cca411897"/>
Aug 26 08:37:25 user nova-compute[73104]:       <nova:ports>
Aug 26 08:37:25 user nova-compute[73104]:         <nova:port uuid="54d197ce-aea5-41ab-b450-e86a182c8bc4">
Aug 26 08:37:25 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 08:37:25 user nova-compute[73104]:         </nova:port>
Aug 26 08:37:25 user nova-compute[73104]:       </nova:ports>
Aug 26 08:37:25 user nova-compute[73104]:     </nova:instance>
Aug 26 08:37:25 user nova-compute[73104]:   </metadata>
Aug 26 08:37:25 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:37:25 user nova-compute[73104]:     <system>
Aug 26 08:37:25 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:37:25 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:37:25 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:37:25 user nova-compute[73104]:       <entry name="serial">afe2c15e-4e27-47f3-8b0b-426f4b8619d1</entry>
Aug 26 08:37:25 user nova-compute[73104]:       <entry name="uuid">afe2c15e-4e27-47f3-8b0b-426f4b8619d1</entry>
Aug 26 08:37:25 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:37:25 user nova-compute[73104]:     </system>
Aug 26 08:37:25 user nova-compute[73104]:   </sysinfo>
Aug 26 08:37:25 user nova-compute[73104]:   <os>
Aug 26 08:37:25 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:37:25 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:37:25 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:37:25 user nova-compute[73104]:   </os>
Aug 26 08:37:25 user nova-compute[73104]:   <features>
Aug 26 08:37:25 user nova-compute[73104]:     <acpi/>
Aug 26 08:37:25 user nova-compute[73104]:     <apic/>
Aug 26 08:37:25 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:37:25 user nova-compute[73104]:   </features>
Aug 26 08:37:25 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:37:25 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:37:25 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:37:25 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:37:25 user nova-compute[73104]:   </clock>
Aug 26 08:37:25 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:37:25 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:37:25 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:37:25 user nova-compute[73104]:   </cpu>
Aug 26 08:37:25 user nova-compute[73104]:   <devices>
Aug 26 08:37:25 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:37:25 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:37:25 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/afe2c15e-4e27-47f3-8b0b-426f4b8619d1/disk"/>
Aug 26 08:37:25 user nova-compute[73104]:       <target dev="sda" bus="scsi"/>
Aug 26 08:37:25 user nova-compute[73104]:       <address type="drive" controller="0" unit="0"/>
Aug 26 08:37:25 user nova-compute[73104]:     </disk>
Aug 26 08:37:25 user nova-compute[73104]:     <disk type="file" device="cdrom">
Aug 26 08:37:25 user nova-compute[73104]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 08:37:25 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/afe2c15e-4e27-47f3-8b0b-426f4b8619d1/disk.config"/>
Aug 26 08:37:25 user nova-compute[73104]:       <target dev="sdb" bus="scsi"/>
Aug 26 08:37:25 user nova-compute[73104]:       <address type="drive" controller="0" unit="1"/>
Aug 26 08:37:25 user nova-compute[73104]:     </disk>
Aug 26 08:37:25 user nova-compute[73104]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 26 08:37:25 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:37:25 user nova-compute[73104]:       <mac address="fa:16:3e:66:74:06"/>
Aug 26 08:37:25 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:37:25 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:37:25 user nova-compute[73104]:       <target dev="tap54d197ce-ae"/>
Aug 26 08:37:25 user nova-compute[73104]:     </interface>
Aug 26 08:37:25 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:37:25 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/afe2c15e-4e27-47f3-8b0b-426f4b8619d1/console.log" append="off"/>
Aug 26 08:37:25 user nova-compute[73104]:     </serial>
Aug 26 08:37:25 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:37:25 user nova-compute[73104]:     <video>
Aug 26 08:37:25 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:37:25 user nova-compute[73104]:     </video>
Aug 26 08:37:25 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:37:25 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:37:25 user nova-compute[73104]:     </rng>
Aug 26 08:37:25 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:37:25 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:37:25 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:37:25 user nova-compute[73104]:     </memballoon>
Aug 26 08:37:25 user nova-compute[73104]:   </devices>
Aug 26 08:37:25 user nova-compute[73104]: </domain>
Aug 26 08:37:25 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:37:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1322977777',display_name='tempest-AttachSCSIVolumeTestJSON-server-1322977777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1322977777',id=6,image_ref='e401a7c1-a4d7-4a65-ac53-540cca411897',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5Cij8zzsqNQ3suHvcWHlj8vdwh3bDjHGyHymq20YHDioVhNYfec41mqWnzYQQBxAZyfs+RvLmFx6OgsuZnRz3xWUzUTO240PiMzhHbQBoji/KTOh75/CQeig0NkNHfQA==',key_name='tempest-keypair-502951310',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3dfab4672f4f4303839a67b98699cae5',ramdisk_id='',reservation_id='r-76pw76wt',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e401a7c1-a4d7-4a65-ac53-540cca411897',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-662982876',owner_user_name='tempest-AttachSCSIVolumeTestJSON-662982876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:37:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a60dca728ca341b2a6908ba984a799e4',uuid=afe2c15e-4e27-47f3-8b0b-426f4b8619d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54d197ce-aea5-41ab-b450-e86a182c8bc4", "address": "fa:16:3e:66:74:06", "network": {"id": "e0ff8c51-555a-4539-8408-7efee217025c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1595132883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dfab4672f4f4303839a67b98699cae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54d197ce-ae", "ovs_interfaceid": "54d197ce-aea5-41ab-b450-e86a182c8bc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Converting VIF {"id": "54d197ce-aea5-41ab-b450-e86a182c8bc4", "address": "fa:16:3e:66:74:06", "network": {"id": "e0ff8c51-555a-4539-8408-7efee217025c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1595132883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dfab4672f4f4303839a67b98699cae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54d197ce-ae", "ovs_interfaceid": "54d197ce-aea5-41ab-b450-e86a182c8bc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:74:06,bridge_name='br-int',has_traffic_filtering=True,id=54d197ce-aea5-41ab-b450-e86a182c8bc4,network=Network(e0ff8c51-555a-4539-8408-7efee217025c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54d197ce-ae') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG os_vif [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:74:06,bridge_name='br-int',has_traffic_filtering=True,id=54d197ce-aea5-41ab-b450-e86a182c8bc4,network=Network(e0ff8c51-555a-4539-8408-7efee217025c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54d197ce-ae') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54d197ce-ae, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap54d197ce-ae, col_values=(('external_ids', {'iface-id': '54d197ce-aea5-41ab-b450-e86a182c8bc4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:74:06', 'vm-uuid': 'afe2c15e-4e27-47f3-8b0b-426f4b8619d1'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:25 user nova-compute[73104]: INFO os_vif [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:74:06,bridge_name='br-int',has_traffic_filtering=True,id=54d197ce-aea5-41ab-b450-e86a182c8bc4,network=Network(e0ff8c51-555a-4539-8408-7efee217025c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54d197ce-ae')
Aug 26 08:37:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] No BDM found with device name sda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:37:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] No VIF found with MAC fa:16:3e:66:74:06, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:37:25 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Using config drive
Aug 26 08:37:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Acquiring lock "93244bcd-34be-46f3-85e6-87bb5e69888d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "93244bcd-34be-46f3-85e6-87bb5e69888d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:26 user nova-compute[73104]: DEBUG nova.compute.manager [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:37:26 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Creating config drive at /opt/stack/data/nova/instances/afe2c15e-4e27-47f3-8b0b-426f4b8619d1/disk.config
Aug 26 08:37:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/afe2c15e-4e27-47f3-8b0b-426f4b8619d1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmputojb7ve {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/afe2c15e-4e27-47f3-8b0b-426f4b8619d1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmputojb7ve" returned: 0 in 0.072s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:26 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:37:26 user nova-compute[73104]: INFO nova.compute.claims [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Claim successful on node user
Aug 26 08:37:26 user nova-compute[73104]: DEBUG nova.network.neutron [req-f02104d8-9c74-4c6b-accd-c1953105a1dd req-94ef3f13-a6a9-4dd9-a669-ff14db8db0d3 service nova] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Updated VIF entry in instance network info cache for port 54d197ce-aea5-41ab-b450-e86a182c8bc4. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:37:26 user nova-compute[73104]: DEBUG nova.network.neutron [req-f02104d8-9c74-4c6b-accd-c1953105a1dd req-94ef3f13-a6a9-4dd9-a669-ff14db8db0d3 service nova] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Updating instance_info_cache with network_info: [{"id": "54d197ce-aea5-41ab-b450-e86a182c8bc4", "address": "fa:16:3e:66:74:06", "network": {"id": "e0ff8c51-555a-4539-8408-7efee217025c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1595132883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dfab4672f4f4303839a67b98699cae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54d197ce-ae", "ovs_interfaceid": "54d197ce-aea5-41ab-b450-e86a182c8bc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:37:26 user nova-compute[73104]: DEBUG nova.compute.manager [req-94172d5d-2401-4024-abd9-c02221392c89 req-479af787-83ba-401a-85fc-9fa956053d25 service nova] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Received event network-vif-plugged-be09acc4-f1a1-40a1-bfab-90b23ac8000c {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:37:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-94172d5d-2401-4024-abd9-c02221392c89 req-479af787-83ba-401a-85fc-9fa956053d25 service nova] Acquiring lock "dcec7631-b94f-4dbf-b85d-e8ad9c6396b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-94172d5d-2401-4024-abd9-c02221392c89 req-479af787-83ba-401a-85fc-9fa956053d25 service nova] Lock "dcec7631-b94f-4dbf-b85d-e8ad9c6396b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-94172d5d-2401-4024-abd9-c02221392c89 req-479af787-83ba-401a-85fc-9fa956053d25 service nova] Lock "dcec7631-b94f-4dbf-b85d-e8ad9c6396b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:26 user nova-compute[73104]: DEBUG nova.compute.manager [req-94172d5d-2401-4024-abd9-c02221392c89 req-479af787-83ba-401a-85fc-9fa956053d25 service nova] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] No waiting events found dispatching network-vif-plugged-be09acc4-f1a1-40a1-bfab-90b23ac8000c {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:37:26 user nova-compute[73104]: WARNING nova.compute.manager [req-94172d5d-2401-4024-abd9-c02221392c89 req-479af787-83ba-401a-85fc-9fa956053d25 service nova] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Received unexpected event network-vif-plugged-be09acc4-f1a1-40a1-bfab-90b23ac8000c for instance with vm_state active and task_state None.
Aug 26 08:37:26 user nova-compute[73104]: DEBUG nova.compute.manager [req-94172d5d-2401-4024-abd9-c02221392c89 req-479af787-83ba-401a-85fc-9fa956053d25 service nova] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Received event network-vif-plugged-be09acc4-f1a1-40a1-bfab-90b23ac8000c {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:37:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-94172d5d-2401-4024-abd9-c02221392c89 req-479af787-83ba-401a-85fc-9fa956053d25 service nova] Acquiring lock "dcec7631-b94f-4dbf-b85d-e8ad9c6396b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-94172d5d-2401-4024-abd9-c02221392c89 req-479af787-83ba-401a-85fc-9fa956053d25 service nova] Lock "dcec7631-b94f-4dbf-b85d-e8ad9c6396b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-94172d5d-2401-4024-abd9-c02221392c89 req-479af787-83ba-401a-85fc-9fa956053d25 service nova] Lock "dcec7631-b94f-4dbf-b85d-e8ad9c6396b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:26 user nova-compute[73104]: DEBUG nova.compute.manager [req-94172d5d-2401-4024-abd9-c02221392c89 req-479af787-83ba-401a-85fc-9fa956053d25 service nova] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] No waiting events found dispatching network-vif-plugged-be09acc4-f1a1-40a1-bfab-90b23ac8000c {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:37:26 user nova-compute[73104]: WARNING nova.compute.manager [req-94172d5d-2401-4024-abd9-c02221392c89 req-479af787-83ba-401a-85fc-9fa956053d25 service nova] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Received unexpected event network-vif-plugged-be09acc4-f1a1-40a1-bfab-90b23ac8000c for instance with vm_state active and task_state None.
Aug 26 08:37:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f02104d8-9c74-4c6b-accd-c1953105a1dd req-94ef3f13-a6a9-4dd9-a669-ff14db8db0d3 service nova] Releasing lock "refresh_cache-afe2c15e-4e27-47f3-8b0b-426f4b8619d1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:37:26 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:37:26 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:37:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.776s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:27 user nova-compute[73104]: DEBUG nova.compute.manager [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:37:27 user nova-compute[73104]: DEBUG nova.compute.manager [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:37:27 user nova-compute[73104]: DEBUG nova.network.neutron [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:37:27 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:37:27 user nova-compute[73104]: DEBUG nova.compute.manager [req-3a3d5418-b9fe-4b40-b1b8-316345d4d9ce req-7e919a41-7930-44d4-af02-3bc067da00ed service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Received event network-vif-plugged-d4692900-c165-487d-9847-383fcf1d2270 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:37:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3a3d5418-b9fe-4b40-b1b8-316345d4d9ce req-7e919a41-7930-44d4-af02-3bc067da00ed service nova] Acquiring lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3a3d5418-b9fe-4b40-b1b8-316345d4d9ce req-7e919a41-7930-44d4-af02-3bc067da00ed service nova] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3a3d5418-b9fe-4b40-b1b8-316345d4d9ce req-7e919a41-7930-44d4-af02-3bc067da00ed service nova] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:27 user nova-compute[73104]: DEBUG nova.compute.manager [req-3a3d5418-b9fe-4b40-b1b8-316345d4d9ce req-7e919a41-7930-44d4-af02-3bc067da00ed service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] No waiting events found dispatching network-vif-plugged-d4692900-c165-487d-9847-383fcf1d2270 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:37:27 user nova-compute[73104]: WARNING nova.compute.manager [req-3a3d5418-b9fe-4b40-b1b8-316345d4d9ce req-7e919a41-7930-44d4-af02-3bc067da00ed service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Received unexpected event network-vif-plugged-d4692900-c165-487d-9847-383fcf1d2270 for instance with vm_state active and task_state None.
Aug 26 08:37:27 user nova-compute[73104]: DEBUG nova.compute.manager [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:37:27 user nova-compute[73104]: DEBUG nova.compute.manager [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:37:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:37:27 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Creating image(s)
Aug 26 08:37:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Acquiring lock "/opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "/opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "/opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:27 user nova-compute[73104]: DEBUG nova.policy [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5653cc2733b44477957b797143a854f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6f6e226b23400481b2ad063356bc06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:37:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.232s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.220s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk 1073741824" returned: 0 in 0.062s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.306s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:28 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Checking if we can resize image /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 08:37:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:28 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Cannot resize image /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 08:37:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:37:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Ensure instance console log exists: /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:37:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:28 user nova-compute[73104]: DEBUG nova.network.neutron [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Successfully created port: af8b0ae5-581c-4096-98de-4442fe942572 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:37:29 user nova-compute[73104]: DEBUG nova.compute.manager [req-06c2e5f7-d1d9-444f-8c21-b6cb609b1ceb req-41e67581-25c0-4588-8332-88841a5a9937 service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Received event network-vif-plugged-d4692900-c165-487d-9847-383fcf1d2270 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:37:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-06c2e5f7-d1d9-444f-8c21-b6cb609b1ceb req-41e67581-25c0-4588-8332-88841a5a9937 service nova] Acquiring lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-06c2e5f7-d1d9-444f-8c21-b6cb609b1ceb req-41e67581-25c0-4588-8332-88841a5a9937 service nova] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-06c2e5f7-d1d9-444f-8c21-b6cb609b1ceb req-41e67581-25c0-4588-8332-88841a5a9937 service nova] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:29 user nova-compute[73104]: DEBUG nova.compute.manager [req-06c2e5f7-d1d9-444f-8c21-b6cb609b1ceb req-41e67581-25c0-4588-8332-88841a5a9937 service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] No waiting events found dispatching network-vif-plugged-d4692900-c165-487d-9847-383fcf1d2270 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:37:29 user nova-compute[73104]: WARNING nova.compute.manager [req-06c2e5f7-d1d9-444f-8c21-b6cb609b1ceb req-41e67581-25c0-4588-8332-88841a5a9937 service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Received unexpected event network-vif-plugged-d4692900-c165-487d-9847-383fcf1d2270 for instance with vm_state active and task_state None.
Aug 26 08:37:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:29 user nova-compute[73104]: DEBUG nova.network.neutron [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Successfully updated port: af8b0ae5-581c-4096-98de-4442fe942572 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:37:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Acquiring lock "refresh_cache-93244bcd-34be-46f3-85e6-87bb5e69888d" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:37:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Acquired lock "refresh_cache-93244bcd-34be-46f3-85e6-87bb5e69888d" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:37:29 user nova-compute[73104]: DEBUG nova.network.neutron [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:37:29 user nova-compute[73104]: DEBUG nova.compute.manager [req-32e39337-91af-45f0-b233-2d2195412ecd req-ff9513b3-3853-417b-a4f0-7debe7fd1944 service nova] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Received event network-changed-af8b0ae5-581c-4096-98de-4442fe942572 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:37:29 user nova-compute[73104]: DEBUG nova.compute.manager [req-32e39337-91af-45f0-b233-2d2195412ecd req-ff9513b3-3853-417b-a4f0-7debe7fd1944 service nova] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Refreshing instance network info cache due to event network-changed-af8b0ae5-581c-4096-98de-4442fe942572. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:37:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-32e39337-91af-45f0-b233-2d2195412ecd req-ff9513b3-3853-417b-a4f0-7debe7fd1944 service nova] Acquiring lock "refresh_cache-93244bcd-34be-46f3-85e6-87bb5e69888d" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:37:29 user nova-compute[73104]: DEBUG nova.network.neutron [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:37:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.network.neutron [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Updating instance_info_cache with network_info: [{"id": "af8b0ae5-581c-4096-98de-4442fe942572", "address": "fa:16:3e:d5:84:96", "network": {"id": "58299b40-db54-4ba9-b4aa-8a40f0c2c2d4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-295087397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef6f6e226b23400481b2ad063356bc06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8b0ae5-58", "ovs_interfaceid": "af8b0ae5-581c-4096-98de-4442fe942572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Releasing lock "refresh_cache-93244bcd-34be-46f3-85e6-87bb5e69888d" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Instance network_info: |[{"id": "af8b0ae5-581c-4096-98de-4442fe942572", "address": "fa:16:3e:d5:84:96", "network": {"id": "58299b40-db54-4ba9-b4aa-8a40f0c2c2d4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-295087397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef6f6e226b23400481b2ad063356bc06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8b0ae5-58", "ovs_interfaceid": "af8b0ae5-581c-4096-98de-4442fe942572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-32e39337-91af-45f0-b233-2d2195412ecd req-ff9513b3-3853-417b-a4f0-7debe7fd1944 service nova] Acquired lock "refresh_cache-93244bcd-34be-46f3-85e6-87bb5e69888d" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.network.neutron [req-32e39337-91af-45f0-b233-2d2195412ecd req-ff9513b3-3853-417b-a4f0-7debe7fd1944 service nova] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Refreshing network info cache for port af8b0ae5-581c-4096-98de-4442fe942572 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Start _get_guest_xml network_info=[{"id": "af8b0ae5-581c-4096-98de-4442fe942572", "address": "fa:16:3e:d5:84:96", "network": {"id": "58299b40-db54-4ba9-b4aa-8a40f0c2c2d4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-295087397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef6f6e226b23400481b2ad063356bc06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8b0ae5-58", "ovs_interfaceid": "af8b0ae5-581c-4096-98de-4442fe942572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:37:30 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:37:30 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:37:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1547126579',display_name='tempest-VolumesAdminNegativeTest-server-1547126579',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1547126579',id=7,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmUvowBy17O/E9fJcG7qnd87vsTeKHup7cw1MYZ+PRv7BvCdLVqhgBK9Acm341Ypc0U7HBA/GwF1qLAZDs86VZN2zZkIwBCTvQqjNmNiOpTkOROt8e4uwbmnUJHLISQRg==',key_name='tempest-keypair-1074283344',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef6f6e226b23400481b2ad063356bc06',ramdisk_id='',reservation_id='r-xqm417tn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-933148822',owner_user_name='tempest-VolumesAdminNegativeTest-933148822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:37:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5653cc2733b44477957b797143a854f6',uuid=93244bcd-34be-46f3-85e6-87bb5e69888d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af8b0ae5-581c-4096-98de-4442fe942572", "address": "fa:16:3e:d5:84:96", "network": {"id": "58299b40-db54-4ba9-b4aa-8a40f0c2c2d4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-295087397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef6f6e226b23400481b2ad063356bc06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8b0ae5-58", "ovs_interfaceid": "af8b0ae5-581c-4096-98de-4442fe942572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Converting VIF {"id": "af8b0ae5-581c-4096-98de-4442fe942572", "address": "fa:16:3e:d5:84:96", "network": {"id": "58299b40-db54-4ba9-b4aa-8a40f0c2c2d4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-295087397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef6f6e226b23400481b2ad063356bc06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8b0ae5-58", "ovs_interfaceid": "af8b0ae5-581c-4096-98de-4442fe942572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:84:96,bridge_name='br-int',has_traffic_filtering=True,id=af8b0ae5-581c-4096-98de-4442fe942572,network=Network(58299b40-db54-4ba9-b4aa-8a40f0c2c2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8b0ae5-58') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.objects.instance [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lazy-loading 'pci_devices' on Instance uuid 93244bcd-34be-46f3-85e6-87bb5e69888d {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039050.384094, afe2c15e-4e27-47f3-8b0b-426f4b8619d1 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:37:30 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] VM Resumed (Lifecycle Event)
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:37:30 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Instance spawned successfully.
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:37:30 user nova-compute[73104]:   <uuid>93244bcd-34be-46f3-85e6-87bb5e69888d</uuid>
Aug 26 08:37:30 user nova-compute[73104]:   <name>instance-00000007</name>
Aug 26 08:37:30 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:37:30 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:37:30 user nova-compute[73104]:   <metadata>
Aug 26 08:37:30 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:37:30 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:37:30 user nova-compute[73104]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1547126579</nova:name>
Aug 26 08:37:30 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:37:30</nova:creationTime>
Aug 26 08:37:30 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:37:30 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:37:30 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:37:30 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:37:30 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:37:30 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:37:30 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:37:30 user nova-compute[73104]:       <nova:owner>
Aug 26 08:37:30 user nova-compute[73104]:         <nova:user uuid="5653cc2733b44477957b797143a854f6">tempest-VolumesAdminNegativeTest-933148822-project-member</nova:user>
Aug 26 08:37:30 user nova-compute[73104]:         <nova:project uuid="ef6f6e226b23400481b2ad063356bc06">tempest-VolumesAdminNegativeTest-933148822</nova:project>
Aug 26 08:37:30 user nova-compute[73104]:       </nova:owner>
Aug 26 08:37:30 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:37:30 user nova-compute[73104]:       <nova:ports>
Aug 26 08:37:30 user nova-compute[73104]:         <nova:port uuid="af8b0ae5-581c-4096-98de-4442fe942572">
Aug 26 08:37:30 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 08:37:30 user nova-compute[73104]:         </nova:port>
Aug 26 08:37:30 user nova-compute[73104]:       </nova:ports>
Aug 26 08:37:30 user nova-compute[73104]:     </nova:instance>
Aug 26 08:37:30 user nova-compute[73104]:   </metadata>
Aug 26 08:37:30 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:37:30 user nova-compute[73104]:     <system>
Aug 26 08:37:30 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:37:30 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:37:30 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:37:30 user nova-compute[73104]:       <entry name="serial">93244bcd-34be-46f3-85e6-87bb5e69888d</entry>
Aug 26 08:37:30 user nova-compute[73104]:       <entry name="uuid">93244bcd-34be-46f3-85e6-87bb5e69888d</entry>
Aug 26 08:37:30 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:37:30 user nova-compute[73104]:     </system>
Aug 26 08:37:30 user nova-compute[73104]:   </sysinfo>
Aug 26 08:37:30 user nova-compute[73104]:   <os>
Aug 26 08:37:30 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:37:30 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:37:30 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:37:30 user nova-compute[73104]:   </os>
Aug 26 08:37:30 user nova-compute[73104]:   <features>
Aug 26 08:37:30 user nova-compute[73104]:     <acpi/>
Aug 26 08:37:30 user nova-compute[73104]:     <apic/>
Aug 26 08:37:30 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:37:30 user nova-compute[73104]:   </features>
Aug 26 08:37:30 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:37:30 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:37:30 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:37:30 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:37:30 user nova-compute[73104]:   </clock>
Aug 26 08:37:30 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:37:30 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:37:30 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:37:30 user nova-compute[73104]:   </cpu>
Aug 26 08:37:30 user nova-compute[73104]:   <devices>
Aug 26 08:37:30 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:37:30 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:37:30 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk"/>
Aug 26 08:37:30 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:37:30 user nova-compute[73104]:     </disk>
Aug 26 08:37:30 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:37:30 user nova-compute[73104]:       <mac address="fa:16:3e:d5:84:96"/>
Aug 26 08:37:30 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:37:30 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:37:30 user nova-compute[73104]:       <target dev="tapaf8b0ae5-58"/>
Aug 26 08:37:30 user nova-compute[73104]:     </interface>
Aug 26 08:37:30 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:37:30 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/console.log" append="off"/>
Aug 26 08:37:30 user nova-compute[73104]:     </serial>
Aug 26 08:37:30 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:37:30 user nova-compute[73104]:     <video>
Aug 26 08:37:30 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:37:30 user nova-compute[73104]:     </video>
Aug 26 08:37:30 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:37:30 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:37:30 user nova-compute[73104]:     </rng>
Aug 26 08:37:30 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:37:30 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:37:30 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:37:30 user nova-compute[73104]:     </memballoon>
Aug 26 08:37:30 user nova-compute[73104]:   </devices>
Aug 26 08:37:30 user nova-compute[73104]: </domain>
Aug 26 08:37:30 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:37:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1547126579',display_name='tempest-VolumesAdminNegativeTest-server-1547126579',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1547126579',id=7,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmUvowBy17O/E9fJcG7qnd87vsTeKHup7cw1MYZ+PRv7BvCdLVqhgBK9Acm341Ypc0U7HBA/GwF1qLAZDs86VZN2zZkIwBCTvQqjNmNiOpTkOROt8e4uwbmnUJHLISQRg==',key_name='tempest-keypair-1074283344',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef6f6e226b23400481b2ad063356bc06',ramdisk_id='',reservation_id='r-xqm417tn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-933148822',owner_user_name='tempest-VolumesAdminNegativeTest-933148822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:37:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5653cc2733b44477957b797143a854f6',uuid=93244bcd-34be-46f3-85e6-87bb5e69888d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af8b0ae5-581c-4096-98de-4442fe942572", "address": "fa:16:3e:d5:84:96", "network": {"id": "58299b40-db54-4ba9-b4aa-8a40f0c2c2d4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-295087397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef6f6e226b23400481b2ad063356bc06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8b0ae5-58", "ovs_interfaceid": "af8b0ae5-581c-4096-98de-4442fe942572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Converting VIF {"id": "af8b0ae5-581c-4096-98de-4442fe942572", "address": "fa:16:3e:d5:84:96", "network": {"id": "58299b40-db54-4ba9-b4aa-8a40f0c2c2d4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-295087397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef6f6e226b23400481b2ad063356bc06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8b0ae5-58", "ovs_interfaceid": "af8b0ae5-581c-4096-98de-4442fe942572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:84:96,bridge_name='br-int',has_traffic_filtering=True,id=af8b0ae5-581c-4096-98de-4442fe942572,network=Network(58299b40-db54-4ba9-b4aa-8a40f0c2c2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8b0ae5-58') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG os_vif [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:84:96,bridge_name='br-int',has_traffic_filtering=True,id=af8b0ae5-581c-4096-98de-4442fe942572,network=Network(58299b40-db54-4ba9-b4aa-8a40f0c2c2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8b0ae5-58') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf8b0ae5-58, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaf8b0ae5-58, col_values=(('external_ids', {'iface-id': 'af8b0ae5-581c-4096-98de-4442fe942572', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:84:96', 'vm-uuid': '93244bcd-34be-46f3-85e6-87bb5e69888d'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:30 user nova-compute[73104]: INFO os_vif [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:84:96,bridge_name='br-int',has_traffic_filtering=True,id=af8b0ae5-581c-4096-98de-4442fe942572,network=Network(58299b40-db54-4ba9-b4aa-8a40f0c2c2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8b0ae5-58')
Aug 26 08:37:30 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039050.3850415, afe2c15e-4e27-47f3-8b0b-426f4b8619d1 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:37:30 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] VM Started (Lifecycle Event)
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:37:30 user nova-compute[73104]: INFO nova.compute.manager [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Took 8.99 seconds to spawn the instance on the hypervisor.
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:37:30 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:37:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] No VIF found with MAC fa:16:3e:d5:84:96, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:37:30 user nova-compute[73104]: INFO nova.compute.manager [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Took 10.56 seconds to build instance.
Aug 26 08:37:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a157fc2e-d9ee-40e4-9808-5d32fdaa5473 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lock "afe2c15e-4e27-47f3-8b0b-426f4b8619d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.754s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:31 user nova-compute[73104]: DEBUG nova.network.neutron [req-32e39337-91af-45f0-b233-2d2195412ecd req-ff9513b3-3853-417b-a4f0-7debe7fd1944 service nova] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Updated VIF entry in instance network info cache for port af8b0ae5-581c-4096-98de-4442fe942572. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:37:31 user nova-compute[73104]: DEBUG nova.network.neutron [req-32e39337-91af-45f0-b233-2d2195412ecd req-ff9513b3-3853-417b-a4f0-7debe7fd1944 service nova] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Updating instance_info_cache with network_info: [{"id": "af8b0ae5-581c-4096-98de-4442fe942572", "address": "fa:16:3e:d5:84:96", "network": {"id": "58299b40-db54-4ba9-b4aa-8a40f0c2c2d4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-295087397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef6f6e226b23400481b2ad063356bc06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8b0ae5-58", "ovs_interfaceid": "af8b0ae5-581c-4096-98de-4442fe942572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:37:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-32e39337-91af-45f0-b233-2d2195412ecd req-ff9513b3-3853-417b-a4f0-7debe7fd1944 service nova] Releasing lock "refresh_cache-93244bcd-34be-46f3-85e6-87bb5e69888d" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:37:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:33 user nova-compute[73104]: DEBUG nova.compute.manager [req-2bc29ccc-b4f7-4494-afba-17337e0d4d53 req-1969cf0e-4c8a-4882-8077-62ee53dce913 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Received event network-vif-plugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:37:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2bc29ccc-b4f7-4494-afba-17337e0d4d53 req-1969cf0e-4c8a-4882-8077-62ee53dce913 service nova] Acquiring lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2bc29ccc-b4f7-4494-afba-17337e0d4d53 req-1969cf0e-4c8a-4882-8077-62ee53dce913 service nova] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2bc29ccc-b4f7-4494-afba-17337e0d4d53 req-1969cf0e-4c8a-4882-8077-62ee53dce913 service nova] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:33 user nova-compute[73104]: DEBUG nova.compute.manager [req-2bc29ccc-b4f7-4494-afba-17337e0d4d53 req-1969cf0e-4c8a-4882-8077-62ee53dce913 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] No waiting events found dispatching network-vif-plugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:37:33 user nova-compute[73104]: WARNING nova.compute.manager [req-2bc29ccc-b4f7-4494-afba-17337e0d4d53 req-1969cf0e-4c8a-4882-8077-62ee53dce913 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Received unexpected event network-vif-plugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 for instance with vm_state active and task_state None.
Aug 26 08:37:35 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039055.0333421, 93244bcd-34be-46f3-85e6-87bb5e69888d => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:37:35 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] VM Resumed (Lifecycle Event)
Aug 26 08:37:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:37:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:37:35 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Instance spawned successfully.
Aug 26 08:37:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:37:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:37:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:37:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:35 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:37:35 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039055.034322, 93244bcd-34be-46f3-85e6-87bb5e69888d => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:37:35 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] VM Started (Lifecycle Event)
Aug 26 08:37:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:37:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:37:35 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:37:35 user nova-compute[73104]: INFO nova.compute.manager [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Took 7.83 seconds to spawn the instance on the hypervisor.
Aug 26 08:37:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:37:35 user nova-compute[73104]: INFO nova.compute.manager [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Took 9.12 seconds to build instance.
Aug 26 08:37:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d036b025-a5d6-4294-9204-1320328da37c tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "93244bcd-34be-46f3-85e6-87bb5e69888d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.262s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:35 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:35 user nova-compute[73104]: DEBUG nova.compute.manager [req-ff3939c8-ef87-4c7c-9ae7-1610dd8174c3 req-7dee6174-b72e-49b3-b6b2-4ebc29a398a8 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Received event network-vif-plugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:37:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ff3939c8-ef87-4c7c-9ae7-1610dd8174c3 req-7dee6174-b72e-49b3-b6b2-4ebc29a398a8 service nova] Acquiring lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ff3939c8-ef87-4c7c-9ae7-1610dd8174c3 req-7dee6174-b72e-49b3-b6b2-4ebc29a398a8 service nova] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ff3939c8-ef87-4c7c-9ae7-1610dd8174c3 req-7dee6174-b72e-49b3-b6b2-4ebc29a398a8 service nova] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:35 user nova-compute[73104]: DEBUG nova.compute.manager [req-ff3939c8-ef87-4c7c-9ae7-1610dd8174c3 req-7dee6174-b72e-49b3-b6b2-4ebc29a398a8 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] No waiting events found dispatching network-vif-plugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:37:35 user nova-compute[73104]: WARNING nova.compute.manager [req-ff3939c8-ef87-4c7c-9ae7-1610dd8174c3 req-7dee6174-b72e-49b3-b6b2-4ebc29a398a8 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Received unexpected event network-vif-plugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 for instance with vm_state active and task_state None.
Aug 26 08:37:37 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:37:37 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Cleaning up deleted instances {{(pid=73104) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 08:37:37 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] There are 0 instances to clean {{(pid=73104) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 08:37:37 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:37:37 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73104) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 08:37:37 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:37:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:38 user nova-compute[73104]: DEBUG nova.compute.manager [req-481ce822-6df9-4f3a-8e0f-12352629c2c8 req-a512e815-c83d-427c-8fe5-cf5cce3633d3 service nova] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Received event network-vif-plugged-54d197ce-aea5-41ab-b450-e86a182c8bc4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:37:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-481ce822-6df9-4f3a-8e0f-12352629c2c8 req-a512e815-c83d-427c-8fe5-cf5cce3633d3 service nova] Acquiring lock "afe2c15e-4e27-47f3-8b0b-426f4b8619d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-481ce822-6df9-4f3a-8e0f-12352629c2c8 req-a512e815-c83d-427c-8fe5-cf5cce3633d3 service nova] Lock "afe2c15e-4e27-47f3-8b0b-426f4b8619d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-481ce822-6df9-4f3a-8e0f-12352629c2c8 req-a512e815-c83d-427c-8fe5-cf5cce3633d3 service nova] Lock "afe2c15e-4e27-47f3-8b0b-426f4b8619d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:38 user nova-compute[73104]: DEBUG nova.compute.manager [req-481ce822-6df9-4f3a-8e0f-12352629c2c8 req-a512e815-c83d-427c-8fe5-cf5cce3633d3 service nova] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] No waiting events found dispatching network-vif-plugged-54d197ce-aea5-41ab-b450-e86a182c8bc4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:37:38 user nova-compute[73104]: WARNING nova.compute.manager [req-481ce822-6df9-4f3a-8e0f-12352629c2c8 req-a512e815-c83d-427c-8fe5-cf5cce3633d3 service nova] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Received unexpected event network-vif-plugged-54d197ce-aea5-41ab-b450-e86a182c8bc4 for instance with vm_state active and task_state None.
Aug 26 08:37:40 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:37:40 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 08:37:40 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Rebuilding the list of instances to heal {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 08:37:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-dcec7631-b94f-4dbf-b85d-e8ad9c6396b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:37:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-dcec7631-b94f-4dbf-b85d-e8ad9c6396b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:37:40 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 08:37:40 user nova-compute[73104]: DEBUG nova.objects.instance [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lazy-loading 'info_cache' on Instance uuid dcec7631-b94f-4dbf-b85d-e8ad9c6396b7 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:37:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:40 user nova-compute[73104]: DEBUG nova.compute.manager [req-9c018dad-46b2-4d06-9c05-cb1aac99035d req-f6f77fe6-61bf-49e5-ba8d-be891e01316e service nova] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Received event network-vif-plugged-54d197ce-aea5-41ab-b450-e86a182c8bc4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:37:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9c018dad-46b2-4d06-9c05-cb1aac99035d req-f6f77fe6-61bf-49e5-ba8d-be891e01316e service nova] Acquiring lock "afe2c15e-4e27-47f3-8b0b-426f4b8619d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9c018dad-46b2-4d06-9c05-cb1aac99035d req-f6f77fe6-61bf-49e5-ba8d-be891e01316e service nova] Lock "afe2c15e-4e27-47f3-8b0b-426f4b8619d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9c018dad-46b2-4d06-9c05-cb1aac99035d req-f6f77fe6-61bf-49e5-ba8d-be891e01316e service nova] Lock "afe2c15e-4e27-47f3-8b0b-426f4b8619d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:40 user nova-compute[73104]: DEBUG nova.compute.manager [req-9c018dad-46b2-4d06-9c05-cb1aac99035d req-f6f77fe6-61bf-49e5-ba8d-be891e01316e service nova] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] No waiting events found dispatching network-vif-plugged-54d197ce-aea5-41ab-b450-e86a182c8bc4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:37:40 user nova-compute[73104]: WARNING nova.compute.manager [req-9c018dad-46b2-4d06-9c05-cb1aac99035d req-f6f77fe6-61bf-49e5-ba8d-be891e01316e service nova] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Received unexpected event network-vif-plugged-54d197ce-aea5-41ab-b450-e86a182c8bc4 for instance with vm_state active and task_state None.
Aug 26 08:37:41 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Updating instance_info_cache with network_info: [{"id": "be09acc4-f1a1-40a1-bfab-90b23ac8000c", "address": "fa:16:3e:f0:64:0b", "network": {"id": "c6ce9852-f528-4ac1-aa7a-be833ed25137", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2003310403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a0141c91ef45e4bf23a4b1cc4eb029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe09acc4-f1", "ovs_interfaceid": "be09acc4-f1a1-40a1-bfab-90b23ac8000c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:37:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-dcec7631-b94f-4dbf-b85d-e8ad9c6396b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:37:41 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 08:37:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Acquiring lock "b04e96c7-f098-4612-b0b8-92cf6fd58865" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Lock "b04e96c7-f098-4612-b0b8-92cf6fd58865" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:41 user nova-compute[73104]: DEBUG nova.compute.manager [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:37:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:41 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:37:41 user nova-compute[73104]: INFO nova.compute.claims [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Claim successful on node user
Aug 26 08:37:42 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:37:42 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:37:42 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:37:42 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 08:37:42 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:37:42 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:37:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.505s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:42 user nova-compute[73104]: DEBUG nova.compute.manager [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:37:42 user nova-compute[73104]: DEBUG nova.compute.manager [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:37:42 user nova-compute[73104]: DEBUG nova.network.neutron [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:37:42 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:37:42 user nova-compute[73104]: DEBUG nova.compute.manager [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:37:42 user nova-compute[73104]: DEBUG nova.policy [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df5ec3ef2c5e45698ed648547430fa29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251199a8e75247e897551cb5bc1aec00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:37:42 user nova-compute[73104]: DEBUG nova.compute.manager [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:37:42 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:37:42 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Creating image(s)
Aug 26 08:37:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Acquiring lock "/opt/stack/data/nova/instances/b04e96c7-f098-4612-b0b8-92cf6fd58865/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Lock "/opt/stack/data/nova/instances/b04e96c7-f098-4612-b0b8-92cf6fd58865/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Lock "/opt/stack/data/nova/instances/b04e96c7-f098-4612-b0b8-92cf6fd58865/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.241s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:43 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.204s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:43 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/b04e96c7-f098-4612-b0b8-92cf6fd58865/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:43 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/b04e96c7-f098-4612-b0b8-92cf6fd58865/disk 1073741824" returned: 0 in 0.053s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:43 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:43 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:37:43 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:37:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:43 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 08:37:43 user nova-compute[73104]: DEBUG nova.network.neutron [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Successfully created port: e589161d-f15a-4143-8dcc-445bb29fbdff {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:37:43 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.247s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:43 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b04e96c7-f098-4612-b0b8-92cf6fd58865/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 08:37:43 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04e96c7-f098-4612-b0b8-92cf6fd58865/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:43 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:43 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04e96c7-f098-4612-b0b8-92cf6fd58865/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:43 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Cannot resize image /opt/stack/data/nova/instances/b04e96c7-f098-4612-b0b8-92cf6fd58865/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 08:37:43 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:37:43 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Ensure instance console log exists: /opt/stack/data/nova/instances/b04e96c7-f098-4612-b0b8-92cf6fd58865/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:37:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:43 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:43 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995a2bd3-4c54-4217-ae9f-056353008547/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995a2bd3-4c54-4217-ae9f-056353008547/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995a2bd3-4c54-4217-ae9f-056353008547/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:44 user nova-compute[73104]: DEBUG nova.network.neutron [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Successfully updated port: e589161d-f15a-4143-8dcc-445bb29fbdff {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:37:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Acquiring lock "refresh_cache-b04e96c7-f098-4612-b0b8-92cf6fd58865" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:37:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Acquired lock "refresh_cache-b04e96c7-f098-4612-b0b8-92cf6fd58865" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:37:44 user nova-compute[73104]: DEBUG nova.network.neutron [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:37:44 user nova-compute[73104]: DEBUG nova.compute.manager [req-b6ffff27-ad77-4dd5-a68e-552249648bd4 req-b37ff3e8-7c85-43ed-bc16-34accc105a8e service nova] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Received event network-changed-e589161d-f15a-4143-8dcc-445bb29fbdff {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:37:44 user nova-compute[73104]: DEBUG nova.compute.manager [req-b6ffff27-ad77-4dd5-a68e-552249648bd4 req-b37ff3e8-7c85-43ed-bc16-34accc105a8e service nova] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Refreshing instance network info cache due to event network-changed-e589161d-f15a-4143-8dcc-445bb29fbdff. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:37:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b6ffff27-ad77-4dd5-a68e-552249648bd4 req-b37ff3e8-7c85-43ed-bc16-34accc105a8e service nova] Acquiring lock "refresh_cache-b04e96c7-f098-4612-b0b8-92cf6fd58865" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:37:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995a2bd3-4c54-4217-ae9f-056353008547/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:44 user nova-compute[73104]: DEBUG nova.network.neutron [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:37:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG nova.network.neutron [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Updating instance_info_cache with network_info: [{"id": "e589161d-f15a-4143-8dcc-445bb29fbdff", "address": "fa:16:3e:23:5b:3a", "network": {"id": "6e5e1144-fa42-42e5-83e5-82d1825ede71", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-135318777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "251199a8e75247e897551cb5bc1aec00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape589161d-f1", "ovs_interfaceid": "e589161d-f15a-4143-8dcc-445bb29fbdff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Releasing lock "refresh_cache-b04e96c7-f098-4612-b0b8-92cf6fd58865" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG nova.compute.manager [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Instance network_info: |[{"id": "e589161d-f15a-4143-8dcc-445bb29fbdff", "address": "fa:16:3e:23:5b:3a", "network": {"id": "6e5e1144-fa42-42e5-83e5-82d1825ede71", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-135318777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "251199a8e75247e897551cb5bc1aec00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape589161d-f1", "ovs_interfaceid": "e589161d-f15a-4143-8dcc-445bb29fbdff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b6ffff27-ad77-4dd5-a68e-552249648bd4 req-b37ff3e8-7c85-43ed-bc16-34accc105a8e service nova] Acquired lock "refresh_cache-b04e96c7-f098-4612-b0b8-92cf6fd58865" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG nova.network.neutron [req-b6ffff27-ad77-4dd5-a68e-552249648bd4 req-b37ff3e8-7c85-43ed-bc16-34accc105a8e service nova] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Refreshing network info cache for port e589161d-f15a-4143-8dcc-445bb29fbdff {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Start _get_guest_xml network_info=[{"id": "e589161d-f15a-4143-8dcc-445bb29fbdff", "address": "fa:16:3e:23:5b:3a", "network": {"id": "6e5e1144-fa42-42e5-83e5-82d1825ede71", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-135318777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "251199a8e75247e897551cb5bc1aec00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape589161d-f1", "ovs_interfaceid": "e589161d-f15a-4143-8dcc-445bb29fbdff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:37:45 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:37:45 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:37:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:37:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1761440256',display_name='tempest-VolumesAssistedSnapshotsTest-server-1761440256',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1761440256',id=8,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOunchFb13bRhOM3jQW2UQnMPxvfTmt5AvnDaDPkitb77PHOy9GVGHdVESbzkwrvoMDNaPR1YdSZ+Aj2rN6g9lO4zYI9yIxcZlnqQNgPQKSjM6qdJJMLpbn/Q09h/CCCdA==',key_name='tempest-keypair-1246782866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='251199a8e75247e897551cb5bc1aec00',ramdisk_id='',reservation_id='r-gpwmnq8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-215182459',owner_user_name='tempest-VolumesAssistedSnapshotsTest-215182459-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:37:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df5ec3ef2c5e45698ed648547430fa29',uuid=b04e96c7-f098-4612-b0b8-92cf6fd58865,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e589161d-f15a-4143-8dcc-445bb29fbdff", "address": "fa:16:3e:23:5b:3a", "network": {"id": "6e5e1144-fa42-42e5-83e5-82d1825ede71", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-135318777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "251199a8e75247e897551cb5bc1aec00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape589161d-f1", "ovs_interfaceid": "e589161d-f15a-4143-8dcc-445bb29fbdff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Converting VIF {"id": "e589161d-f15a-4143-8dcc-445bb29fbdff", "address": "fa:16:3e:23:5b:3a", "network": {"id": "6e5e1144-fa42-42e5-83e5-82d1825ede71", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-135318777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "251199a8e75247e897551cb5bc1aec00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape589161d-f1", "ovs_interfaceid": "e589161d-f15a-4143-8dcc-445bb29fbdff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:5b:3a,bridge_name='br-int',has_traffic_filtering=True,id=e589161d-f15a-4143-8dcc-445bb29fbdff,network=Network(6e5e1144-fa42-42e5-83e5-82d1825ede71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape589161d-f1') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG nova.objects.instance [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Lazy-loading 'pci_devices' on Instance uuid b04e96c7-f098-4612-b0b8-92cf6fd58865 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:37:45 user nova-compute[73104]:   <uuid>b04e96c7-f098-4612-b0b8-92cf6fd58865</uuid>
Aug 26 08:37:45 user nova-compute[73104]:   <name>instance-00000008</name>
Aug 26 08:37:45 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:37:45 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:37:45 user nova-compute[73104]:   <metadata>
Aug 26 08:37:45 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:37:45 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:37:45 user nova-compute[73104]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1761440256</nova:name>
Aug 26 08:37:45 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:37:45</nova:creationTime>
Aug 26 08:37:45 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:37:45 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:37:45 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:37:45 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:37:45 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:37:45 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:37:45 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:37:45 user nova-compute[73104]:       <nova:owner>
Aug 26 08:37:45 user nova-compute[73104]:         <nova:user uuid="df5ec3ef2c5e45698ed648547430fa29">tempest-VolumesAssistedSnapshotsTest-215182459-project-member</nova:user>
Aug 26 08:37:45 user nova-compute[73104]:         <nova:project uuid="251199a8e75247e897551cb5bc1aec00">tempest-VolumesAssistedSnapshotsTest-215182459</nova:project>
Aug 26 08:37:45 user nova-compute[73104]:       </nova:owner>
Aug 26 08:37:45 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:37:45 user nova-compute[73104]:       <nova:ports>
Aug 26 08:37:45 user nova-compute[73104]:         <nova:port uuid="e589161d-f15a-4143-8dcc-445bb29fbdff">
Aug 26 08:37:45 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 08:37:45 user nova-compute[73104]:         </nova:port>
Aug 26 08:37:45 user nova-compute[73104]:       </nova:ports>
Aug 26 08:37:45 user nova-compute[73104]:     </nova:instance>
Aug 26 08:37:45 user nova-compute[73104]:   </metadata>
Aug 26 08:37:45 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:37:45 user nova-compute[73104]:     <system>
Aug 26 08:37:45 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:37:45 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:37:45 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:37:45 user nova-compute[73104]:       <entry name="serial">b04e96c7-f098-4612-b0b8-92cf6fd58865</entry>
Aug 26 08:37:45 user nova-compute[73104]:       <entry name="uuid">b04e96c7-f098-4612-b0b8-92cf6fd58865</entry>
Aug 26 08:37:45 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:37:45 user nova-compute[73104]:     </system>
Aug 26 08:37:45 user nova-compute[73104]:   </sysinfo>
Aug 26 08:37:45 user nova-compute[73104]:   <os>
Aug 26 08:37:45 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:37:45 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:37:45 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:37:45 user nova-compute[73104]:   </os>
Aug 26 08:37:45 user nova-compute[73104]:   <features>
Aug 26 08:37:45 user nova-compute[73104]:     <acpi/>
Aug 26 08:37:45 user nova-compute[73104]:     <apic/>
Aug 26 08:37:45 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:37:45 user nova-compute[73104]:   </features>
Aug 26 08:37:45 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:37:45 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:37:45 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:37:45 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:37:45 user nova-compute[73104]:   </clock>
Aug 26 08:37:45 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:37:45 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:37:45 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:37:45 user nova-compute[73104]:   </cpu>
Aug 26 08:37:45 user nova-compute[73104]:   <devices>
Aug 26 08:37:45 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:37:45 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:37:45 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/b04e96c7-f098-4612-b0b8-92cf6fd58865/disk"/>
Aug 26 08:37:45 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:37:45 user nova-compute[73104]:     </disk>
Aug 26 08:37:45 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:37:45 user nova-compute[73104]:       <mac address="fa:16:3e:23:5b:3a"/>
Aug 26 08:37:45 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:37:45 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:37:45 user nova-compute[73104]:       <target dev="tape589161d-f1"/>
Aug 26 08:37:45 user nova-compute[73104]:     </interface>
Aug 26 08:37:45 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:37:45 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/b04e96c7-f098-4612-b0b8-92cf6fd58865/console.log" append="off"/>
Aug 26 08:37:45 user nova-compute[73104]:     </serial>
Aug 26 08:37:45 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:37:45 user nova-compute[73104]:     <video>
Aug 26 08:37:45 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:37:45 user nova-compute[73104]:     </video>
Aug 26 08:37:45 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:37:45 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:37:45 user nova-compute[73104]:     </rng>
Aug 26 08:37:45 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:37:45 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:37:45 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:37:45 user nova-compute[73104]:     </memballoon>
Aug 26 08:37:45 user nova-compute[73104]:   </devices>
Aug 26 08:37:45 user nova-compute[73104]: </domain>
Aug 26 08:37:45 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:37:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1761440256',display_name='tempest-VolumesAssistedSnapshotsTest-server-1761440256',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1761440256',id=8,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOunchFb13bRhOM3jQW2UQnMPxvfTmt5AvnDaDPkitb77PHOy9GVGHdVESbzkwrvoMDNaPR1YdSZ+Aj2rN6g9lO4zYI9yIxcZlnqQNgPQKSjM6qdJJMLpbn/Q09h/CCCdA==',key_name='tempest-keypair-1246782866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='251199a8e75247e897551cb5bc1aec00',ramdisk_id='',reservation_id='r-gpwmnq8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-215182459',owner_user_name='tempest-VolumesAssistedSnapshotsTest-215182459-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:37:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df5ec3ef2c5e45698ed648547430fa29',uuid=b04e96c7-f098-4612-b0b8-92cf6fd58865,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e589161d-f15a-4143-8dcc-445bb29fbdff", "address": "fa:16:3e:23:5b:3a", "network": {"id": "6e5e1144-fa42-42e5-83e5-82d1825ede71", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-135318777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "251199a8e75247e897551cb5bc1aec00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape589161d-f1", "ovs_interfaceid": "e589161d-f15a-4143-8dcc-445bb29fbdff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Converting VIF {"id": "e589161d-f15a-4143-8dcc-445bb29fbdff", "address": "fa:16:3e:23:5b:3a", "network": {"id": "6e5e1144-fa42-42e5-83e5-82d1825ede71", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-135318777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "251199a8e75247e897551cb5bc1aec00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape589161d-f1", "ovs_interfaceid": "e589161d-f15a-4143-8dcc-445bb29fbdff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:5b:3a,bridge_name='br-int',has_traffic_filtering=True,id=e589161d-f15a-4143-8dcc-445bb29fbdff,network=Network(6e5e1144-fa42-42e5-83e5-82d1825ede71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape589161d-f1') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG os_vif [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:5b:3a,bridge_name='br-int',has_traffic_filtering=True,id=e589161d-f15a-4143-8dcc-445bb29fbdff,network=Network(6e5e1144-fa42-42e5-83e5-82d1825ede71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape589161d-f1') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape589161d-f1, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape589161d-f1, col_values=(('external_ids', {'iface-id': 'e589161d-f15a-4143-8dcc-445bb29fbdff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:5b:3a', 'vm-uuid': 'b04e96c7-f098-4612-b0b8-92cf6fd58865'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:45 user nova-compute[73104]: INFO os_vif [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:5b:3a,bridge_name='br-int',has_traffic_filtering=True,id=e589161d-f15a-4143-8dcc-445bb29fbdff,network=Network(6e5e1144-fa42-42e5-83e5-82d1825ede71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape589161d-f1')
Aug 26 08:37:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] No VIF found with MAC fa:16:3e:23:5b:3a, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe2c15e-4e27-47f3-8b0b-426f4b8619d1/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG nova.network.neutron [req-b6ffff27-ad77-4dd5-a68e-552249648bd4 req-b37ff3e8-7c85-43ed-bc16-34accc105a8e service nova] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Updated VIF entry in instance network info cache for port e589161d-f15a-4143-8dcc-445bb29fbdff. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG nova.network.neutron [req-b6ffff27-ad77-4dd5-a68e-552249648bd4 req-b37ff3e8-7c85-43ed-bc16-34accc105a8e service nova] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Updating instance_info_cache with network_info: [{"id": "e589161d-f15a-4143-8dcc-445bb29fbdff", "address": "fa:16:3e:23:5b:3a", "network": {"id": "6e5e1144-fa42-42e5-83e5-82d1825ede71", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-135318777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "251199a8e75247e897551cb5bc1aec00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape589161d-f1", "ovs_interfaceid": "e589161d-f15a-4143-8dcc-445bb29fbdff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b6ffff27-ad77-4dd5-a68e-552249648bd4 req-b37ff3e8-7c85-43ed-bc16-34accc105a8e service nova] Releasing lock "refresh_cache-b04e96c7-f098-4612-b0b8-92cf6fd58865" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe2c15e-4e27-47f3-8b0b-426f4b8619d1/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe2c15e-4e27-47f3-8b0b-426f4b8619d1/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe2c15e-4e27-47f3-8b0b-426f4b8619d1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:45 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:37:46 user nova-compute[73104]: DEBUG nova.compute.manager [req-121e8394-e732-41cc-87cb-ab7143bd9aeb req-0d7621ea-9b5a-46e1-b4b8-8465a413ae57 service nova] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Received event network-vif-plugged-af8b0ae5-581c-4096-98de-4442fe942572 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:37:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-121e8394-e732-41cc-87cb-ab7143bd9aeb req-0d7621ea-9b5a-46e1-b4b8-8465a413ae57 service nova] Acquiring lock "93244bcd-34be-46f3-85e6-87bb5e69888d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-121e8394-e732-41cc-87cb-ab7143bd9aeb req-0d7621ea-9b5a-46e1-b4b8-8465a413ae57 service nova] Lock "93244bcd-34be-46f3-85e6-87bb5e69888d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-121e8394-e732-41cc-87cb-ab7143bd9aeb req-0d7621ea-9b5a-46e1-b4b8-8465a413ae57 service nova] Lock "93244bcd-34be-46f3-85e6-87bb5e69888d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:46 user nova-compute[73104]: DEBUG nova.compute.manager [req-121e8394-e732-41cc-87cb-ab7143bd9aeb req-0d7621ea-9b5a-46e1-b4b8-8465a413ae57 service nova] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] No waiting events found dispatching network-vif-plugged-af8b0ae5-581c-4096-98de-4442fe942572 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:37:46 user nova-compute[73104]: WARNING nova.compute.manager [req-121e8394-e732-41cc-87cb-ab7143bd9aeb req-0d7621ea-9b5a-46e1-b4b8-8465a413ae57 service nova] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Received unexpected event network-vif-plugged-af8b0ae5-581c-4096-98de-4442fe942572 for instance with vm_state active and task_state None.
Aug 26 08:37:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039069.255335, b04e96c7-f098-4612-b0b8-92cf6fd58865 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:37:49 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] VM Resumed (Lifecycle Event)
Aug 26 08:37:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-31862749-f3e6-4305-8123-f32166c0d320 req-bb077217-aa21-444c-94be-a83d3febe946 service nova] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Received event network-vif-plugged-e589161d-f15a-4143-8dcc-445bb29fbdff {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-31862749-f3e6-4305-8123-f32166c0d320 req-bb077217-aa21-444c-94be-a83d3febe946 service nova] Acquiring lock "b04e96c7-f098-4612-b0b8-92cf6fd58865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-31862749-f3e6-4305-8123-f32166c0d320 req-bb077217-aa21-444c-94be-a83d3febe946 service nova] Lock "b04e96c7-f098-4612-b0b8-92cf6fd58865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-31862749-f3e6-4305-8123-f32166c0d320 req-bb077217-aa21-444c-94be-a83d3febe946 service nova] Lock "b04e96c7-f098-4612-b0b8-92cf6fd58865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-31862749-f3e6-4305-8123-f32166c0d320 req-bb077217-aa21-444c-94be-a83d3febe946 service nova] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] No waiting events found dispatching network-vif-plugged-e589161d-f15a-4143-8dcc-445bb29fbdff {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:37:49 user nova-compute[73104]: WARNING nova.compute.manager [req-31862749-f3e6-4305-8123-f32166c0d320 req-bb077217-aa21-444c-94be-a83d3febe946 service nova] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Received unexpected event network-vif-plugged-e589161d-f15a-4143-8dcc-445bb29fbdff for instance with vm_state building and task_state spawning.
Aug 26 08:37:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-091f4230-e995-4af0-9970-5b39c7a62d32 req-880b03f4-40f8-4565-a1e5-b1c0a3f7e88d service nova] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Received event network-vif-plugged-af8b0ae5-581c-4096-98de-4442fe942572 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-091f4230-e995-4af0-9970-5b39c7a62d32 req-880b03f4-40f8-4565-a1e5-b1c0a3f7e88d service nova] Acquiring lock "93244bcd-34be-46f3-85e6-87bb5e69888d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-091f4230-e995-4af0-9970-5b39c7a62d32 req-880b03f4-40f8-4565-a1e5-b1c0a3f7e88d service nova] Lock "93244bcd-34be-46f3-85e6-87bb5e69888d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-091f4230-e995-4af0-9970-5b39c7a62d32 req-880b03f4-40f8-4565-a1e5-b1c0a3f7e88d service nova] Lock "93244bcd-34be-46f3-85e6-87bb5e69888d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-091f4230-e995-4af0-9970-5b39c7a62d32 req-880b03f4-40f8-4565-a1e5-b1c0a3f7e88d service nova] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] No waiting events found dispatching network-vif-plugged-af8b0ae5-581c-4096-98de-4442fe942572 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:37:49 user nova-compute[73104]: WARNING nova.compute.manager [req-091f4230-e995-4af0-9970-5b39c7a62d32 req-880b03f4-40f8-4565-a1e5-b1c0a3f7e88d service nova] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Received unexpected event network-vif-plugged-af8b0ae5-581c-4096-98de-4442fe942572 for instance with vm_state active and task_state None.
Aug 26 08:37:49 user nova-compute[73104]: DEBUG nova.compute.manager [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:37:49 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:37:49 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:37:49 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=7564MB free_disk=24.707096099853516GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:49 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Instance spawned successfully.
Aug 26 08:37:49 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:37:49 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:37:49 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039069.256877, b04e96c7-f098-4612-b0b8-92cf6fd58865 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:37:49 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] VM Started (Lifecycle Event)
Aug 26 08:37:49 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:37:49 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:37:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-660a0886-a74c-4787-bec8-6f2e1dc13452 req-d229bc68-8e1d-4f16-88a5-b58525f0cabf service nova] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Received event network-vif-plugged-e589161d-f15a-4143-8dcc-445bb29fbdff {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-660a0886-a74c-4787-bec8-6f2e1dc13452 req-d229bc68-8e1d-4f16-88a5-b58525f0cabf service nova] Acquiring lock "b04e96c7-f098-4612-b0b8-92cf6fd58865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-660a0886-a74c-4787-bec8-6f2e1dc13452 req-d229bc68-8e1d-4f16-88a5-b58525f0cabf service nova] Lock "b04e96c7-f098-4612-b0b8-92cf6fd58865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-660a0886-a74c-4787-bec8-6f2e1dc13452 req-d229bc68-8e1d-4f16-88a5-b58525f0cabf service nova] Lock "b04e96c7-f098-4612-b0b8-92cf6fd58865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-660a0886-a74c-4787-bec8-6f2e1dc13452 req-d229bc68-8e1d-4f16-88a5-b58525f0cabf service nova] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] No waiting events found dispatching network-vif-plugged-e589161d-f15a-4143-8dcc-445bb29fbdff {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:37:49 user nova-compute[73104]: WARNING nova.compute.manager [req-660a0886-a74c-4787-bec8-6f2e1dc13452 req-d229bc68-8e1d-4f16-88a5-b58525f0cabf service nova] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Received unexpected event network-vif-plugged-e589161d-f15a-4143-8dcc-445bb29fbdff for instance with vm_state building and task_state spawning.
Aug 26 08:37:49 user nova-compute[73104]: INFO nova.compute.manager [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Took 7.01 seconds to spawn the instance on the hypervisor.
Aug 26 08:37:49 user nova-compute[73104]: DEBUG nova.compute.manager [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:37:49 user nova-compute[73104]: INFO nova.compute.manager [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Took 7.99 seconds to build instance.
Aug 26 08:37:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-29594e28-8959-4b60-a09b-328bad18e6ed tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Lock "b04e96c7-f098-4612-b0b8-92cf6fd58865" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.090s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance dcec7631-b94f-4dbf-b85d-e8ad9c6396b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 995a2bd3-4c54-4217-ae9f-056353008547 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 94de2062-7017-44fe-8df0-0a3cd63d5498 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 13200b79-17a6-4c18-87da-653311946a04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 385c6d93-907d-42d7-9b43-479e6caf66f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance afe2c15e-4e27-47f3-8b0b-426f4b8619d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 93244bcd-34be-46f3-85e6-87bb5e69888d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance b04e96c7-f098-4612-b0b8-92cf6fd58865 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 08:37:49 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 08:37:50 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:50 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Refreshing inventories for resource provider 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 08:37:50 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Updating ProviderTree inventory for provider 8a2a2397-4d47-4524-8146-84db4225a812 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 08:37:50 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Updating inventory in ProviderTree for provider 8a2a2397-4d47-4524-8146-84db4225a812 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 08:37:50 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Refreshing aggregate associations for resource provider 8a2a2397-4d47-4524-8146-84db4225a812, aggregates: None {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 08:37:50 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Refreshing trait associations for resource provider 8a2a2397-4d47-4524-8146-84db4225a812, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 08:37:50 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:37:50 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:37:50 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 08:37:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.146s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:37:51 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:37:51 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:37:51 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:37:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:37:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Acquiring lock "85eea82a-c221-4661-9525-06a925b57e1c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:38:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "85eea82a-c221-4661-9525-06a925b57e1c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:38:15 user nova-compute[73104]: DEBUG nova.compute.manager [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:38:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:38:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:38:15 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:38:15 user nova-compute[73104]: INFO nova.compute.claims [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Claim successful on node user
Aug 26 08:38:16 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:38:16 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:38:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.692s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:38:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:38:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:38:16 user nova-compute[73104]: DEBUG nova.network.neutron [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:38:16 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:38:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:38:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:38:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:38:16 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Creating image(s)
Aug 26 08:38:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Acquiring lock "/opt/stack/data/nova/instances/85eea82a-c221-4661-9525-06a925b57e1c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:38:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "/opt/stack/data/nova/instances/85eea82a-c221-4661-9525-06a925b57e1c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:38:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "/opt/stack/data/nova/instances/85eea82a-c221-4661-9525-06a925b57e1c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:38:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:16 user nova-compute[73104]: DEBUG nova.policy [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aca885fd82294677abf751087bcfc5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cbb61cb896e4b3cbbdc04d82df1cea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:38:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.188s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:38:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:38:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.172s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/85eea82a-c221-4661-9525-06a925b57e1c/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/85eea82a-c221-4661-9525-06a925b57e1c/disk 1073741824" returned: 0 in 0.047s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:38:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.193s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:17 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85eea82a-c221-4661-9525-06a925b57e1c/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 08:38:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85eea82a-c221-4661-9525-06a925b57e1c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85eea82a-c221-4661-9525-06a925b57e1c/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:17 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Cannot resize image /opt/stack/data/nova/instances/85eea82a-c221-4661-9525-06a925b57e1c/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 08:38:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:38:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Ensure instance console log exists: /opt/stack/data/nova/instances/85eea82a-c221-4661-9525-06a925b57e1c/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:38:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:38:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:38:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:38:17 user nova-compute[73104]: DEBUG nova.network.neutron [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Successfully created port: 5ca70232-e7ad-4989-b581-3c9c5b983db8 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG nova.network.neutron [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Successfully updated port: 5ca70232-e7ad-4989-b581-3c9c5b983db8 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Acquiring lock "refresh_cache-85eea82a-c221-4661-9525-06a925b57e1c" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Acquired lock "refresh_cache-85eea82a-c221-4661-9525-06a925b57e1c" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG nova.network.neutron [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG nova.compute.manager [req-031f0c0b-d34a-4825-85a8-9aa57e171b1f req-47fc4eec-8b73-4859-b407-d112ca4d5ac7 service nova] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Received event network-changed-5ca70232-e7ad-4989-b581-3c9c5b983db8 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG nova.compute.manager [req-031f0c0b-d34a-4825-85a8-9aa57e171b1f req-47fc4eec-8b73-4859-b407-d112ca4d5ac7 service nova] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Refreshing instance network info cache due to event network-changed-5ca70232-e7ad-4989-b581-3c9c5b983db8. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-031f0c0b-d34a-4825-85a8-9aa57e171b1f req-47fc4eec-8b73-4859-b407-d112ca4d5ac7 service nova] Acquiring lock "refresh_cache-85eea82a-c221-4661-9525-06a925b57e1c" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG nova.network.neutron [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG nova.network.neutron [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Updating instance_info_cache with network_info: [{"id": "5ca70232-e7ad-4989-b581-3c9c5b983db8", "address": "fa:16:3e:8b:1d:d1", "network": {"id": "84dc5f73-5b46-4788-8e58-69d57f2f089f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-856831086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbb61cb896e4b3cbbdc04d82df1cea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ca70232-e7", "ovs_interfaceid": "5ca70232-e7ad-4989-b581-3c9c5b983db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Releasing lock "refresh_cache-85eea82a-c221-4661-9525-06a925b57e1c" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG nova.compute.manager [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Instance network_info: |[{"id": "5ca70232-e7ad-4989-b581-3c9c5b983db8", "address": "fa:16:3e:8b:1d:d1", "network": {"id": "84dc5f73-5b46-4788-8e58-69d57f2f089f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-856831086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbb61cb896e4b3cbbdc04d82df1cea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ca70232-e7", "ovs_interfaceid": "5ca70232-e7ad-4989-b581-3c9c5b983db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-031f0c0b-d34a-4825-85a8-9aa57e171b1f req-47fc4eec-8b73-4859-b407-d112ca4d5ac7 service nova] Acquired lock "refresh_cache-85eea82a-c221-4661-9525-06a925b57e1c" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG nova.network.neutron [req-031f0c0b-d34a-4825-85a8-9aa57e171b1f req-47fc4eec-8b73-4859-b407-d112ca4d5ac7 service nova] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Refreshing network info cache for port 5ca70232-e7ad-4989-b581-3c9c5b983db8 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Start _get_guest_xml network_info=[{"id": "5ca70232-e7ad-4989-b581-3c9c5b983db8", "address": "fa:16:3e:8b:1d:d1", "network": {"id": "84dc5f73-5b46-4788-8e58-69d57f2f089f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-856831086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbb61cb896e4b3cbbdc04d82df1cea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ca70232-e7", "ovs_interfaceid": "5ca70232-e7ad-4989-b581-3c9c5b983db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:38:18 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:38:18 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:38:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:38:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2011165384',display_name='tempest-VolumesSnapshotTestJSON-instance-2011165384',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2011165384',id=9,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEnU6VxJrXTSCGsE4Tn2eKSkFawT9wsdxtiluvxLWQQolI+fGKFx0tNUohwrn59cwCUhjxQn8d4nrcJweioomRFLj00XWBPnp/gNEUHw7M/5Kn5aJi8rfV5m7f6C5GF6w==',key_name='tempest-keypair-740543947',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cbb61cb896e4b3cbbdc04d82df1cea9',ramdisk_id='',reservation_id='r-491urjj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1828823155',owner_user_name='tempest-VolumesSnapshotTestJSON-1828823155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:38:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aca885fd82294677abf751087bcfc5e1',uuid=85eea82a-c221-4661-9525-06a925b57e1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ca70232-e7ad-4989-b581-3c9c5b983db8", "address": "fa:16:3e:8b:1d:d1", "network": {"id": "84dc5f73-5b46-4788-8e58-69d57f2f089f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-856831086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbb61cb896e4b3cbbdc04d82df1cea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ca70232-e7", "ovs_interfaceid": "5ca70232-e7ad-4989-b581-3c9c5b983db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Converting VIF {"id": "5ca70232-e7ad-4989-b581-3c9c5b983db8", "address": "fa:16:3e:8b:1d:d1", "network": {"id": "84dc5f73-5b46-4788-8e58-69d57f2f089f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-856831086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbb61cb896e4b3cbbdc04d82df1cea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ca70232-e7", "ovs_interfaceid": "5ca70232-e7ad-4989-b581-3c9c5b983db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:1d:d1,bridge_name='br-int',has_traffic_filtering=True,id=5ca70232-e7ad-4989-b581-3c9c5b983db8,network=Network(84dc5f73-5b46-4788-8e58-69d57f2f089f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ca70232-e7') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG nova.objects.instance [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lazy-loading 'pci_devices' on Instance uuid 85eea82a-c221-4661-9525-06a925b57e1c {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:38:18 user nova-compute[73104]:   <uuid>85eea82a-c221-4661-9525-06a925b57e1c</uuid>
Aug 26 08:38:18 user nova-compute[73104]:   <name>instance-00000009</name>
Aug 26 08:38:18 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:38:18 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:38:18 user nova-compute[73104]:   <metadata>
Aug 26 08:38:18 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:38:18 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:38:18 user nova-compute[73104]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2011165384</nova:name>
Aug 26 08:38:18 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:38:18</nova:creationTime>
Aug 26 08:38:18 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:38:18 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:38:18 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:38:18 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:38:18 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:38:18 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:38:18 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:38:18 user nova-compute[73104]:       <nova:owner>
Aug 26 08:38:18 user nova-compute[73104]:         <nova:user uuid="aca885fd82294677abf751087bcfc5e1">tempest-VolumesSnapshotTestJSON-1828823155-project-member</nova:user>
Aug 26 08:38:18 user nova-compute[73104]:         <nova:project uuid="6cbb61cb896e4b3cbbdc04d82df1cea9">tempest-VolumesSnapshotTestJSON-1828823155</nova:project>
Aug 26 08:38:18 user nova-compute[73104]:       </nova:owner>
Aug 26 08:38:18 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:38:18 user nova-compute[73104]:       <nova:ports>
Aug 26 08:38:18 user nova-compute[73104]:         <nova:port uuid="5ca70232-e7ad-4989-b581-3c9c5b983db8">
Aug 26 08:38:18 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 08:38:18 user nova-compute[73104]:         </nova:port>
Aug 26 08:38:18 user nova-compute[73104]:       </nova:ports>
Aug 26 08:38:18 user nova-compute[73104]:     </nova:instance>
Aug 26 08:38:18 user nova-compute[73104]:   </metadata>
Aug 26 08:38:18 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:38:18 user nova-compute[73104]:     <system>
Aug 26 08:38:18 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:38:18 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:38:18 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:38:18 user nova-compute[73104]:       <entry name="serial">85eea82a-c221-4661-9525-06a925b57e1c</entry>
Aug 26 08:38:18 user nova-compute[73104]:       <entry name="uuid">85eea82a-c221-4661-9525-06a925b57e1c</entry>
Aug 26 08:38:18 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:38:18 user nova-compute[73104]:     </system>
Aug 26 08:38:18 user nova-compute[73104]:   </sysinfo>
Aug 26 08:38:18 user nova-compute[73104]:   <os>
Aug 26 08:38:18 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:38:18 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:38:18 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:38:18 user nova-compute[73104]:   </os>
Aug 26 08:38:18 user nova-compute[73104]:   <features>
Aug 26 08:38:18 user nova-compute[73104]:     <acpi/>
Aug 26 08:38:18 user nova-compute[73104]:     <apic/>
Aug 26 08:38:18 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:38:18 user nova-compute[73104]:   </features>
Aug 26 08:38:18 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:38:18 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:38:18 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:38:18 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:38:18 user nova-compute[73104]:   </clock>
Aug 26 08:38:18 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:38:18 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:38:18 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:38:18 user nova-compute[73104]:   </cpu>
Aug 26 08:38:18 user nova-compute[73104]:   <devices>
Aug 26 08:38:18 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:38:18 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:38:18 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/85eea82a-c221-4661-9525-06a925b57e1c/disk"/>
Aug 26 08:38:18 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:38:18 user nova-compute[73104]:     </disk>
Aug 26 08:38:18 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:38:18 user nova-compute[73104]:       <mac address="fa:16:3e:8b:1d:d1"/>
Aug 26 08:38:18 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:38:18 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:38:18 user nova-compute[73104]:       <target dev="tap5ca70232-e7"/>
Aug 26 08:38:18 user nova-compute[73104]:     </interface>
Aug 26 08:38:18 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:38:18 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/85eea82a-c221-4661-9525-06a925b57e1c/console.log" append="off"/>
Aug 26 08:38:18 user nova-compute[73104]:     </serial>
Aug 26 08:38:18 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:38:18 user nova-compute[73104]:     <video>
Aug 26 08:38:18 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:38:18 user nova-compute[73104]:     </video>
Aug 26 08:38:18 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:38:18 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:38:18 user nova-compute[73104]:     </rng>
Aug 26 08:38:18 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:38:18 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:38:18 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:38:18 user nova-compute[73104]:     </memballoon>
Aug 26 08:38:18 user nova-compute[73104]:   </devices>
Aug 26 08:38:18 user nova-compute[73104]: </domain>
Aug 26 08:38:18 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:38:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2011165384',display_name='tempest-VolumesSnapshotTestJSON-instance-2011165384',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2011165384',id=9,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEnU6VxJrXTSCGsE4Tn2eKSkFawT9wsdxtiluvxLWQQolI+fGKFx0tNUohwrn59cwCUhjxQn8d4nrcJweioomRFLj00XWBPnp/gNEUHw7M/5Kn5aJi8rfV5m7f6C5GF6w==',key_name='tempest-keypair-740543947',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cbb61cb896e4b3cbbdc04d82df1cea9',ramdisk_id='',reservation_id='r-491urjj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1828823155',owner_user_name='tempest-VolumesSnapshotTestJSON-1828823155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:38:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aca885fd82294677abf751087bcfc5e1',uuid=85eea82a-c221-4661-9525-06a925b57e1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ca70232-e7ad-4989-b581-3c9c5b983db8", "address": "fa:16:3e:8b:1d:d1", "network": {"id": "84dc5f73-5b46-4788-8e58-69d57f2f089f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-856831086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbb61cb896e4b3cbbdc04d82df1cea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ca70232-e7", "ovs_interfaceid": "5ca70232-e7ad-4989-b581-3c9c5b983db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Converting VIF {"id": "5ca70232-e7ad-4989-b581-3c9c5b983db8", "address": "fa:16:3e:8b:1d:d1", "network": {"id": "84dc5f73-5b46-4788-8e58-69d57f2f089f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-856831086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbb61cb896e4b3cbbdc04d82df1cea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ca70232-e7", "ovs_interfaceid": "5ca70232-e7ad-4989-b581-3c9c5b983db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:1d:d1,bridge_name='br-int',has_traffic_filtering=True,id=5ca70232-e7ad-4989-b581-3c9c5b983db8,network=Network(84dc5f73-5b46-4788-8e58-69d57f2f089f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ca70232-e7') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG os_vif [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:1d:d1,bridge_name='br-int',has_traffic_filtering=True,id=5ca70232-e7ad-4989-b581-3c9c5b983db8,network=Network(84dc5f73-5b46-4788-8e58-69d57f2f089f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ca70232-e7') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ca70232-e7, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5ca70232-e7, col_values=(('external_ids', {'iface-id': '5ca70232-e7ad-4989-b581-3c9c5b983db8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:1d:d1', 'vm-uuid': '85eea82a-c221-4661-9525-06a925b57e1c'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:38:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:18 user nova-compute[73104]: INFO os_vif [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:1d:d1,bridge_name='br-int',has_traffic_filtering=True,id=5ca70232-e7ad-4989-b581-3c9c5b983db8,network=Network(84dc5f73-5b46-4788-8e58-69d57f2f089f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ca70232-e7')
Aug 26 08:38:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:38:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] No VIF found with MAC fa:16:3e:8b:1d:d1, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:38:19 user nova-compute[73104]: DEBUG nova.network.neutron [req-031f0c0b-d34a-4825-85a8-9aa57e171b1f req-47fc4eec-8b73-4859-b407-d112ca4d5ac7 service nova] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Updated VIF entry in instance network info cache for port 5ca70232-e7ad-4989-b581-3c9c5b983db8. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:38:19 user nova-compute[73104]: DEBUG nova.network.neutron [req-031f0c0b-d34a-4825-85a8-9aa57e171b1f req-47fc4eec-8b73-4859-b407-d112ca4d5ac7 service nova] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Updating instance_info_cache with network_info: [{"id": "5ca70232-e7ad-4989-b581-3c9c5b983db8", "address": "fa:16:3e:8b:1d:d1", "network": {"id": "84dc5f73-5b46-4788-8e58-69d57f2f089f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-856831086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbb61cb896e4b3cbbdc04d82df1cea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ca70232-e7", "ovs_interfaceid": "5ca70232-e7ad-4989-b581-3c9c5b983db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:38:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-031f0c0b-d34a-4825-85a8-9aa57e171b1f req-47fc4eec-8b73-4859-b407-d112ca4d5ac7 service nova] Releasing lock "refresh_cache-85eea82a-c221-4661-9525-06a925b57e1c" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:38:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:20 user nova-compute[73104]: DEBUG nova.compute.manager [req-339701da-71d7-4f9b-93ff-9c4aa951d2b3 req-cb70290f-9ecd-4040-bfab-ca979f202fc5 service nova] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Received event network-vif-plugged-5ca70232-e7ad-4989-b581-3c9c5b983db8 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:38:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-339701da-71d7-4f9b-93ff-9c4aa951d2b3 req-cb70290f-9ecd-4040-bfab-ca979f202fc5 service nova] Acquiring lock "85eea82a-c221-4661-9525-06a925b57e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:38:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-339701da-71d7-4f9b-93ff-9c4aa951d2b3 req-cb70290f-9ecd-4040-bfab-ca979f202fc5 service nova] Lock "85eea82a-c221-4661-9525-06a925b57e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:38:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-339701da-71d7-4f9b-93ff-9c4aa951d2b3 req-cb70290f-9ecd-4040-bfab-ca979f202fc5 service nova] Lock "85eea82a-c221-4661-9525-06a925b57e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:38:20 user nova-compute[73104]: DEBUG nova.compute.manager [req-339701da-71d7-4f9b-93ff-9c4aa951d2b3 req-cb70290f-9ecd-4040-bfab-ca979f202fc5 service nova] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] No waiting events found dispatching network-vif-plugged-5ca70232-e7ad-4989-b581-3c9c5b983db8 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:38:20 user nova-compute[73104]: WARNING nova.compute.manager [req-339701da-71d7-4f9b-93ff-9c4aa951d2b3 req-cb70290f-9ecd-4040-bfab-ca979f202fc5 service nova] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Received unexpected event network-vif-plugged-5ca70232-e7ad-4989-b581-3c9c5b983db8 for instance with vm_state building and task_state spawning.
Aug 26 08:38:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:22 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039102.7980392, 85eea82a-c221-4661-9525-06a925b57e1c => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:38:22 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] VM Resumed (Lifecycle Event)
Aug 26 08:38:22 user nova-compute[73104]: DEBUG nova.compute.manager [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:38:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:38:22 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Instance spawned successfully.
Aug 26 08:38:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:38:22 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:38:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:38:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:38:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:38:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:38:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:38:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:38:22 user nova-compute[73104]: DEBUG nova.compute.manager [req-aa3e7702-6a0f-4ea6-83dd-594120edf4bc req-3ea44353-f1de-4a83-9f13-047865053d1c service nova] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Received event network-vif-plugged-5ca70232-e7ad-4989-b581-3c9c5b983db8 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:38:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-aa3e7702-6a0f-4ea6-83dd-594120edf4bc req-3ea44353-f1de-4a83-9f13-047865053d1c service nova] Acquiring lock "85eea82a-c221-4661-9525-06a925b57e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:38:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-aa3e7702-6a0f-4ea6-83dd-594120edf4bc req-3ea44353-f1de-4a83-9f13-047865053d1c service nova] Lock "85eea82a-c221-4661-9525-06a925b57e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:38:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-aa3e7702-6a0f-4ea6-83dd-594120edf4bc req-3ea44353-f1de-4a83-9f13-047865053d1c service nova] Lock "85eea82a-c221-4661-9525-06a925b57e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:38:22 user nova-compute[73104]: DEBUG nova.compute.manager [req-aa3e7702-6a0f-4ea6-83dd-594120edf4bc req-3ea44353-f1de-4a83-9f13-047865053d1c service nova] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] No waiting events found dispatching network-vif-plugged-5ca70232-e7ad-4989-b581-3c9c5b983db8 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:38:22 user nova-compute[73104]: WARNING nova.compute.manager [req-aa3e7702-6a0f-4ea6-83dd-594120edf4bc req-3ea44353-f1de-4a83-9f13-047865053d1c service nova] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Received unexpected event network-vif-plugged-5ca70232-e7ad-4989-b581-3c9c5b983db8 for instance with vm_state building and task_state spawning.
Aug 26 08:38:22 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:38:22 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:38:22 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039102.7994637, 85eea82a-c221-4661-9525-06a925b57e1c => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:38:22 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] VM Started (Lifecycle Event)
Aug 26 08:38:22 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:38:22 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:38:22 user nova-compute[73104]: INFO nova.compute.manager [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Took 6.33 seconds to spawn the instance on the hypervisor.
Aug 26 08:38:22 user nova-compute[73104]: DEBUG nova.compute.manager [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:38:22 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:38:23 user nova-compute[73104]: INFO nova.compute.manager [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Took 7.36 seconds to build instance.
Aug 26 08:38:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-416d2dd7-1fd5-43be-b8e5-5fd0a8e90d5b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "85eea82a-c221-4661-9525-06a925b57e1c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.470s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:38:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Acquiring lock "e2ec2788-98c7-48a7-933a-433dc215d7ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:38:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:38:25 user nova-compute[73104]: DEBUG nova.compute.manager [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:38:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:38:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:38:25 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:38:25 user nova-compute[73104]: INFO nova.compute.claims [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Claim successful on node user
Aug 26 08:38:26 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:38:26 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:38:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:38:26 user nova-compute[73104]: DEBUG nova.compute.manager [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:38:26 user nova-compute[73104]: DEBUG nova.compute.manager [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:38:26 user nova-compute[73104]: DEBUG nova.network.neutron [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:38:26 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:38:26 user nova-compute[73104]: DEBUG nova.compute.manager [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:38:26 user nova-compute[73104]: INFO nova.virt.block_device [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Booting with volume 99dfa21b-e82b-4526-ac24-50a4e0b66646 at /dev/vda
Aug 26 08:38:26 user nova-compute[73104]: DEBUG nova.policy [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a68183c66ce484aa46ec2a4d897dac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7989e8c5da415a9ccf66845b0d831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:38:26 user nova-compute[73104]: DEBUG os_brick.utils [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:38:26 user nova-compute[73104]: INFO oslo.privsep.daemon [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpgwfek6oe/privsep.sock']
Aug 26 08:38:26 user sudo[84260]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpgwfek6oe/privsep.sock
Aug 26 08:38:26 user sudo[84260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 26 08:38:27 user nova-compute[73104]: DEBUG nova.network.neutron [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Successfully created port: 949f6e6c-727e-440c-b767-caf76f3f037e {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:38:28 user nova-compute[73104]: DEBUG nova.network.neutron [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Successfully created port: 2bb400c7-1a44-427c-a38e-860f71f92d31 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:38:28 user nova-compute[73104]: DEBUG nova.network.neutron [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Successfully created port: 0cf8f75c-539b-44d0-bc4a-a52f86a24d9c {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:38:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:28 user sudo[84260]: pam_unix(sudo:session): session closed for user root
Aug 26 08:38:28 user nova-compute[73104]: INFO oslo.privsep.daemon [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Spawned new privsep daemon via rootwrap
Aug 26 08:38:28 user nova-compute[73104]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 08:38:28 user nova-compute[73104]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 08:38:28 user nova-compute[73104]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 26 08:38:28 user nova-compute[73104]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84263
Aug 26 08:38:28 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[38850c78-16c6-4c90-9e3b-88a6dcfe9d13]: (2,) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:38:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:29 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2dfcb8-6657-48ce-81cd-b4a3133455c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:38:29 user nova-compute[73104]: WARNING os_brick.initiator.connectors.nvmeof [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 26 08:38:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.042s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:29 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9177cefc-96c2-461a-b1af-caf017d9619f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:38:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:29 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[954a77b6-648d-4ba0-a465-8248dc40cf12]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:38:29 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae4805c-2747-44fa-be69-a2a052e8f046]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:38:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:38:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:38:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:38:29 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:38:29 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18a81f5-e4d8-42cb-b735-8a24ac969401]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:38:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:38:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:38:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:38:29 user nova-compute[73104]: DEBUG os_brick.utils [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] <== get_connector_properties: return (2515ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:38:29 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Updating existing volume attachment record: 8714ed9c-e459-4d38-8fc0-378bc09379ec {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 08:38:29 user nova-compute[73104]: DEBUG nova.network.neutron [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Successfully created port: 971207c4-aee3-47f6-8fb4-ad7d7fc2827e {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:38:30 user nova-compute[73104]: DEBUG nova.network.neutron [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Successfully created port: 1de67e88-3745-4d54-9b30-17d82513265f {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:38:31 user nova-compute[73104]: DEBUG nova.network.neutron [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Successfully updated port: 949f6e6c-727e-440c-b767-caf76f3f037e {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:38:31 user nova-compute[73104]: DEBUG nova.compute.manager [req-b389a772-0ac2-4412-b908-35fe133aca55 req-196dbf9b-ce1a-4749-8b99-98c43d860214 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-changed-949f6e6c-727e-440c-b767-caf76f3f037e {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:38:31 user nova-compute[73104]: DEBUG nova.compute.manager [req-b389a772-0ac2-4412-b908-35fe133aca55 req-196dbf9b-ce1a-4749-8b99-98c43d860214 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Refreshing instance network info cache due to event network-changed-949f6e6c-727e-440c-b767-caf76f3f037e. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:38:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b389a772-0ac2-4412-b908-35fe133aca55 req-196dbf9b-ce1a-4749-8b99-98c43d860214 service nova] Acquiring lock "refresh_cache-e2ec2788-98c7-48a7-933a-433dc215d7ec" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:38:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b389a772-0ac2-4412-b908-35fe133aca55 req-196dbf9b-ce1a-4749-8b99-98c43d860214 service nova] Acquired lock "refresh_cache-e2ec2788-98c7-48a7-933a-433dc215d7ec" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:38:31 user nova-compute[73104]: DEBUG nova.network.neutron [req-b389a772-0ac2-4412-b908-35fe133aca55 req-196dbf9b-ce1a-4749-8b99-98c43d860214 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Refreshing network info cache for port 949f6e6c-727e-440c-b767-caf76f3f037e {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:38:31 user nova-compute[73104]: DEBUG nova.network.neutron [req-b389a772-0ac2-4412-b908-35fe133aca55 req-196dbf9b-ce1a-4749-8b99-98c43d860214 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:38:32 user nova-compute[73104]: DEBUG nova.network.neutron [req-b389a772-0ac2-4412-b908-35fe133aca55 req-196dbf9b-ce1a-4749-8b99-98c43d860214 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:38:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b389a772-0ac2-4412-b908-35fe133aca55 req-196dbf9b-ce1a-4749-8b99-98c43d860214 service nova] Releasing lock "refresh_cache-e2ec2788-98c7-48a7-933a-433dc215d7ec" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:38:32 user nova-compute[73104]: DEBUG nova.network.neutron [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Successfully updated port: d7cb8b02-8579-43e0-b058-2cbe69bf0edf {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:38:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Acquiring lock "7170b5a8-12a7-4ddf-8089-fde172570fd1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:38:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:38:33 user nova-compute[73104]: DEBUG nova.compute.manager [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:38:33 user nova-compute[73104]: DEBUG nova.network.neutron [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Successfully updated port: 55fb8a61-3cfe-422c-af91-ca5199362cc7 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:38:33 user nova-compute[73104]: DEBUG nova.compute.manager [req-91216849-0ee0-463b-9e21-bfea65ef19ce req-9ffe07a3-1ebb-4683-8667-0862fbb52bf9 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-changed-d7cb8b02-8579-43e0-b058-2cbe69bf0edf {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:38:33 user nova-compute[73104]: DEBUG nova.compute.manager [req-91216849-0ee0-463b-9e21-bfea65ef19ce req-9ffe07a3-1ebb-4683-8667-0862fbb52bf9 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Refreshing instance network info cache due to event network-changed-d7cb8b02-8579-43e0-b058-2cbe69bf0edf. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:38:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-91216849-0ee0-463b-9e21-bfea65ef19ce req-9ffe07a3-1ebb-4683-8667-0862fbb52bf9 service nova] Acquiring lock "refresh_cache-e2ec2788-98c7-48a7-933a-433dc215d7ec" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:38:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-91216849-0ee0-463b-9e21-bfea65ef19ce req-9ffe07a3-1ebb-4683-8667-0862fbb52bf9 service nova] Acquired lock "refresh_cache-e2ec2788-98c7-48a7-933a-433dc215d7ec" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:38:33 user nova-compute[73104]: DEBUG nova.network.neutron [req-91216849-0ee0-463b-9e21-bfea65ef19ce req-9ffe07a3-1ebb-4683-8667-0862fbb52bf9 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Refreshing network info cache for port d7cb8b02-8579-43e0-b058-2cbe69bf0edf {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:38:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:38:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:38:33 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:38:33 user nova-compute[73104]: INFO nova.compute.claims [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Claim successful on node user
Aug 26 08:38:33 user nova-compute[73104]: DEBUG nova.network.neutron [req-91216849-0ee0-463b-9e21-bfea65ef19ce req-9ffe07a3-1ebb-4683-8667-0862fbb52bf9 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:38:33 user nova-compute[73104]: DEBUG nova.network.neutron [req-91216849-0ee0-463b-9e21-bfea65ef19ce req-9ffe07a3-1ebb-4683-8667-0862fbb52bf9 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:38:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-91216849-0ee0-463b-9e21-bfea65ef19ce req-9ffe07a3-1ebb-4683-8667-0862fbb52bf9 service nova] Releasing lock "refresh_cache-e2ec2788-98c7-48a7-933a-433dc215d7ec" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:38:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:38:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5008 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 08:38:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 08:38:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 08:38:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:34 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:38:34 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:38:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:38:34 user nova-compute[73104]: DEBUG nova.compute.manager [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:38:34 user nova-compute[73104]: DEBUG nova.compute.manager [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:38:34 user nova-compute[73104]: DEBUG nova.network.neutron [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:38:34 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:38:34 user nova-compute[73104]: DEBUG nova.compute.manager [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:38:34 user nova-compute[73104]: INFO nova.virt.block_device [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Booting with volume d6fd7c84-07ca-43be-9dc8-66cecc82ab75 at /dev/vda
Aug 26 08:38:34 user nova-compute[73104]: DEBUG os_brick.utils [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:38:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:34 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[47258aea-da8d-405d-af7d-cc0589727332]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:38:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:34 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abf9963-3189-49f8-b221-ee949af83887]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:38:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:34 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a83ce51-a26e-4ddd-91dd-1b7f0a1e8b9e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:38:34 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[60132845-0ab2-42a5-b21f-3605ecc5dac4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:38:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:38:34 user nova-compute[73104]: DEBUG nova.policy [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5592a07f52b84dc9aa87f20bc1b9f0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c658028a274117a30ecb831e50ddbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:38:34 user nova-compute[73104]: DEBUG nova.network.neutron [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Successfully updated port: 2bb400c7-1a44-427c-a38e-860f71f92d31 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:38:34 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:38:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:38:34 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:38:34 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbcb4da-285a-406c-98e7-e76ebc296176]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:38:34 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:38:34 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:38:34 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:38:34 user nova-compute[73104]: DEBUG os_brick.utils [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:38:34 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Updating existing volume attachment record: 7863b62e-e797-4c69-a56f-b100ef4e84ad {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 08:38:35 user nova-compute[73104]: DEBUG nova.network.neutron [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Successfully updated port: 0cf8f75c-539b-44d0-bc4a-a52f86a24d9c {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:38:35 user nova-compute[73104]: DEBUG nova.compute.manager [req-3e6255bb-1d52-4b8f-9fbd-917c69252d31 req-828304f1-dfb7-4cf6-9a98-3b9b3bd7cec3 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-changed-55fb8a61-3cfe-422c-af91-ca5199362cc7 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:38:35 user nova-compute[73104]: DEBUG nova.compute.manager [req-3e6255bb-1d52-4b8f-9fbd-917c69252d31 req-828304f1-dfb7-4cf6-9a98-3b9b3bd7cec3 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Refreshing instance network info cache due to event network-changed-55fb8a61-3cfe-422c-af91-ca5199362cc7. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:38:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3e6255bb-1d52-4b8f-9fbd-917c69252d31 req-828304f1-dfb7-4cf6-9a98-3b9b3bd7cec3 service nova] Acquiring lock "refresh_cache-e2ec2788-98c7-48a7-933a-433dc215d7ec" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:38:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3e6255bb-1d52-4b8f-9fbd-917c69252d31 req-828304f1-dfb7-4cf6-9a98-3b9b3bd7cec3 service nova] Acquired lock "refresh_cache-e2ec2788-98c7-48a7-933a-433dc215d7ec" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:38:35 user nova-compute[73104]: DEBUG nova.network.neutron [req-3e6255bb-1d52-4b8f-9fbd-917c69252d31 req-828304f1-dfb7-4cf6-9a98-3b9b3bd7cec3 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Refreshing network info cache for port 55fb8a61-3cfe-422c-af91-ca5199362cc7 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:38:35 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:35 user nova-compute[73104]: DEBUG nova.network.neutron [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Successfully created port: 4f31240a-f297-42c8-a9f5-65c64322c486 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:38:35 user nova-compute[73104]: DEBUG nova.network.neutron [req-3e6255bb-1d52-4b8f-9fbd-917c69252d31 req-828304f1-dfb7-4cf6-9a98-3b9b3bd7cec3 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:38:36 user nova-compute[73104]: DEBUG nova.network.neutron [req-3e6255bb-1d52-4b8f-9fbd-917c69252d31 req-828304f1-dfb7-4cf6-9a98-3b9b3bd7cec3 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:38:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3e6255bb-1d52-4b8f-9fbd-917c69252d31 req-828304f1-dfb7-4cf6-9a98-3b9b3bd7cec3 service nova] Releasing lock "refresh_cache-e2ec2788-98c7-48a7-933a-433dc215d7ec" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:38:36 user nova-compute[73104]: DEBUG nova.compute.manager [req-3e6255bb-1d52-4b8f-9fbd-917c69252d31 req-828304f1-dfb7-4cf6-9a98-3b9b3bd7cec3 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-changed-2bb400c7-1a44-427c-a38e-860f71f92d31 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:38:36 user nova-compute[73104]: DEBUG nova.compute.manager [req-3e6255bb-1d52-4b8f-9fbd-917c69252d31 req-828304f1-dfb7-4cf6-9a98-3b9b3bd7cec3 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Refreshing instance network info cache due to event network-changed-2bb400c7-1a44-427c-a38e-860f71f92d31. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:38:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3e6255bb-1d52-4b8f-9fbd-917c69252d31 req-828304f1-dfb7-4cf6-9a98-3b9b3bd7cec3 service nova] Acquiring lock "refresh_cache-e2ec2788-98c7-48a7-933a-433dc215d7ec" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:38:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3e6255bb-1d52-4b8f-9fbd-917c69252d31 req-828304f1-dfb7-4cf6-9a98-3b9b3bd7cec3 service nova] Acquired lock "refresh_cache-e2ec2788-98c7-48a7-933a-433dc215d7ec" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:38:36 user nova-compute[73104]: DEBUG nova.network.neutron [req-3e6255bb-1d52-4b8f-9fbd-917c69252d31 req-828304f1-dfb7-4cf6-9a98-3b9b3bd7cec3 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Refreshing network info cache for port 2bb400c7-1a44-427c-a38e-860f71f92d31 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:38:36 user nova-compute[73104]: DEBUG nova.network.neutron [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Successfully created port: 7c7615d3-d6db-4a04-884b-34ad12ed49ab {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:38:36 user nova-compute[73104]: DEBUG nova.network.neutron [req-3e6255bb-1d52-4b8f-9fbd-917c69252d31 req-828304f1-dfb7-4cf6-9a98-3b9b3bd7cec3 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:38:36 user nova-compute[73104]: DEBUG nova.network.neutron [req-3e6255bb-1d52-4b8f-9fbd-917c69252d31 req-828304f1-dfb7-4cf6-9a98-3b9b3bd7cec3 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:38:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3e6255bb-1d52-4b8f-9fbd-917c69252d31 req-828304f1-dfb7-4cf6-9a98-3b9b3bd7cec3 service nova] Releasing lock "refresh_cache-e2ec2788-98c7-48a7-933a-433dc215d7ec" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:38:36 user nova-compute[73104]: DEBUG nova.network.neutron [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Successfully updated port: 971207c4-aee3-47f6-8fb4-ad7d7fc2827e {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:38:36 user nova-compute[73104]: DEBUG nova.network.neutron [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Successfully created port: 8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:38:37 user nova-compute[73104]: DEBUG nova.compute.manager [req-1542d369-969f-40a4-913d-fae8fe322113 req-c51e7473-5e9c-4b0c-8765-53c5355c0de7 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-changed-0cf8f75c-539b-44d0-bc4a-a52f86a24d9c {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:38:37 user nova-compute[73104]: DEBUG nova.compute.manager [req-1542d369-969f-40a4-913d-fae8fe322113 req-c51e7473-5e9c-4b0c-8765-53c5355c0de7 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Refreshing instance network info cache due to event network-changed-0cf8f75c-539b-44d0-bc4a-a52f86a24d9c. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:38:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1542d369-969f-40a4-913d-fae8fe322113 req-c51e7473-5e9c-4b0c-8765-53c5355c0de7 service nova] Acquiring lock "refresh_cache-e2ec2788-98c7-48a7-933a-433dc215d7ec" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:38:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1542d369-969f-40a4-913d-fae8fe322113 req-c51e7473-5e9c-4b0c-8765-53c5355c0de7 service nova] Acquired lock "refresh_cache-e2ec2788-98c7-48a7-933a-433dc215d7ec" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:38:37 user nova-compute[73104]: DEBUG nova.network.neutron [req-1542d369-969f-40a4-913d-fae8fe322113 req-c51e7473-5e9c-4b0c-8765-53c5355c0de7 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Refreshing network info cache for port 0cf8f75c-539b-44d0-bc4a-a52f86a24d9c {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:38:37 user nova-compute[73104]: DEBUG nova.network.neutron [req-1542d369-969f-40a4-913d-fae8fe322113 req-c51e7473-5e9c-4b0c-8765-53c5355c0de7 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:38:37 user nova-compute[73104]: DEBUG nova.network.neutron [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Successfully created port: e77e909b-af87-4825-b30b-a7062763e3ea {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:38:37 user nova-compute[73104]: DEBUG nova.network.neutron [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Successfully updated port: 1de67e88-3745-4d54-9b30-17d82513265f {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:38:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Acquiring lock "refresh_cache-e2ec2788-98c7-48a7-933a-433dc215d7ec" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:38:37 user nova-compute[73104]: DEBUG nova.network.neutron [req-1542d369-969f-40a4-913d-fae8fe322113 req-c51e7473-5e9c-4b0c-8765-53c5355c0de7 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:38:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1542d369-969f-40a4-913d-fae8fe322113 req-c51e7473-5e9c-4b0c-8765-53c5355c0de7 service nova] Releasing lock "refresh_cache-e2ec2788-98c7-48a7-933a-433dc215d7ec" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:38:37 user nova-compute[73104]: DEBUG nova.compute.manager [req-1542d369-969f-40a4-913d-fae8fe322113 req-c51e7473-5e9c-4b0c-8765-53c5355c0de7 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-changed-971207c4-aee3-47f6-8fb4-ad7d7fc2827e {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:38:37 user nova-compute[73104]: DEBUG nova.compute.manager [req-1542d369-969f-40a4-913d-fae8fe322113 req-c51e7473-5e9c-4b0c-8765-53c5355c0de7 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Refreshing instance network info cache due to event network-changed-971207c4-aee3-47f6-8fb4-ad7d7fc2827e. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:38:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1542d369-969f-40a4-913d-fae8fe322113 req-c51e7473-5e9c-4b0c-8765-53c5355c0de7 service nova] Acquiring lock "refresh_cache-e2ec2788-98c7-48a7-933a-433dc215d7ec" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:38:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1542d369-969f-40a4-913d-fae8fe322113 req-c51e7473-5e9c-4b0c-8765-53c5355c0de7 service nova] Acquired lock "refresh_cache-e2ec2788-98c7-48a7-933a-433dc215d7ec" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:38:37 user nova-compute[73104]: DEBUG nova.network.neutron [req-1542d369-969f-40a4-913d-fae8fe322113 req-c51e7473-5e9c-4b0c-8765-53c5355c0de7 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Refreshing network info cache for port 971207c4-aee3-47f6-8fb4-ad7d7fc2827e {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:38:38 user nova-compute[73104]: DEBUG nova.network.neutron [req-1542d369-969f-40a4-913d-fae8fe322113 req-c51e7473-5e9c-4b0c-8765-53c5355c0de7 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:38:38 user nova-compute[73104]: DEBUG nova.network.neutron [req-1542d369-969f-40a4-913d-fae8fe322113 req-c51e7473-5e9c-4b0c-8765-53c5355c0de7 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:38:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1542d369-969f-40a4-913d-fae8fe322113 req-c51e7473-5e9c-4b0c-8765-53c5355c0de7 service nova] Releasing lock "refresh_cache-e2ec2788-98c7-48a7-933a-433dc215d7ec" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:38:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Acquired lock "refresh_cache-e2ec2788-98c7-48a7-933a-433dc215d7ec" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:38:38 user nova-compute[73104]: DEBUG nova.network.neutron [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:38:38 user nova-compute[73104]: DEBUG nova.network.neutron [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:38:38 user nova-compute[73104]: DEBUG nova.network.neutron [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Successfully created port: 7aabcef5-79f9-4f25-b095-ac587d15a460 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:38:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:39 user nova-compute[73104]: DEBUG nova.network.neutron [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Successfully updated port: 4f31240a-f297-42c8-a9f5-65c64322c486 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:38:39 user nova-compute[73104]: DEBUG nova.compute.manager [req-3b7e9c3d-314f-457e-8cad-68f6eccc07b3 req-d72854df-e44f-4ef9-abcf-0d123e6a17f4 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-changed-4f31240a-f297-42c8-a9f5-65c64322c486 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:38:39 user nova-compute[73104]: DEBUG nova.compute.manager [req-3b7e9c3d-314f-457e-8cad-68f6eccc07b3 req-d72854df-e44f-4ef9-abcf-0d123e6a17f4 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Refreshing instance network info cache due to event network-changed-4f31240a-f297-42c8-a9f5-65c64322c486. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:38:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3b7e9c3d-314f-457e-8cad-68f6eccc07b3 req-d72854df-e44f-4ef9-abcf-0d123e6a17f4 service nova] Acquiring lock "refresh_cache-7170b5a8-12a7-4ddf-8089-fde172570fd1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:38:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3b7e9c3d-314f-457e-8cad-68f6eccc07b3 req-d72854df-e44f-4ef9-abcf-0d123e6a17f4 service nova] Acquired lock "refresh_cache-7170b5a8-12a7-4ddf-8089-fde172570fd1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:38:39 user nova-compute[73104]: DEBUG nova.network.neutron [req-3b7e9c3d-314f-457e-8cad-68f6eccc07b3 req-d72854df-e44f-4ef9-abcf-0d123e6a17f4 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Refreshing network info cache for port 4f31240a-f297-42c8-a9f5-65c64322c486 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:38:39 user nova-compute[73104]: DEBUG nova.network.neutron [req-3b7e9c3d-314f-457e-8cad-68f6eccc07b3 req-d72854df-e44f-4ef9-abcf-0d123e6a17f4 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:38:39 user nova-compute[73104]: DEBUG nova.compute.manager [req-20370418-a1b5-4540-92ea-d09102778ca0 req-d8c9a8e6-a8c9-4fe8-8dae-338b7eccb6e8 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-changed-1de67e88-3745-4d54-9b30-17d82513265f {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:38:39 user nova-compute[73104]: DEBUG nova.compute.manager [req-20370418-a1b5-4540-92ea-d09102778ca0 req-d8c9a8e6-a8c9-4fe8-8dae-338b7eccb6e8 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Refreshing instance network info cache due to event network-changed-1de67e88-3745-4d54-9b30-17d82513265f. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:38:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-20370418-a1b5-4540-92ea-d09102778ca0 req-d8c9a8e6-a8c9-4fe8-8dae-338b7eccb6e8 service nova] Acquiring lock "refresh_cache-e2ec2788-98c7-48a7-933a-433dc215d7ec" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:38:39 user nova-compute[73104]: DEBUG nova.network.neutron [req-3b7e9c3d-314f-457e-8cad-68f6eccc07b3 req-d72854df-e44f-4ef9-abcf-0d123e6a17f4 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:38:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3b7e9c3d-314f-457e-8cad-68f6eccc07b3 req-d72854df-e44f-4ef9-abcf-0d123e6a17f4 service nova] Releasing lock "refresh_cache-7170b5a8-12a7-4ddf-8089-fde172570fd1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:38:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Acquiring lock "f22d4c05-720a-4dc7-afa0-ac823e70060a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:38:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lock "f22d4c05-720a-4dc7-afa0-ac823e70060a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:38:40 user nova-compute[73104]: DEBUG nova.compute.manager [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:38:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:38:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:38:40 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:38:40 user nova-compute[73104]: INFO nova.compute.claims [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Claim successful on node user
Aug 26 08:38:40 user nova-compute[73104]: DEBUG nova.network.neutron [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Successfully updated port: 8469badb-d912-4a8d-ba41-cf4a04664c73 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:38:40 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:38:40 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:38:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:38:40 user nova-compute[73104]: DEBUG nova.compute.manager [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:38:40 user nova-compute[73104]: DEBUG nova.network.neutron [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Updating instance_info_cache with network_info: [{"id": "949f6e6c-727e-440c-b767-caf76f3f037e", "address": "fa:16:3e:a4:00:26", "network": {"id": "0941b2d8-176a-403b-a9bf-4a4d0de5bcc0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-890813398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap949f6e6c-72", "ovs_interfaceid": "949f6e6c-727e-440c-b767-caf76f3f037e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d7cb8b02-8579-43e0-b058-2cbe69bf0edf", "address": "fa:16:3e:72:2b:2a", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cb8b02-85", "ovs_interfaceid": "d7cb8b02-8579-43e0-b058-2cbe69bf0edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "55fb8a61-3cfe-422c-af91-ca5199362cc7", "address": "fa:16:3e:04:77:77", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fb8a61-3c", "ovs_interfaceid": "55fb8a61-3cfe-422c-af91-ca5199362cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2bb400c7-1a44-427c-a38e-860f71f92d31", "address": "fa:16:3e:33:83:63", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb400c7-1a", "ovs_interfaceid": "2bb400c7-1a44-427c-a38e-860f71f92d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0cf8f75c-539b-44d0-bc4a-a52f86a24d9c", "address": "fa:16:3e:50:f5:ca", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf8f75c-53", "ovs_interfaceid": "0cf8f75c-539b-44d0-bc4a-a52f86a24d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "971207c4-aee3-47f6-8fb4-ad7d7fc2827e", "address": "fa:16:3e:13:5e:a9", "network": {"id": "b98d43ff-51d0-4328-be34-b7c110358c95", "bridge": "br-int", "label": "tempest-device-tagging-net2-545564459", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap971207c4-ae", "ovs_interfaceid": "971207c4-aee3-47f6-8fb4-ad7d7fc2827e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1de67e88-3745-4d54-9b30-17d82513265f", "address": "fa:16:3e:b3:77:f4", "network": {"id": "b98d43ff-51d0-4328-be34-b7c110358c95", "bridge": "br-int", "label": "tempest-device-tagging-net2-545564459", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de67e88-37", "ovs_interfaceid": "1de67e88-3745-4d54-9b30-17d82513265f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:38:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Releasing lock "refresh_cache-e2ec2788-98c7-48a7-933a-433dc215d7ec" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:38:40 user nova-compute[73104]: DEBUG nova.compute.manager [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Instance network_info: |[{"id": "949f6e6c-727e-440c-b767-caf76f3f037e", "address": "fa:16:3e:a4:00:26", "network": {"id": "0941b2d8-176a-403b-a9bf-4a4d0de5bcc0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-890813398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap949f6e6c-72", "ovs_interfaceid": "949f6e6c-727e-440c-b767-caf76f3f037e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d7cb8b02-8579-43e0-b058-2cbe69bf0edf", "address": "fa:16:3e:72:2b:2a", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cb8b02-85", "ovs_interfaceid": "d7cb8b02-8579-43e0-b058-2cbe69bf0edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "55fb8a61-3cfe-422c-af91-ca5199362cc7", "address": "fa:16:3e:04:77:77", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fb8a61-3c", "ovs_interfaceid": "55fb8a61-3cfe-422c-af91-ca5199362cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2bb400c7-1a44-427c-a38e-860f71f92d31", "address": "fa:16:3e:33:83:63", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb400c7-1a", "ovs_interfaceid": "2bb400c7-1a44-427c-a38e-860f71f92d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0cf8f75c-539b-44d0-bc4a-a52f86a24d9c", "address": "fa:16:3e:50:f5:ca", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf8f75c-53", "ovs_interfaceid": "0cf8f75c-539b-44d0-bc4a-a52f86a24d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "971207c4-aee3-47f6-8fb4-ad7d7fc2827e", "address": "fa:16:3e:13:5e:a9", "network": {"id": "b98d43ff-51d0-4328-be34-b7c110358c95", "bridge": "br-int", "label": "tempest-device-tagging-net2-545564459", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap971207c4-ae", "ovs_interfaceid": "971207c4-aee3-47f6-8fb4-ad7d7fc2827e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1de67e88-3745-4d54-9b30-17d82513265f", "address": "fa:16:3e:b3:77:f4", "network": {"id": "b98d43ff-51d0-4328-be34-b7c110358c95", "bridge": "br-int", "label": "tempest-device-tagging-net2-545564459", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de67e88-37", "ovs_interfaceid": "1de67e88-3745-4d54-9b30-17d82513265f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:38:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-20370418-a1b5-4540-92ea-d09102778ca0 req-d8c9a8e6-a8c9-4fe8-8dae-338b7eccb6e8 service nova] Acquired lock "refresh_cache-e2ec2788-98c7-48a7-933a-433dc215d7ec" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:38:40 user nova-compute[73104]: DEBUG nova.network.neutron [req-20370418-a1b5-4540-92ea-d09102778ca0 req-d8c9a8e6-a8c9-4fe8-8dae-338b7eccb6e8 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Refreshing network info cache for port 1de67e88-3745-4d54-9b30-17d82513265f {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:38:40 user nova-compute[73104]: DEBUG nova.compute.manager [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:38:40 user nova-compute[73104]: DEBUG nova.network.neutron [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:38:40 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:38:40 user nova-compute[73104]: DEBUG nova.compute.manager [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG nova.policy [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7ceab3a9cd7496fae6a08b9ea8cc513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0141c91ef45e4bf23a4b1cc4eb029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG nova.compute.manager [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:38:41 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Creating image(s)
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Acquiring lock "/opt/stack/data/nova/instances/f22d4c05-720a-4dc7-afa0-ac823e70060a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lock "/opt/stack/data/nova/instances/f22d4c05-720a-4dc7-afa0-ac823e70060a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lock "/opt/stack/data/nova/instances/f22d4c05-720a-4dc7-afa0-ac823e70060a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG nova.network.neutron [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Successfully updated port: 4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.199s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:41 user nova-compute[73104]: INFO nova.virt.block_device [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Booting with volume 311fdf7a-f6f3-413d-9f9b-a21e89f340dc at /dev/vdb
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-995a2bd3-4c54-4217-ae9f-056353008547" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-995a2bd3-4c54-4217-ae9f-056353008547" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG os_brick.utils [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a524d78b-fb8d-4a2a-b27d-bd8c860fb5de]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[09de926c-ec59-421c-9e43-3fe9dbc1062e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.193s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/f22d4c05-720a-4dc7-afa0-ac823e70060a/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cddea32-2586-46e2-9813-9953a00cf303]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG nova.compute.manager [req-3d15236c-8465-45f8-85a4-1c6d99bc65cd req-8d932015-3b55-473b-8713-b0ebd9d044ca service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-changed-8469badb-d912-4a8d-ba41-cf4a04664c73 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG nova.compute.manager [req-3d15236c-8465-45f8-85a4-1c6d99bc65cd req-8d932015-3b55-473b-8713-b0ebd9d044ca service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Refreshing instance network info cache due to event network-changed-8469badb-d912-4a8d-ba41-cf4a04664c73. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3d15236c-8465-45f8-85a4-1c6d99bc65cd req-8d932015-3b55-473b-8713-b0ebd9d044ca service nova] Acquiring lock "refresh_cache-7170b5a8-12a7-4ddf-8089-fde172570fd1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3d15236c-8465-45f8-85a4-1c6d99bc65cd req-8d932015-3b55-473b-8713-b0ebd9d044ca service nova] Acquired lock "refresh_cache-7170b5a8-12a7-4ddf-8089-fde172570fd1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG nova.network.neutron [req-3d15236c-8465-45f8-85a4-1c6d99bc65cd req-8d932015-3b55-473b-8713-b0ebd9d044ca service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Refreshing network info cache for port 8469badb-d912-4a8d-ba41-cf4a04664c73 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/f22d4c05-720a-4dc7-afa0-ac823e70060a/disk 1073741824" returned: 0 in 0.061s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[140b963a-2f55-441c-a581-ece544d49a63]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:38:41 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a519b2-c5ff-4007-9c48-164752783104]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG os_brick.utils [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] <== get_connector_properties: return (260ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Updating existing volume attachment record: 5c06c22c-5027-466d-b408-041a344cadb6 {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.210s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f22d4c05-720a-4dc7-afa0-ac823e70060a/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d4c05-720a-4dc7-afa0-ac823e70060a/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG nova.network.neutron [req-3d15236c-8465-45f8-85a4-1c6d99bc65cd req-8d932015-3b55-473b-8713-b0ebd9d044ca service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG nova.network.neutron [req-20370418-a1b5-4540-92ea-d09102778ca0 req-d8c9a8e6-a8c9-4fe8-8dae-338b7eccb6e8 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Updated VIF entry in instance network info cache for port 1de67e88-3745-4d54-9b30-17d82513265f. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG nova.network.neutron [req-20370418-a1b5-4540-92ea-d09102778ca0 req-d8c9a8e6-a8c9-4fe8-8dae-338b7eccb6e8 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Updating instance_info_cache with network_info: [{"id": "949f6e6c-727e-440c-b767-caf76f3f037e", "address": "fa:16:3e:a4:00:26", "network": {"id": "0941b2d8-176a-403b-a9bf-4a4d0de5bcc0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-890813398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap949f6e6c-72", "ovs_interfaceid": "949f6e6c-727e-440c-b767-caf76f3f037e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d7cb8b02-8579-43e0-b058-2cbe69bf0edf", "address": "fa:16:3e:72:2b:2a", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cb8b02-85", "ovs_interfaceid": "d7cb8b02-8579-43e0-b058-2cbe69bf0edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "55fb8a61-3cfe-422c-af91-ca5199362cc7", "address": "fa:16:3e:04:77:77", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fb8a61-3c", "ovs_interfaceid": "55fb8a61-3cfe-422c-af91-ca5199362cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2bb400c7-1a44-427c-a38e-860f71f92d31", "address": "fa:16:3e:33:83:63", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb400c7-1a", "ovs_interfaceid": "2bb400c7-1a44-427c-a38e-860f71f92d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0cf8f75c-539b-44d0-bc4a-a52f86a24d9c", "address": "fa:16:3e:50:f5:ca", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf8f75c-53", "ovs_interfaceid": "0cf8f75c-539b-44d0-bc4a-a52f86a24d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "971207c4-aee3-47f6-8fb4-ad7d7fc2827e", "address": "fa:16:3e:13:5e:a9", "network": {"id": "b98d43ff-51d0-4328-be34-b7c110358c95", "bridge": "br-int", "label": "tempest-device-tagging-net2-545564459", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap971207c4-ae", "ovs_interfaceid": "971207c4-aee3-47f6-8fb4-ad7d7fc2827e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1de67e88-3745-4d54-9b30-17d82513265f", "address": "fa:16:3e:b3:77:f4", "network": {"id": "b98d43ff-51d0-4328-be34-b7c110358c95", "bridge": "br-int", "label": "tempest-device-tagging-net2-545564459", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de67e88-37", "ovs_interfaceid": "1de67e88-3745-4d54-9b30-17d82513265f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-20370418-a1b5-4540-92ea-d09102778ca0 req-d8c9a8e6-a8c9-4fe8-8dae-338b7eccb6e8 service nova] Releasing lock "refresh_cache-e2ec2788-98c7-48a7-933a-433dc215d7ec" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG nova.network.neutron [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Successfully created port: efd472f1-aab1-4878-bed5-14054ce12ebd {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d4c05-720a-4dc7-afa0-ac823e70060a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Cannot resize image /opt/stack/data/nova/instances/f22d4c05-720a-4dc7-afa0-ac823e70060a/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Ensure instance console log exists: /opt/stack/data/nova/instances/f22d4c05-720a-4dc7-afa0-ac823e70060a/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:38:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:38:42 user nova-compute[73104]: DEBUG nova.network.neutron [req-3d15236c-8465-45f8-85a4-1c6d99bc65cd req-8d932015-3b55-473b-8713-b0ebd9d044ca service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:38:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3d15236c-8465-45f8-85a4-1c6d99bc65cd req-8d932015-3b55-473b-8713-b0ebd9d044ca service nova] Releasing lock "refresh_cache-7170b5a8-12a7-4ddf-8089-fde172570fd1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:38:42 user nova-compute[73104]: DEBUG nova.compute.manager [req-3d15236c-8465-45f8-85a4-1c6d99bc65cd req-8d932015-3b55-473b-8713-b0ebd9d044ca service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-changed-4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:38:42 user nova-compute[73104]: DEBUG nova.compute.manager [req-3d15236c-8465-45f8-85a4-1c6d99bc65cd req-8d932015-3b55-473b-8713-b0ebd9d044ca service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Refreshing instance network info cache due to event network-changed-4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:38:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3d15236c-8465-45f8-85a4-1c6d99bc65cd req-8d932015-3b55-473b-8713-b0ebd9d044ca service nova] Acquiring lock "refresh_cache-7170b5a8-12a7-4ddf-8089-fde172570fd1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:38:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3d15236c-8465-45f8-85a4-1c6d99bc65cd req-8d932015-3b55-473b-8713-b0ebd9d044ca service nova] Acquired lock "refresh_cache-7170b5a8-12a7-4ddf-8089-fde172570fd1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:38:42 user nova-compute[73104]: DEBUG nova.network.neutron [req-3d15236c-8465-45f8-85a4-1c6d99bc65cd req-8d932015-3b55-473b-8713-b0ebd9d044ca service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Refreshing network info cache for port 4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:38:42 user nova-compute[73104]: DEBUG nova.network.neutron [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Successfully updated port: 7c7615d3-d6db-4a04-884b-34ad12ed49ab {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:38:42 user nova-compute[73104]: DEBUG nova.compute.manager [req-d5710c7c-402e-40e7-bce6-a6faecca72f0 req-86140e2c-0f60-44dc-96e0-a94466dec211 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-changed-7c7615d3-d6db-4a04-884b-34ad12ed49ab {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:38:42 user nova-compute[73104]: DEBUG nova.compute.manager [req-d5710c7c-402e-40e7-bce6-a6faecca72f0 req-86140e2c-0f60-44dc-96e0-a94466dec211 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Refreshing instance network info cache due to event network-changed-7c7615d3-d6db-4a04-884b-34ad12ed49ab. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:38:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d5710c7c-402e-40e7-bce6-a6faecca72f0 req-86140e2c-0f60-44dc-96e0-a94466dec211 service nova] Acquiring lock "refresh_cache-7170b5a8-12a7-4ddf-8089-fde172570fd1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:38:42 user nova-compute[73104]: DEBUG nova.network.neutron [req-3d15236c-8465-45f8-85a4-1c6d99bc65cd req-8d932015-3b55-473b-8713-b0ebd9d044ca service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:38:42 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Updating instance_info_cache with network_info: [{"id": "911335fb-63d7-4381-ac34-a47bb61d2b7e", "address": "fa:16:3e:a3:26:d9", "network": {"id": "377250a7-e055-47b7-b42d-10b634024239", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-158207792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "723a18c60d10444189783f4d50d2e6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap911335fb-63", "ovs_interfaceid": "911335fb-63d7-4381-ac34-a47bb61d2b7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:38:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-995a2bd3-4c54-4217-ae9f-056353008547" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:38:42 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 08:38:42 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:38:42 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 08:38:42 user nova-compute[73104]: DEBUG nova.network.neutron [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Successfully updated port: efd472f1-aab1-4878-bed5-14054ce12ebd {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:38:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Acquiring lock "refresh_cache-f22d4c05-720a-4dc7-afa0-ac823e70060a" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:38:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Acquired lock "refresh_cache-f22d4c05-720a-4dc7-afa0-ac823e70060a" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:38:42 user nova-compute[73104]: DEBUG nova.network.neutron [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:38:42 user nova-compute[73104]: DEBUG nova.compute.manager [req-de5ffb18-179a-4fb0-9b0a-a6556cf4f7a4 req-1f3b0781-44a6-464c-882d-4bf67cb8f132 service nova] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Received event network-changed-efd472f1-aab1-4878-bed5-14054ce12ebd {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:38:42 user nova-compute[73104]: DEBUG nova.compute.manager [req-de5ffb18-179a-4fb0-9b0a-a6556cf4f7a4 req-1f3b0781-44a6-464c-882d-4bf67cb8f132 service nova] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Refreshing instance network info cache due to event network-changed-efd472f1-aab1-4878-bed5-14054ce12ebd. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:38:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-de5ffb18-179a-4fb0-9b0a-a6556cf4f7a4 req-1f3b0781-44a6-464c-882d-4bf67cb8f132 service nova] Acquiring lock "refresh_cache-f22d4c05-720a-4dc7-afa0-ac823e70060a" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:38:42 user nova-compute[73104]: DEBUG nova.network.neutron [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.network.neutron [req-3d15236c-8465-45f8-85a4-1c6d99bc65cd req-8d932015-3b55-473b-8713-b0ebd9d044ca service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3d15236c-8465-45f8-85a4-1c6d99bc65cd req-8d932015-3b55-473b-8713-b0ebd9d044ca service nova] Releasing lock "refresh_cache-7170b5a8-12a7-4ddf-8089-fde172570fd1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d5710c7c-402e-40e7-bce6-a6faecca72f0 req-86140e2c-0f60-44dc-96e0-a94466dec211 service nova] Acquired lock "refresh_cache-7170b5a8-12a7-4ddf-8089-fde172570fd1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.network.neutron [req-d5710c7c-402e-40e7-bce6-a6faecca72f0 req-86140e2c-0f60-44dc-96e0-a94466dec211 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Refreshing network info cache for port 7c7615d3-d6db-4a04-884b-34ad12ed49ab {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.network.neutron [req-d5710c7c-402e-40e7-bce6-a6faecca72f0 req-86140e2c-0f60-44dc-96e0-a94466dec211 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.network.neutron [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Updating instance_info_cache with network_info: [{"id": "efd472f1-aab1-4878-bed5-14054ce12ebd", "address": "fa:16:3e:c0:6c:81", "network": {"id": "c6ce9852-f528-4ac1-aa7a-be833ed25137", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2003310403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a0141c91ef45e4bf23a4b1cc4eb029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd472f1-aa", "ovs_interfaceid": "efd472f1-aab1-4878-bed5-14054ce12ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Releasing lock "refresh_cache-f22d4c05-720a-4dc7-afa0-ac823e70060a" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.compute.manager [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Instance network_info: |[{"id": "efd472f1-aab1-4878-bed5-14054ce12ebd", "address": "fa:16:3e:c0:6c:81", "network": {"id": "c6ce9852-f528-4ac1-aa7a-be833ed25137", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2003310403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a0141c91ef45e4bf23a4b1cc4eb029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd472f1-aa", "ovs_interfaceid": "efd472f1-aab1-4878-bed5-14054ce12ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-de5ffb18-179a-4fb0-9b0a-a6556cf4f7a4 req-1f3b0781-44a6-464c-882d-4bf67cb8f132 service nova] Acquired lock "refresh_cache-f22d4c05-720a-4dc7-afa0-ac823e70060a" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.network.neutron [req-de5ffb18-179a-4fb0-9b0a-a6556cf4f7a4 req-1f3b0781-44a6-464c-882d-4bf67cb8f132 service nova] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Refreshing network info cache for port efd472f1-aab1-4878-bed5-14054ce12ebd {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Start _get_guest_xml network_info=[{"id": "efd472f1-aab1-4878-bed5-14054ce12ebd", "address": "fa:16:3e:c0:6c:81", "network": {"id": "c6ce9852-f528-4ac1-aa7a-be833ed25137", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2003310403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a0141c91ef45e4bf23a4b1cc4eb029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd472f1-aa", "ovs_interfaceid": "efd472f1-aab1-4878-bed5-14054ce12ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:38:43 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:38:43 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:38:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-948443756',display_name='tempest-ServersNegativeTestJSON-server-948443756',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-948443756',id=12,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35a0141c91ef45e4bf23a4b1cc4eb029',ramdisk_id='',reservation_id='r-bzrbt9r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1313163796',owner_user_name='tempest-ServersNegativeTestJSON-1313163796-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:38:41Z,user_data=None,user_id='d7ceab3a9cd7496fae6a08b9ea8cc513',uuid=f22d4c05-720a-4dc7-afa0-ac823e70060a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efd472f1-aab1-4878-bed5-14054ce12ebd", "address": "fa:16:3e:c0:6c:81", "network": {"id": "c6ce9852-f528-4ac1-aa7a-be833ed25137", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2003310403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a0141c91ef45e4bf23a4b1cc4eb029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd472f1-aa", "ovs_interfaceid": "efd472f1-aab1-4878-bed5-14054ce12ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Converting VIF {"id": "efd472f1-aab1-4878-bed5-14054ce12ebd", "address": "fa:16:3e:c0:6c:81", "network": {"id": "c6ce9852-f528-4ac1-aa7a-be833ed25137", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2003310403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a0141c91ef45e4bf23a4b1cc4eb029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd472f1-aa", "ovs_interfaceid": "efd472f1-aab1-4878-bed5-14054ce12ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:6c:81,bridge_name='br-int',has_traffic_filtering=True,id=efd472f1-aab1-4878-bed5-14054ce12ebd,network=Network(c6ce9852-f528-4ac1-aa7a-be833ed25137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefd472f1-aa') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.objects.instance [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lazy-loading 'pci_devices' on Instance uuid f22d4c05-720a-4dc7-afa0-ac823e70060a {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.network.neutron [req-d5710c7c-402e-40e7-bce6-a6faecca72f0 req-86140e2c-0f60-44dc-96e0-a94466dec211 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:38:43 user nova-compute[73104]:   <uuid>f22d4c05-720a-4dc7-afa0-ac823e70060a</uuid>
Aug 26 08:38:43 user nova-compute[73104]:   <name>instance-0000000c</name>
Aug 26 08:38:43 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:38:43 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:38:43 user nova-compute[73104]:   <metadata>
Aug 26 08:38:43 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:38:43 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:38:43 user nova-compute[73104]:       <nova:name>tempest-ServersNegativeTestJSON-server-948443756</nova:name>
Aug 26 08:38:43 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:38:43</nova:creationTime>
Aug 26 08:38:43 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:38:43 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:38:43 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:38:43 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:38:43 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:38:43 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:38:43 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:38:43 user nova-compute[73104]:       <nova:owner>
Aug 26 08:38:43 user nova-compute[73104]:         <nova:user uuid="d7ceab3a9cd7496fae6a08b9ea8cc513">tempest-ServersNegativeTestJSON-1313163796-project-member</nova:user>
Aug 26 08:38:43 user nova-compute[73104]:         <nova:project uuid="35a0141c91ef45e4bf23a4b1cc4eb029">tempest-ServersNegativeTestJSON-1313163796</nova:project>
Aug 26 08:38:43 user nova-compute[73104]:       </nova:owner>
Aug 26 08:38:43 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:38:43 user nova-compute[73104]:       <nova:ports>
Aug 26 08:38:43 user nova-compute[73104]:         <nova:port uuid="efd472f1-aab1-4878-bed5-14054ce12ebd">
Aug 26 08:38:43 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 08:38:43 user nova-compute[73104]:         </nova:port>
Aug 26 08:38:43 user nova-compute[73104]:       </nova:ports>
Aug 26 08:38:43 user nova-compute[73104]:     </nova:instance>
Aug 26 08:38:43 user nova-compute[73104]:   </metadata>
Aug 26 08:38:43 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:38:43 user nova-compute[73104]:     <system>
Aug 26 08:38:43 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:38:43 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:38:43 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:38:43 user nova-compute[73104]:       <entry name="serial">f22d4c05-720a-4dc7-afa0-ac823e70060a</entry>
Aug 26 08:38:43 user nova-compute[73104]:       <entry name="uuid">f22d4c05-720a-4dc7-afa0-ac823e70060a</entry>
Aug 26 08:38:43 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:38:43 user nova-compute[73104]:     </system>
Aug 26 08:38:43 user nova-compute[73104]:   </sysinfo>
Aug 26 08:38:43 user nova-compute[73104]:   <os>
Aug 26 08:38:43 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:38:43 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:38:43 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:38:43 user nova-compute[73104]:   </os>
Aug 26 08:38:43 user nova-compute[73104]:   <features>
Aug 26 08:38:43 user nova-compute[73104]:     <acpi/>
Aug 26 08:38:43 user nova-compute[73104]:     <apic/>
Aug 26 08:38:43 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:38:43 user nova-compute[73104]:   </features>
Aug 26 08:38:43 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:38:43 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:38:43 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:38:43 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:38:43 user nova-compute[73104]:   </clock>
Aug 26 08:38:43 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:38:43 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:38:43 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:38:43 user nova-compute[73104]:   </cpu>
Aug 26 08:38:43 user nova-compute[73104]:   <devices>
Aug 26 08:38:43 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:38:43 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:38:43 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/f22d4c05-720a-4dc7-afa0-ac823e70060a/disk"/>
Aug 26 08:38:43 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:38:43 user nova-compute[73104]:     </disk>
Aug 26 08:38:43 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:38:43 user nova-compute[73104]:       <mac address="fa:16:3e:c0:6c:81"/>
Aug 26 08:38:43 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:38:43 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:38:43 user nova-compute[73104]:       <target dev="tapefd472f1-aa"/>
Aug 26 08:38:43 user nova-compute[73104]:     </interface>
Aug 26 08:38:43 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:38:43 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/f22d4c05-720a-4dc7-afa0-ac823e70060a/console.log" append="off"/>
Aug 26 08:38:43 user nova-compute[73104]:     </serial>
Aug 26 08:38:43 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:38:43 user nova-compute[73104]:     <video>
Aug 26 08:38:43 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:38:43 user nova-compute[73104]:     </video>
Aug 26 08:38:43 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:38:43 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:38:43 user nova-compute[73104]:     </rng>
Aug 26 08:38:43 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:38:43 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:38:43 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:38:43 user nova-compute[73104]:     </memballoon>
Aug 26 08:38:43 user nova-compute[73104]:   </devices>
Aug 26 08:38:43 user nova-compute[73104]: </domain>
Aug 26 08:38:43 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:38:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-948443756',display_name='tempest-ServersNegativeTestJSON-server-948443756',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-948443756',id=12,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35a0141c91ef45e4bf23a4b1cc4eb029',ramdisk_id='',reservation_id='r-bzrbt9r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1313163796',owner_user_name='tempest-ServersNegativeTestJSON-1313163796-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:38:41Z,user_data=None,user_id='d7ceab3a9cd7496fae6a08b9ea8cc513',uuid=f22d4c05-720a-4dc7-afa0-ac823e70060a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efd472f1-aab1-4878-bed5-14054ce12ebd", "address": "fa:16:3e:c0:6c:81", "network": {"id": "c6ce9852-f528-4ac1-aa7a-be833ed25137", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2003310403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a0141c91ef45e4bf23a4b1cc4eb029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd472f1-aa", "ovs_interfaceid": "efd472f1-aab1-4878-bed5-14054ce12ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Converting VIF {"id": "efd472f1-aab1-4878-bed5-14054ce12ebd", "address": "fa:16:3e:c0:6c:81", "network": {"id": "c6ce9852-f528-4ac1-aa7a-be833ed25137", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2003310403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a0141c91ef45e4bf23a4b1cc4eb029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd472f1-aa", "ovs_interfaceid": "efd472f1-aab1-4878-bed5-14054ce12ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:6c:81,bridge_name='br-int',has_traffic_filtering=True,id=efd472f1-aab1-4878-bed5-14054ce12ebd,network=Network(c6ce9852-f528-4ac1-aa7a-be833ed25137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefd472f1-aa') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG os_vif [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:6c:81,bridge_name='br-int',has_traffic_filtering=True,id=efd472f1-aab1-4878-bed5-14054ce12ebd,network=Network(c6ce9852-f528-4ac1-aa7a-be833ed25137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefd472f1-aa') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d5710c7c-402e-40e7-bce6-a6faecca72f0 req-86140e2c-0f60-44dc-96e0-a94466dec211 service nova] Releasing lock "refresh_cache-7170b5a8-12a7-4ddf-8089-fde172570fd1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapefd472f1-aa, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapefd472f1-aa, col_values=(('external_ids', {'iface-id': 'efd472f1-aab1-4878-bed5-14054ce12ebd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:6c:81', 'vm-uuid': 'f22d4c05-720a-4dc7-afa0-ac823e70060a'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.network.neutron [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Successfully updated port: 8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:43 user nova-compute[73104]: INFO os_vif [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:6c:81,bridge_name='br-int',has_traffic_filtering=True,id=efd472f1-aab1-4878-bed5-14054ce12ebd,network=Network(c6ce9852-f528-4ac1-aa7a-be833ed25137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefd472f1-aa')
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] No VIF found with MAC fa:16:3e:c0:6c:81, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.network.neutron [req-de5ffb18-179a-4fb0-9b0a-a6556cf4f7a4 req-1f3b0781-44a6-464c-882d-4bf67cb8f132 service nova] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Updated VIF entry in instance network info cache for port efd472f1-aab1-4878-bed5-14054ce12ebd. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG nova.network.neutron [req-de5ffb18-179a-4fb0-9b0a-a6556cf4f7a4 req-1f3b0781-44a6-464c-882d-4bf67cb8f132 service nova] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Updating instance_info_cache with network_info: [{"id": "efd472f1-aab1-4878-bed5-14054ce12ebd", "address": "fa:16:3e:c0:6c:81", "network": {"id": "c6ce9852-f528-4ac1-aa7a-be833ed25137", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2003310403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a0141c91ef45e4bf23a4b1cc4eb029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd472f1-aa", "ovs_interfaceid": "efd472f1-aab1-4878-bed5-14054ce12ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:38:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-de5ffb18-179a-4fb0-9b0a-a6556cf4f7a4 req-1f3b0781-44a6-464c-882d-4bf67cb8f132 service nova] Releasing lock "refresh_cache-f22d4c05-720a-4dc7-afa0-ac823e70060a" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:38:44 user nova-compute[73104]: DEBUG nova.network.neutron [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Successfully updated port: e77e909b-af87-4825-b30b-a7062763e3ea {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:38:44 user nova-compute[73104]: DEBUG nova.compute.manager [req-564c24c3-9f7a-4c2d-b736-8dd2b2da43b6 req-b7ce6c53-aa1d-40bd-b05c-7973fd208bc0 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-changed-8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:38:44 user nova-compute[73104]: DEBUG nova.compute.manager [req-564c24c3-9f7a-4c2d-b736-8dd2b2da43b6 req-b7ce6c53-aa1d-40bd-b05c-7973fd208bc0 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Refreshing instance network info cache due to event network-changed-8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:38:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-564c24c3-9f7a-4c2d-b736-8dd2b2da43b6 req-b7ce6c53-aa1d-40bd-b05c-7973fd208bc0 service nova] Acquiring lock "refresh_cache-7170b5a8-12a7-4ddf-8089-fde172570fd1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:38:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-564c24c3-9f7a-4c2d-b736-8dd2b2da43b6 req-b7ce6c53-aa1d-40bd-b05c-7973fd208bc0 service nova] Acquired lock "refresh_cache-7170b5a8-12a7-4ddf-8089-fde172570fd1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:38:44 user nova-compute[73104]: DEBUG nova.network.neutron [req-564c24c3-9f7a-4c2d-b736-8dd2b2da43b6 req-b7ce6c53-aa1d-40bd-b05c-7973fd208bc0 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Refreshing network info cache for port 8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:38:44 user nova-compute[73104]: DEBUG nova.network.neutron [req-564c24c3-9f7a-4c2d-b736-8dd2b2da43b6 req-b7ce6c53-aa1d-40bd-b05c-7973fd208bc0 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:38:44 user nova-compute[73104]: DEBUG nova.network.neutron [req-564c24c3-9f7a-4c2d-b736-8dd2b2da43b6 req-b7ce6c53-aa1d-40bd-b05c-7973fd208bc0 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:38:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-564c24c3-9f7a-4c2d-b736-8dd2b2da43b6 req-b7ce6c53-aa1d-40bd-b05c-7973fd208bc0 service nova] Releasing lock "refresh_cache-7170b5a8-12a7-4ddf-8089-fde172570fd1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:38:44 user nova-compute[73104]: DEBUG nova.compute.manager [req-564c24c3-9f7a-4c2d-b736-8dd2b2da43b6 req-b7ce6c53-aa1d-40bd-b05c-7973fd208bc0 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-changed-e77e909b-af87-4825-b30b-a7062763e3ea {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:38:44 user nova-compute[73104]: DEBUG nova.compute.manager [req-564c24c3-9f7a-4c2d-b736-8dd2b2da43b6 req-b7ce6c53-aa1d-40bd-b05c-7973fd208bc0 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Refreshing instance network info cache due to event network-changed-e77e909b-af87-4825-b30b-a7062763e3ea. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:38:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-564c24c3-9f7a-4c2d-b736-8dd2b2da43b6 req-b7ce6c53-aa1d-40bd-b05c-7973fd208bc0 service nova] Acquiring lock "refresh_cache-7170b5a8-12a7-4ddf-8089-fde172570fd1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:38:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-564c24c3-9f7a-4c2d-b736-8dd2b2da43b6 req-b7ce6c53-aa1d-40bd-b05c-7973fd208bc0 service nova] Acquired lock "refresh_cache-7170b5a8-12a7-4ddf-8089-fde172570fd1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:38:44 user nova-compute[73104]: DEBUG nova.network.neutron [req-564c24c3-9f7a-4c2d-b736-8dd2b2da43b6 req-b7ce6c53-aa1d-40bd-b05c-7973fd208bc0 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Refreshing network info cache for port e77e909b-af87-4825-b30b-a7062763e3ea {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:38:44 user nova-compute[73104]: DEBUG nova.network.neutron [req-564c24c3-9f7a-4c2d-b736-8dd2b2da43b6 req-b7ce6c53-aa1d-40bd-b05c-7973fd208bc0 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:38:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:45 user nova-compute[73104]: DEBUG nova.network.neutron [req-564c24c3-9f7a-4c2d-b736-8dd2b2da43b6 req-b7ce6c53-aa1d-40bd-b05c-7973fd208bc0 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:38:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-564c24c3-9f7a-4c2d-b736-8dd2b2da43b6 req-b7ce6c53-aa1d-40bd-b05c-7973fd208bc0 service nova] Releasing lock "refresh_cache-7170b5a8-12a7-4ddf-8089-fde172570fd1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:38:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:45 user nova-compute[73104]: DEBUG nova.network.neutron [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Successfully updated port: 7aabcef5-79f9-4f25-b095-ac587d15a460 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:38:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Acquiring lock "refresh_cache-7170b5a8-12a7-4ddf-8089-fde172570fd1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:38:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Acquired lock "refresh_cache-7170b5a8-12a7-4ddf-8089-fde172570fd1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:38:45 user nova-compute[73104]: DEBUG nova.network.neutron [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:38:45 user nova-compute[73104]: DEBUG nova.network.neutron [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:38:45 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe2c15e-4e27-47f3-8b0b-426f4b8619d1/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:45 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe2c15e-4e27-47f3-8b0b-426f4b8619d1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:45 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe2c15e-4e27-47f3-8b0b-426f4b8619d1/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:45 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe2c15e-4e27-47f3-8b0b-426f4b8619d1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:45 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85eea82a-c221-4661-9525-06a925b57e1c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85eea82a-c221-4661-9525-06a925b57e1c/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85eea82a-c221-4661-9525-06a925b57e1c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85eea82a-c221-4661-9525-06a925b57e1c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Acquiring lock "995a2bd3-4c54-4217-ae9f-056353008547" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:38:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Lock "995a2bd3-4c54-4217-ae9f-056353008547" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:38:46 user nova-compute[73104]: DEBUG nova.compute.manager [req-65727722-f4e6-4641-8dca-34142e7641f8 req-816c4362-7f9a-4e8e-988e-7ca048716572 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-changed-7aabcef5-79f9-4f25-b095-ac587d15a460 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:38:46 user nova-compute[73104]: DEBUG nova.compute.manager [req-65727722-f4e6-4641-8dca-34142e7641f8 req-816c4362-7f9a-4e8e-988e-7ca048716572 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Refreshing instance network info cache due to event network-changed-7aabcef5-79f9-4f25-b095-ac587d15a460. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:38:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-65727722-f4e6-4641-8dca-34142e7641f8 req-816c4362-7f9a-4e8e-988e-7ca048716572 service nova] Acquiring lock "refresh_cache-7170b5a8-12a7-4ddf-8089-fde172570fd1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:38:46 user nova-compute[73104]: DEBUG nova.objects.instance [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Lazy-loading 'flavor' on Instance uuid 995a2bd3-4c54-4217-ae9f-056353008547 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:38:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Lock "995a2bd3-4c54-4217-ae9f-056353008547" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.106s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:38:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Acquiring lock "995a2bd3-4c54-4217-ae9f-056353008547" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:38:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Lock "995a2bd3-4c54-4217-ae9f-056353008547" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:38:46 user nova-compute[73104]: INFO nova.compute.manager [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Attaching volume 01730192-0637-4609-a5da-60517dc35abc to /dev/vdb
Aug 26 08:38:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04e96c7-f098-4612-b0b8-92cf6fd58865/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG os_brick.utils [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039127.132851, f22d4c05-720a-4dc7-afa0-ac823e70060a => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:38:47 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] VM Resumed (Lifecycle Event)
Aug 26 08:38:47 user nova-compute[73104]: DEBUG nova.compute.manager [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7949ba64-0413-428e-9416-dbb21e4f4588]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:47 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Instance spawned successfully.
Aug 26 08:38:47 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd33520-6441-4cbb-afc0-a4e6debcad3b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe99a0d-0cbe-4708-b88f-920b789e184c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04e96c7-f098-4612-b0b8-92cf6fd58865/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04e96c7-f098-4612-b0b8-92cf6fd58865/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a393ff-707c-4843-87cf-3ddd99743f65]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:38:47 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:38:47 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039127.133386, f22d4c05-720a-4dc7-afa0-ac823e70060a => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:38:47 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] VM Started (Lifecycle Event)
Aug 26 08:38:47 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:38:47 user nova-compute[73104]: INFO nova.compute.manager [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Took 6.22 seconds to spawn the instance on the hypervisor.
Aug 26 08:38:47 user nova-compute[73104]: DEBUG nova.compute.manager [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:38:47 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:38:47 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5c4158-adb2-4cb6-b539-41ffa3b295f6]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG os_brick.utils [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] <== get_connector_properties: return (201ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Updating existing volume attachment record: e8d58dc6-1a30-4d32-92ae-9be2fb99e97a {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:38:47 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:38:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04e96c7-f098-4612-b0b8-92cf6fd58865/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:47 user nova-compute[73104]: INFO nova.compute.manager [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Took 7.16 seconds to build instance.
Aug 26 08:38:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b1d5a2a8-ba37-4691-a366-d1ca1f073011 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lock "f22d4c05-720a-4dc7-afa0-ac823e70060a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.292s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995a2bd3-4c54-4217-ae9f-056353008547/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995a2bd3-4c54-4217-ae9f-056353008547/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995a2bd3-4c54-4217-ae9f-056353008547/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:48 user nova-compute[73104]: DEBUG nova.network.neutron [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Updating instance_info_cache with network_info: [{"id": "4f31240a-f297-42c8-a9f5-65c64322c486", "address": "fa:16:3e:e4:82:c2", "network": {"id": "61837c4d-d9ee-4ec5-be90-336082e4264e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-701032687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f31240a-f2", "ovs_interfaceid": "4f31240a-f297-42c8-a9f5-65c64322c486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8469badb-d912-4a8d-ba41-cf4a04664c73", "address": "fa:16:3e:8c:2c:5b", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8469badb-d9", "ovs_interfaceid": "8469badb-d912-4a8d-ba41-cf4a04664c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b", "address": "fa:16:3e:f8:62:20", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa218cb-82", "ovs_interfaceid": "4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7c7615d3-d6db-4a04-884b-34ad12ed49ab", "address": "fa:16:3e:5b:13:e7", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7615d3-d6", "ovs_interfaceid": "7c7615d3-d6db-4a04-884b-34ad12ed49ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56", "address": "fa:16:3e:11:48:11", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9e4cb8-1b", "ovs_interfaceid": "8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e77e909b-af87-4825-b30b-a7062763e3ea", "address": "fa:16:3e:85:9b:36", "network": {"id": "4138826a-130b-48c0-b315-122e80d369ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680959749", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77e909b-af", "ovs_interfaceid": "e77e909b-af87-4825-b30b-a7062763e3ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7aabcef5-79f9-4f25-b095-ac587d15a460", "address": "fa:16:3e:e6:4e:9b", "network": {"id": "4138826a-130b-48c0-b315-122e80d369ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680959749", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aabcef5-79", "ovs_interfaceid": "7aabcef5-79f9-4f25-b095-ac587d15a460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:38:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Releasing lock "refresh_cache-7170b5a8-12a7-4ddf-8089-fde172570fd1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:38:48 user nova-compute[73104]: DEBUG nova.compute.manager [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Instance network_info: |[{"id": "4f31240a-f297-42c8-a9f5-65c64322c486", "address": "fa:16:3e:e4:82:c2", "network": {"id": "61837c4d-d9ee-4ec5-be90-336082e4264e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-701032687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f31240a-f2", "ovs_interfaceid": "4f31240a-f297-42c8-a9f5-65c64322c486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8469badb-d912-4a8d-ba41-cf4a04664c73", "address": "fa:16:3e:8c:2c:5b", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8469badb-d9", "ovs_interfaceid": "8469badb-d912-4a8d-ba41-cf4a04664c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b", "address": "fa:16:3e:f8:62:20", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa218cb-82", "ovs_interfaceid": "4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7c7615d3-d6db-4a04-884b-34ad12ed49ab", "address": "fa:16:3e:5b:13:e7", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7615d3-d6", "ovs_interfaceid": "7c7615d3-d6db-4a04-884b-34ad12ed49ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56", "address": "fa:16:3e:11:48:11", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9e4cb8-1b", "ovs_interfaceid": "8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e77e909b-af87-4825-b30b-a7062763e3ea", "address": "fa:16:3e:85:9b:36", "network": {"id": "4138826a-130b-48c0-b315-122e80d369ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680959749", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77e909b-af", "ovs_interfaceid": "e77e909b-af87-4825-b30b-a7062763e3ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7aabcef5-79f9-4f25-b095-ac587d15a460", "address": "fa:16:3e:e6:4e:9b", "network": {"id": "4138826a-130b-48c0-b315-122e80d369ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680959749", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aabcef5-79", "ovs_interfaceid": "7aabcef5-79f9-4f25-b095-ac587d15a460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:38:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-65727722-f4e6-4641-8dca-34142e7641f8 req-816c4362-7f9a-4e8e-988e-7ca048716572 service nova] Acquired lock "refresh_cache-7170b5a8-12a7-4ddf-8089-fde172570fd1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:38:48 user nova-compute[73104]: DEBUG nova.network.neutron [req-65727722-f4e6-4641-8dca-34142e7641f8 req-816c4362-7f9a-4e8e-988e-7ca048716572 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Refreshing network info cache for port 7aabcef5-79f9-4f25-b095-ac587d15a460 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:38:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995a2bd3-4c54-4217-ae9f-056353008547/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:48 user nova-compute[73104]: DEBUG nova.compute.manager [req-2af83f52-c206-4be9-a00a-d5a7e96c1e87 req-fef2090d-241e-4c25-8f5d-426bac69ac49 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Received event network-changed-4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:38:48 user nova-compute[73104]: DEBUG nova.compute.manager [req-2af83f52-c206-4be9-a00a-d5a7e96c1e87 req-fef2090d-241e-4c25-8f5d-426bac69ac49 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Refreshing instance network info cache due to event network-changed-4a3e387d-f638-43fc-bdef-4c0b608d29d4. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:38:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2af83f52-c206-4be9-a00a-d5a7e96c1e87 req-fef2090d-241e-4c25-8f5d-426bac69ac49 service nova] Acquiring lock "refresh_cache-94de2062-7017-44fe-8df0-0a3cd63d5498" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:38:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2af83f52-c206-4be9-a00a-d5a7e96c1e87 req-fef2090d-241e-4c25-8f5d-426bac69ac49 service nova] Acquired lock "refresh_cache-94de2062-7017-44fe-8df0-0a3cd63d5498" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:38:48 user nova-compute[73104]: DEBUG nova.network.neutron [req-2af83f52-c206-4be9-a00a-d5a7e96c1e87 req-fef2090d-241e-4c25-8f5d-426bac69ac49 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Refreshing network info cache for port 4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:38:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d4c05-720a-4dc7-afa0-ac823e70060a/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:49 user nova-compute[73104]: DEBUG nova.network.neutron [req-65727722-f4e6-4641-8dca-34142e7641f8 req-816c4362-7f9a-4e8e-988e-7ca048716572 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Updated VIF entry in instance network info cache for port 7aabcef5-79f9-4f25-b095-ac587d15a460. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:38:49 user nova-compute[73104]: DEBUG nova.network.neutron [req-65727722-f4e6-4641-8dca-34142e7641f8 req-816c4362-7f9a-4e8e-988e-7ca048716572 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Updating instance_info_cache with network_info: [{"id": "4f31240a-f297-42c8-a9f5-65c64322c486", "address": "fa:16:3e:e4:82:c2", "network": {"id": "61837c4d-d9ee-4ec5-be90-336082e4264e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-701032687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f31240a-f2", "ovs_interfaceid": "4f31240a-f297-42c8-a9f5-65c64322c486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8469badb-d912-4a8d-ba41-cf4a04664c73", "address": "fa:16:3e:8c:2c:5b", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8469badb-d9", "ovs_interfaceid": "8469badb-d912-4a8d-ba41-cf4a04664c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b", "address": "fa:16:3e:f8:62:20", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa218cb-82", "ovs_interfaceid": "4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7c7615d3-d6db-4a04-884b-34ad12ed49ab", "address": "fa:16:3e:5b:13:e7", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7615d3-d6", "ovs_interfaceid": "7c7615d3-d6db-4a04-884b-34ad12ed49ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56", "address": "fa:16:3e:11:48:11", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9e4cb8-1b", "ovs_interfaceid": "8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e77e909b-af87-4825-b30b-a7062763e3ea", "address": "fa:16:3e:85:9b:36", "network": {"id": "4138826a-130b-48c0-b315-122e80d369ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680959749", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77e909b-af", "ovs_interfaceid": "e77e909b-af87-4825-b30b-a7062763e3ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7aabcef5-79f9-4f25-b095-ac587d15a460", "address": "fa:16:3e:e6:4e:9b", "network": {"id": "4138826a-130b-48c0-b315-122e80d369ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680959749", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aabcef5-79", "ovs_interfaceid": "7aabcef5-79f9-4f25-b095-ac587d15a460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:38:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-65727722-f4e6-4641-8dca-34142e7641f8 req-816c4362-7f9a-4e8e-988e-7ca048716572 service nova] Releasing lock "refresh_cache-7170b5a8-12a7-4ddf-8089-fde172570fd1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:38:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-65727722-f4e6-4641-8dca-34142e7641f8 req-816c4362-7f9a-4e8e-988e-7ca048716572 service nova] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Received event network-vif-plugged-efd472f1-aab1-4878-bed5-14054ce12ebd {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:38:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-65727722-f4e6-4641-8dca-34142e7641f8 req-816c4362-7f9a-4e8e-988e-7ca048716572 service nova] Acquiring lock "f22d4c05-720a-4dc7-afa0-ac823e70060a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:38:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-65727722-f4e6-4641-8dca-34142e7641f8 req-816c4362-7f9a-4e8e-988e-7ca048716572 service nova] Lock "f22d4c05-720a-4dc7-afa0-ac823e70060a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:38:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-65727722-f4e6-4641-8dca-34142e7641f8 req-816c4362-7f9a-4e8e-988e-7ca048716572 service nova] Lock "f22d4c05-720a-4dc7-afa0-ac823e70060a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:38:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-65727722-f4e6-4641-8dca-34142e7641f8 req-816c4362-7f9a-4e8e-988e-7ca048716572 service nova] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] No waiting events found dispatching network-vif-plugged-efd472f1-aab1-4878-bed5-14054ce12ebd {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:38:49 user nova-compute[73104]: WARNING nova.compute.manager [req-65727722-f4e6-4641-8dca-34142e7641f8 req-816c4362-7f9a-4e8e-988e-7ca048716572 service nova] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Received unexpected event network-vif-plugged-efd472f1-aab1-4878-bed5-14054ce12ebd for instance with vm_state building and task_state spawning.
Aug 26 08:38:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-65727722-f4e6-4641-8dca-34142e7641f8 req-816c4362-7f9a-4e8e-988e-7ca048716572 service nova] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Received event network-vif-plugged-efd472f1-aab1-4878-bed5-14054ce12ebd {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:38:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-65727722-f4e6-4641-8dca-34142e7641f8 req-816c4362-7f9a-4e8e-988e-7ca048716572 service nova] Acquiring lock "f22d4c05-720a-4dc7-afa0-ac823e70060a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:38:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-65727722-f4e6-4641-8dca-34142e7641f8 req-816c4362-7f9a-4e8e-988e-7ca048716572 service nova] Lock "f22d4c05-720a-4dc7-afa0-ac823e70060a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:38:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-65727722-f4e6-4641-8dca-34142e7641f8 req-816c4362-7f9a-4e8e-988e-7ca048716572 service nova] Lock "f22d4c05-720a-4dc7-afa0-ac823e70060a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:38:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-65727722-f4e6-4641-8dca-34142e7641f8 req-816c4362-7f9a-4e8e-988e-7ca048716572 service nova] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] No waiting events found dispatching network-vif-plugged-efd472f1-aab1-4878-bed5-14054ce12ebd {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:38:49 user nova-compute[73104]: WARNING nova.compute.manager [req-65727722-f4e6-4641-8dca-34142e7641f8 req-816c4362-7f9a-4e8e-988e-7ca048716572 service nova] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Received unexpected event network-vif-plugged-efd472f1-aab1-4878-bed5-14054ce12ebd for instance with vm_state building and task_state spawning.
Aug 26 08:38:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d4c05-720a-4dc7-afa0-ac823e70060a/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d4c05-720a-4dc7-afa0-ac823e70060a/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:49 user nova-compute[73104]: DEBUG nova.network.neutron [req-2af83f52-c206-4be9-a00a-d5a7e96c1e87 req-fef2090d-241e-4c25-8f5d-426bac69ac49 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Updated VIF entry in instance network info cache for port 4a3e387d-f638-43fc-bdef-4c0b608d29d4. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:38:49 user nova-compute[73104]: DEBUG nova.network.neutron [req-2af83f52-c206-4be9-a00a-d5a7e96c1e87 req-fef2090d-241e-4c25-8f5d-426bac69ac49 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Updating instance_info_cache with network_info: [{"id": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "address": "fa:16:3e:65:0d:e0", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a3e387d-f6", "ovs_interfaceid": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:38:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2af83f52-c206-4be9-a00a-d5a7e96c1e87 req-fef2090d-241e-4c25-8f5d-426bac69ac49 service nova] Releasing lock "refresh_cache-94de2062-7017-44fe-8df0-0a3cd63d5498" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:38:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d4c05-720a-4dc7-afa0-ac823e70060a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:50 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:38:50 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:38:50 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=7048MB free_disk=24.59899139404297GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 08:38:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:38:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:38:50 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance dcec7631-b94f-4dbf-b85d-e8ad9c6396b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:38:50 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 995a2bd3-4c54-4217-ae9f-056353008547 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:38:50 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 94de2062-7017-44fe-8df0-0a3cd63d5498 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:38:50 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 13200b79-17a6-4c18-87da-653311946a04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:38:50 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 385c6d93-907d-42d7-9b43-479e6caf66f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:38:50 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance afe2c15e-4e27-47f3-8b0b-426f4b8619d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:38:50 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 93244bcd-34be-46f3-85e6-87bb5e69888d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:38:50 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance b04e96c7-f098-4612-b0b8-92cf6fd58865 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:38:50 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 85eea82a-c221-4661-9525-06a925b57e1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:38:50 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance e2ec2788-98c7-48a7-933a-433dc215d7ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:38:50 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 7170b5a8-12a7-4ddf-8089-fde172570fd1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:38:50 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance f22d4c05-720a-4dc7-afa0-ac823e70060a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:38:50 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 08:38:50 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 08:38:50 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:38:50 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:38:50 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 08:38:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.579s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:38:51 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:38:51 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:38:51 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:38:51 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:38:51 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:38:51 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:38:52 user nova-compute[73104]: DEBUG nova.compute.manager [req-aa794aed-3824-4ce3-baf3-16f8b1c87d9f req-8bf113f8-2cd4-4e37-a808-25050a7d0b7e service nova] [instance: 13200b79-17a6-4c18-87da-653311946a04] Received event network-changed-76ccf91d-d705-4512-8bd8-d6747105f390 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:38:52 user nova-compute[73104]: DEBUG nova.compute.manager [req-aa794aed-3824-4ce3-baf3-16f8b1c87d9f req-8bf113f8-2cd4-4e37-a808-25050a7d0b7e service nova] [instance: 13200b79-17a6-4c18-87da-653311946a04] Refreshing instance network info cache due to event network-changed-76ccf91d-d705-4512-8bd8-d6747105f390. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:38:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-aa794aed-3824-4ce3-baf3-16f8b1c87d9f req-8bf113f8-2cd4-4e37-a808-25050a7d0b7e service nova] Acquiring lock "refresh_cache-13200b79-17a6-4c18-87da-653311946a04" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:38:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-aa794aed-3824-4ce3-baf3-16f8b1c87d9f req-8bf113f8-2cd4-4e37-a808-25050a7d0b7e service nova] Acquired lock "refresh_cache-13200b79-17a6-4c18-87da-653311946a04" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:38:52 user nova-compute[73104]: DEBUG nova.network.neutron [req-aa794aed-3824-4ce3-baf3-16f8b1c87d9f req-8bf113f8-2cd4-4e37-a808-25050a7d0b7e service nova] [instance: 13200b79-17a6-4c18-87da-653311946a04] Refreshing network info cache for port 76ccf91d-d705-4512-8bd8-d6747105f390 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:38:53 user nova-compute[73104]: DEBUG nova.network.neutron [req-aa794aed-3824-4ce3-baf3-16f8b1c87d9f req-8bf113f8-2cd4-4e37-a808-25050a7d0b7e service nova] [instance: 13200b79-17a6-4c18-87da-653311946a04] Updated VIF entry in instance network info cache for port 76ccf91d-d705-4512-8bd8-d6747105f390. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:38:53 user nova-compute[73104]: DEBUG nova.network.neutron [req-aa794aed-3824-4ce3-baf3-16f8b1c87d9f req-8bf113f8-2cd4-4e37-a808-25050a7d0b7e service nova] [instance: 13200b79-17a6-4c18-87da-653311946a04] Updating instance_info_cache with network_info: [{"id": "76ccf91d-d705-4512-8bd8-d6747105f390", "address": "fa:16:3e:16:f1:1c", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ccf91d-d7", "ovs_interfaceid": "76ccf91d-d705-4512-8bd8-d6747105f390", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:38:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-aa794aed-3824-4ce3-baf3-16f8b1c87d9f req-8bf113f8-2cd4-4e37-a808-25050a7d0b7e service nova] Releasing lock "refresh_cache-13200b79-17a6-4c18-87da-653311946a04" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:38:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:53 user nova-compute[73104]: INFO nova.virt.block_device [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Booting with volume 213ace90-56d6-43cc-8af2-78f1ffe4b49a at /dev/vdb
Aug 26 08:38:53 user nova-compute[73104]: DEBUG os_brick.utils [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:38:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4907129-dbf6-4565-bf1a-6776aba08805]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:38:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee2faf5-f461-460e-acb1-6af7890bc620]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:38:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[35af6203-cb65-465a-a670-dcb9907ff088]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:38:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[941cd6ae-8c1e-49e1-ad55-969902f3eb43]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:38:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:38:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:38:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:38:53 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:38:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d73da70-3264-4d81-af96-424e20f2b732]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:38:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:38:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:38:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:38:53 user nova-compute[73104]: DEBUG os_brick.utils [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:38:53 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Updating existing volume attachment record: 1fa3291e-b696-40c3-9b45-e9dda118de45 {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 08:38:53 user nova-compute[73104]: INFO nova.virt.block_device [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Booting with volume 3e8a725f-797a-49df-a71e-4672e30f9d6f at /dev/vdc
Aug 26 08:38:54 user nova-compute[73104]: DEBUG os_brick.utils [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:38:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:54 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e09272d-d957-4c91-a89f-3697c106c394]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:38:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:54 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c83e8e-fd46-448a-b127-2c445c55dd5b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:38:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:38:54 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6cb696-c0ff-4d4a-8465-2c8b590e2888]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:38:54 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[316b227e-749b-4673-a0f4-3defc61aaf2f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:38:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:38:54 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:38:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:38:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:38:54 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:38:54 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbd4fd0-2bb7-44b1-994f-10837b27ce29]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:38:54 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:38:54 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:38:54 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:38:54 user nova-compute[73104]: DEBUG os_brick.utils [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:38:54 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Updating existing volume attachment record: d7763f9d-50cb-4350-926e-43e2467cf36c {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 08:38:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-558d1b8c-8769-40bc-95e8-a581ae4b1d94 req-4fc9af91-4519-4e36-8b99-55c505a1d84d service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Received event network-changed-d4692900-c165-487d-9847-383fcf1d2270 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:38:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-558d1b8c-8769-40bc-95e8-a581ae4b1d94 req-4fc9af91-4519-4e36-8b99-55c505a1d84d service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Refreshing instance network info cache due to event network-changed-d4692900-c165-487d-9847-383fcf1d2270. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:38:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-558d1b8c-8769-40bc-95e8-a581ae4b1d94 req-4fc9af91-4519-4e36-8b99-55c505a1d84d service nova] Acquiring lock "refresh_cache-385c6d93-907d-42d7-9b43-479e6caf66f9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:38:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-558d1b8c-8769-40bc-95e8-a581ae4b1d94 req-4fc9af91-4519-4e36-8b99-55c505a1d84d service nova] Acquired lock "refresh_cache-385c6d93-907d-42d7-9b43-479e6caf66f9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:38:54 user nova-compute[73104]: DEBUG nova.network.neutron [req-558d1b8c-8769-40bc-95e8-a581ae4b1d94 req-4fc9af91-4519-4e36-8b99-55c505a1d84d service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Refreshing network info cache for port d4692900-c165-487d-9847-383fcf1d2270 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:38:55 user nova-compute[73104]: DEBUG nova.network.neutron [req-558d1b8c-8769-40bc-95e8-a581ae4b1d94 req-4fc9af91-4519-4e36-8b99-55c505a1d84d service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Updated VIF entry in instance network info cache for port d4692900-c165-487d-9847-383fcf1d2270. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:38:55 user nova-compute[73104]: DEBUG nova.network.neutron [req-558d1b8c-8769-40bc-95e8-a581ae4b1d94 req-4fc9af91-4519-4e36-8b99-55c505a1d84d service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Updating instance_info_cache with network_info: [{"id": "d4692900-c165-487d-9847-383fcf1d2270", "address": "fa:16:3e:b9:37:34", "network": {"id": "9aad8a32-d93f-45ef-be53-f84cebd194b1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2017537149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc8c266ecf8444919a4a2ed73b784b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4692900-c1", "ovs_interfaceid": "d4692900-c165-487d-9847-383fcf1d2270", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:38:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-558d1b8c-8769-40bc-95e8-a581ae4b1d94 req-4fc9af91-4519-4e36-8b99-55c505a1d84d service nova] Releasing lock "refresh_cache-385c6d93-907d-42d7-9b43-479e6caf66f9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:38:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:38:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG os_brick.initiator.connector [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Factory for ISCSI on None {{(pid=73104) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.008s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TrmJdIxB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:39:02 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:39:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:39:02 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:39:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:39:02 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9189caca-60a8-47cf-8142-4a2ee8c829e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:39:02 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[190d0b9d-d1d3-4b84-915a-7ae4742cbec9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc] added
Aug 26 08:39:02 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d3a9c1-271e-4510-b115-76a84dc1a15a]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1512eff-7c11-4bfd-8c45-f61416f18f96]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TrmJdIxB {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TrmJdIxB" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e14343-3aa9-4e8b-8db4-f3d4751826e4]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TrmJdIxB'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[966f619b-b253-4f32-a532-3ee25703332f]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[84df3e46-3054-4727-92a7-1bc8b0bba2b7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 08:39:02 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 08:39:02 user nova-compute[73104]:  {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:39:02 user nova-compute[73104]: WARNING os_brick.initiator.connectors.iscsi [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 08:39:02 user nova-compute[73104]: 
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6c5b9a-408f-4fb6-91a7-3db330f86659]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc, portal: 172.16.0.220,3260]
Aug 26 08:39:02 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc, portal: 172.16.0.220,3260] successful.
Aug 26 08:39:02 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a545cc-2c75-4c00-8336-720337dbcfee]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba53fbb-96ef-423d-bdb9-241924ff28f7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc (non-flash)
Aug 26 08:39:02 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc (non-flash)
Aug 26 08:39:02 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd10bebb-23ec-4dc2-b0ef-8c134f7cdc70]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TrmJdIxB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "13200b79-17a6-4c18-87da-653311946a04" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "13200b79-17a6-4c18-87da-653311946a04" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:03 user nova-compute[73104]: DEBUG nova.objects.instance [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lazy-loading 'flavor' on Instance uuid 13200b79-17a6-4c18-87da-653311946a04 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:39:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "13200b79-17a6-4c18-87da-653311946a04" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "13200b79-17a6-4c18-87da-653311946a04" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "13200b79-17a6-4c18-87da-653311946a04" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:03 user nova-compute[73104]: INFO nova.compute.manager [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Attaching volume 509cda48-d4cc-4341-bd5b-25cc81265966 to /dev/vdb
Aug 26 08:39:03 user nova-compute[73104]: DEBUG os_brick.utils [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:39:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:03 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d25cbd-220b-453a-bb21-5e9cd22321ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:03 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9629f3a-7233-4e11-9b9e-09a0fe912adb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:03 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[440bbe9f-79de-42b4-8967-ce40e3e86216]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:03 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[251ab554-ddb3-4b4a-967f-c9e3ed25020b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:39:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:39:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:39:03 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:39:03 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0193e21e-a215-4677-9e29-e60879f9c025]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:39:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:39:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:39:03 user nova-compute[73104]: DEBUG os_brick.utils [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:39:03 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Updating existing volume attachment record: 2a952bcb-55d2-4cc5-ade9-0293b44d9cdb {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 08:39:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:39:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '26333373030353833', 'path': '/dev/sdb'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:39:03 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333373030353833', 'path': '/dev/sdb'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:39:03 user nova-compute[73104]: DEBUG nova.objects.instance [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Lazy-loading 'flavor' on Instance uuid 995a2bd3-4c54-4217-ae9f-056353008547 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:39:03 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 08:39:03 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:39:03 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 08:39:03 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:39:03 user nova-compute[73104]:   <serial>01730192-0637-4609-a5da-60517dc35abc</serial>
Aug 26 08:39:03 user nova-compute[73104]: </disk>
Aug 26 08:39:03 user nova-compute[73104]:  {{(pid=73104) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 08:39:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "94de2062-7017-44fe-8df0-0a3cd63d5498" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:03 user nova-compute[73104]: INFO nova.compute.manager [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Shelving
Aug 26 08:39:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:04 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:39:04 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:39:04 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] No VIF found with MAC fa:16:3e:a3:26:d9, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:39:04 user nova-compute[73104]: DEBUG nova.compute.manager [req-76d3ca9d-889e-4c7c-ab9a-e52a91ffd8e1 req-6bf5e785-f1ea-40e4-bdff-688dcc6675b2 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Received event network-vif-unplugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-76d3ca9d-889e-4c7c-ab9a-e52a91ffd8e1 req-6bf5e785-f1ea-40e4-bdff-688dcc6675b2 service nova] Acquiring lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-76d3ca9d-889e-4c7c-ab9a-e52a91ffd8e1 req-6bf5e785-f1ea-40e4-bdff-688dcc6675b2 service nova] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-76d3ca9d-889e-4c7c-ab9a-e52a91ffd8e1 req-6bf5e785-f1ea-40e4-bdff-688dcc6675b2 service nova] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:04 user nova-compute[73104]: DEBUG nova.compute.manager [req-76d3ca9d-889e-4c7c-ab9a-e52a91ffd8e1 req-6bf5e785-f1ea-40e4-bdff-688dcc6675b2 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] No waiting events found dispatching network-vif-unplugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:04 user nova-compute[73104]: WARNING nova.compute.manager [req-76d3ca9d-889e-4c7c-ab9a-e52a91ffd8e1 req-6bf5e785-f1ea-40e4-bdff-688dcc6675b2 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Received unexpected event network-vif-unplugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 for instance with vm_state active and task_state shelving.
Aug 26 08:39:04 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Instance destroyed successfully.
Aug 26 08:39:04 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Beginning cold snapshot process
Aug 26 08:39:05 user nova-compute[73104]: DEBUG nova.privsep.utils [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73104) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 08:39:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk /opt/stack/data/nova/instances/snapshots/tmpo1us_59r/a666f51383084a1795766f8ace39c1e3 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk /opt/stack/data/nova/instances/snapshots/tmpo1us_59r/a666f51383084a1795766f8ace39c1e3" returned: 0 in 0.902s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:05 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Snapshot extracted, beginning image upload
Aug 26 08:39:06 user nova-compute[73104]: DEBUG nova.compute.manager [req-d89b3e42-1e22-4d93-b3c0-f71692d84154 req-e0a9b3a0-2504-4f84-b42c-df95e0d92926 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Received event network-vif-plugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d89b3e42-1e22-4d93-b3c0-f71692d84154 req-e0a9b3a0-2504-4f84-b42c-df95e0d92926 service nova] Acquiring lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d89b3e42-1e22-4d93-b3c0-f71692d84154 req-e0a9b3a0-2504-4f84-b42c-df95e0d92926 service nova] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d89b3e42-1e22-4d93-b3c0-f71692d84154 req-e0a9b3a0-2504-4f84-b42c-df95e0d92926 service nova] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:06 user nova-compute[73104]: DEBUG nova.compute.manager [req-d89b3e42-1e22-4d93-b3c0-f71692d84154 req-e0a9b3a0-2504-4f84-b42c-df95e0d92926 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] No waiting events found dispatching network-vif-plugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:06 user nova-compute[73104]: WARNING nova.compute.manager [req-d89b3e42-1e22-4d93-b3c0-f71692d84154 req-e0a9b3a0-2504-4f84-b42c-df95e0d92926 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Received unexpected event network-vif-plugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 for instance with vm_state active and task_state shelving_image_uploading.
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3b5514da-4a34-4f0e-a12d-50d218055faf tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Lock "995a2bd3-4c54-4217-ae9f-056353008547" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.164s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG nova.compute.manager [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:39:08 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Creating image(s)
Aug 26 08:39:08 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Did not create local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Ensure instance console log exists: /opt/stack/data/nova/instances/e2ec2788-98c7-48a7-933a-433dc215d7ec/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Start _get_guest_xml network_info=[{"id": "949f6e6c-727e-440c-b767-caf76f3f037e", "address": "fa:16:3e:a4:00:26", "network": {"id": "0941b2d8-176a-403b-a9bf-4a4d0de5bcc0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-890813398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap949f6e6c-72", "ovs_interfaceid": "949f6e6c-727e-440c-b767-caf76f3f037e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d7cb8b02-8579-43e0-b058-2cbe69bf0edf", "address": "fa:16:3e:72:2b:2a", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cb8b02-85", "ovs_interfaceid": "d7cb8b02-8579-43e0-b058-2cbe69bf0edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "55fb8a61-3cfe-422c-af91-ca5199362cc7", "address": "fa:16:3e:04:77:77", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fb8a61-3c", "ovs_interfaceid": "55fb8a61-3cfe-422c-af91-ca5199362cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2bb400c7-1a44-427c-a38e-860f71f92d31", "address": "fa:16:3e:33:83:63", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb400c7-1a", "ovs_interfaceid": "2bb400c7-1a44-427c-a38e-860f71f92d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0cf8f75c-539b-44d0-bc4a-a52f86a24d9c", "address": "fa:16:3e:50:f5:ca", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf8f75c-53", "ovs_interfaceid": "0cf8f75c-539b-44d0-bc4a-a52f86a24d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "971207c4-aee3-47f6-8fb4-ad7d7fc2827e", "address": "fa:16:3e:13:5e:a9", "network": {"id": "b98d43ff-51d0-4328-be34-b7c110358c95", "bridge": "br-int", "label": "tempest-device-tagging-net2-545564459", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap971207c4-ae", "ovs_interfaceid": "971207c4-aee3-47f6-8fb4-ad7d7fc2827e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1de67e88-3745-4d54-9b30-17d82513265f", "address": "fa:16:3e:b3:77:f4", "network": {"id": "b98d43ff-51d0-4328-be34-b7c110358c95", "bridge": "br-int", "label": "tempest-device-tagging-net2-545564459", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de67e88-37", "ovs_interfaceid": "1de67e88-3745-4d54-9b30-17d82513265f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '8714ed9c-e459-4d38-8fc0-378bc09379ec', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WiUVGChN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e2ec2788-98c7-48a7-933a-433dc215d7ec', 'attached_at': '', 'detached_at': '', 'volume_id': '99dfa21b-e82b-4526-ac24-50a4e0b66646', 'serial': '99dfa21b-e82b-4526-ac24-50a4e0b66646'}, 'device_type': 'disk', 'volume_type': None}, {'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '5c06c22c-5027-466d-b408-041a344cadb6', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcFEzOiw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e2ec2788-98c7-48a7-933a-433dc215d7ec', 'attached_at': '', 'detached_at': '', 'volume_id': '311fdf7a-f6f3-413d-9f9b-a21e89f340dc', 'serial': '311fdf7a-f6f3-413d-9f9b-a21e89f340dc'}, 'device_type': 'disk', 'volume_type': None}, {'delete_on_termination': False, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'd7763f9d-50cb-4350-926e-43e2467cf36c', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sFRtjoUh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e2ec2788-98c7-48a7-933a-433dc215d7ec', 'attached_at': '', 'detached_at': '', 'volume_id': '3e8a725f-797a-49df-a71e-4672e30f9d6f', 'serial': '3e8a725f-797a-49df-a71e-4672e30f9d6f'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:39:08 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:39:08 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:39:08 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WiUVGChN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:39:08 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:39:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:39:08 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:39:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:39:08 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50cfb62-b882-4a6c-8909-22b80d0f42eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:39:08 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31fe09e-4513-444f-b77e-4944f20c1fc3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646] added
Aug 26 08:39:08 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab4adac-b5f0-443e-959c-58c2af3a5cc1]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf714904-c16b-4140-9207-fb0d44e409a5]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WiUVGChN {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WiUVGChN" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f2c17b-275c-46a7-912b-b5476dd64d07]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WiUVGChN'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a072611-6a96-4c5a-a39a-d25ac495198e]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2afc023-8076-44fb-97b1-85ba75b11e88]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc (non-flash)
Aug 26 08:39:08 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc (non-flash)
Aug 26 08:39:08 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4262ab-ae92-40c0-bb0b-5c52f87ed697]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646, portal: 172.16.0.220,3260]
Aug 26 08:39:08 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646, portal: 172.16.0.220,3260] successful.
Aug 26 08:39:08 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:08 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Snapshot image upload complete
Aug 26 08:39:08 user nova-compute[73104]: DEBUG nova.compute.manager [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb10580c-e9b8-46bd-af05-5ca1cd1afb9f]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fc19e8-cb12-4e89-9124-25fb85430f9b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc (non-flash)
Aug 26 08:39:08 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:08 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc (non-flash)
Aug 26 08:39:08 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:08 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9a2643-aeac-4dd9-8319-94c7c7ab5f1c]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WiUVGChN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:39:08 user nova-compute[73104]: INFO nova.compute.manager [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Shelve offloading
Aug 26 08:39:08 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Instance destroyed successfully.
Aug 26 08:39:08 user nova-compute[73104]: DEBUG nova.compute.manager [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "refresh_cache-94de2062-7017-44fe-8df0-0a3cd63d5498" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquired lock "refresh_cache-94de2062-7017-44fe-8df0-0a3cd63d5498" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:39:08 user nova-compute[73104]: DEBUG nova.network.neutron [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG nova.network.neutron [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Updating instance_info_cache with network_info: [{"id": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "address": "fa:16:3e:65:0d:e0", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a3e387d-f6", "ovs_interfaceid": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Releasing lock "refresh_cache-94de2062-7017-44fe-8df0-0a3cd63d5498" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:39:09 user nova-compute[73104]: INFO nova.virt.block_device [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Booting with volume f6d15a6a-b090-4ef2-bfbf-968454ababbd at /dev/vdc
Aug 26 08:39:09 user nova-compute[73104]: DEBUG os_brick.utils [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1c057a-6acd-4c08-b9c9-41806221e350]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd76fb10-27a1-46ca-9e41-681c51f0c0bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Acquiring lock "995a2bd3-4c54-4217-ae9f-056353008547" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Lock "995a2bd3-4c54-4217-ae9f-056353008547" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Acquiring lock "995a2bd3-4c54-4217-ae9f-056353008547-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Lock "995a2bd3-4c54-4217-ae9f-056353008547-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Lock "995a2bd3-4c54-4217-ae9f-056353008547-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:09 user nova-compute[73104]: INFO nova.compute.manager [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Terminating instance
Aug 26 08:39:09 user nova-compute[73104]: DEBUG nova.compute.manager [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a23f78-86cc-44ee-ae52-39f17b4e59c3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2676875-19f1-4f65-b853-7649b99d7288]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:39:09 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d187376-d30b-4e9d-bcb5-c1139a5a21d1]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG os_brick.utils [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Updating existing volume attachment record: fe997aa1-653e-4cfc-8161-e78990d58be5 {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23061363966643363', 'path': '/dev/sdc'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061363966643363', 'path': '/dev/sdc'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcFEzOiw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:39:09 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:39:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:39:09 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:39:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:39:09 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6ec0c1-e486-4dcb-8ba0-6ed43556144d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:39:09 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ddced8-057f-46ab-93e0-1f767c8de32d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc] added
Aug 26 08:39:09 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[977e9571-1b1c-4807-826b-26a84766aba9]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[73612c39-51f8-4941-812e-e90549a5c013]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qcFEzOiw {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qcFEzOiw" returned: 0 in 0.028s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[95708db1-4a8d-4523-b11c-fdb3410c3eb0]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qcFEzOiw'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec001cdb-b413-41b5-b895-ca9066acd7e0]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:09 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Instance destroyed successfully.
Aug 26 08:39:09 user nova-compute[73104]: DEBUG nova.objects.instance [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lazy-loading 'resources' on Instance uuid 94de2062-7017-44fe-8df0-0a3cd63d5498 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7a8810-a8a6-4f36-b37d-fa3d4b60ea17]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc (non-flash)
Aug 26 08:39:09 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:09 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc (non-flash)
Aug 26 08:39:09 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:09 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG nova.compute.manager [req-08c654fc-5f87-475c-bfdf-d457c11f43e9 req-617f5498-ebdb-4324-9d2c-d9110c20c778 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Received event network-changed-4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG nova.compute.manager [req-08c654fc-5f87-475c-bfdf-d457c11f43e9 req-617f5498-ebdb-4324-9d2c-d9110c20c778 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Refreshing instance network info cache due to event network-changed-4a3e387d-f638-43fc-bdef-4c0b608d29d4. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-08c654fc-5f87-475c-bfdf-d457c11f43e9 req-617f5498-ebdb-4324-9d2c-d9110c20c778 service nova] Acquiring lock "refresh_cache-94de2062-7017-44fe-8df0-0a3cd63d5498" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-08c654fc-5f87-475c-bfdf-d457c11f43e9 req-617f5498-ebdb-4324-9d2c-d9110c20c778 service nova] Acquired lock "refresh_cache-94de2062-7017-44fe-8df0-0a3cd63d5498" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG nova.network.neutron [req-08c654fc-5f87-475c-bfdf-d457c11f43e9 req-617f5498-ebdb-4324-9d2c-d9110c20c778 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Refreshing network info cache for port 4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-123632046',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-123632046',id=3,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPi19fyJwWFBGW+j/nwVTdr8vlXHUgdkMaN5yhtSAh87HkLJ/UmDNji3VEqtFmHeRNmvggGbQx0WylavGyvgQRZOyai6wn1O5pmvdVkCKfZS5FYzwTtABxlMMyHIP1kb8A==',key_name='tempest-keypair-1165821836',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:37:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='770daa2e8b274a9b828e489c1573ced4',ramdisk_id='',reservation_id='r-2y3651sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2062858766',owner_user_name='tempest-AttachVolumeShelveTestJSON-2062858766-project-member',shelved_at='2023-08-26T08:39:08.631315',shelved_host='user',shelved_image_id='61716b59-ca97-49ea-b9af-d53731069806'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:39:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db3ae37701df47a5b35026fe3857bc51',uuid=94de2062-7017-44fe-8df0-0a3cd63d5498,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "address": "fa:16:3e:65:0d:e0", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a3e387d-f6", "ovs_interfaceid": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Converting VIF {"id": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "address": "fa:16:3e:65:0d:e0", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a3e387d-f6", "ovs_interfaceid": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:0d:e0,bridge_name='br-int',has_traffic_filtering=True,id=4a3e387d-f638-43fc-bdef-4c0b608d29d4,network=Network(38f7ec35-12eb-46fe-a425-51ee854d804d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a3e387d-f6') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG os_vif [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:0d:e0,bridge_name='br-int',has_traffic_filtering=True,id=4a3e387d-f638-43fc-bdef-4c0b608d29d4,network=Network(38f7ec35-12eb-46fe-a425-51ee854d804d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a3e387d-f6') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a3e387d-f6, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:10 user nova-compute[73104]: INFO os_vif [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:0d:e0,bridge_name='br-int',has_traffic_filtering=True,id=4a3e387d-f638-43fc-bdef-4c0b608d29d4,network=Network(38f7ec35-12eb-46fe-a425-51ee854d804d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a3e387d-f6')
Aug 26 08:39:10 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Deleting instance files /opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498_del
Aug 26 08:39:10 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Deletion of /opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498_del complete
Aug 26 08:39:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b92630-1d6d-4b5f-9302-c12c25b2ea35]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc, portal: 172.16.0.220,3260]
Aug 26 08:39:10 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc, portal: 172.16.0.220,3260] successful.
Aug 26 08:39:10 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[228fd926-a1e7-4eb4-b3ee-3a9e68ba3858]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG nova.compute.manager [req-38695adf-91e8-408f-bf19-03d1893ff296 req-22fad32b-2b09-4ee0-aa0d-6fa934003e59 service nova] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Received event network-vif-unplugged-911335fb-63d7-4381-ac34-a47bb61d2b7e {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-38695adf-91e8-408f-bf19-03d1893ff296 req-22fad32b-2b09-4ee0-aa0d-6fa934003e59 service nova] Acquiring lock "995a2bd3-4c54-4217-ae9f-056353008547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-38695adf-91e8-408f-bf19-03d1893ff296 req-22fad32b-2b09-4ee0-aa0d-6fa934003e59 service nova] Lock "995a2bd3-4c54-4217-ae9f-056353008547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-38695adf-91e8-408f-bf19-03d1893ff296 req-22fad32b-2b09-4ee0-aa0d-6fa934003e59 service nova] Lock "995a2bd3-4c54-4217-ae9f-056353008547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG nova.compute.manager [req-38695adf-91e8-408f-bf19-03d1893ff296 req-22fad32b-2b09-4ee0-aa0d-6fa934003e59 service nova] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] No waiting events found dispatching network-vif-unplugged-911335fb-63d7-4381-ac34-a47bb61d2b7e {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG nova.compute.manager [req-38695adf-91e8-408f-bf19-03d1893ff296 req-22fad32b-2b09-4ee0-aa0d-6fa934003e59 service nova] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Received event network-vif-unplugged-911335fb-63d7-4381-ac34-a47bb61d2b7e for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[527f430e-0784-4880-ad83-9b38f79219e7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc (non-flash)
Aug 26 08:39:10 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:10 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:10 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc (non-flash)
Aug 26 08:39:10 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:10 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:10 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73104) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 26 08:39:10 user nova-compute[73104]: INFO nova.virt.libvirt.host [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] UEFI support detected
Aug 26 08:39:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f576c27a-6bf8-4015-8a5a-02b3671b8fa1]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcFEzOiw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:39:10 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Deleted allocations for instance 94de2062-7017-44fe-8df0-0a3cd63d5498
Aug 26 08:39:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG nova.objects.instance [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lazy-loading 'numa_topology' on Instance uuid 94de2062-7017-44fe-8df0-0a3cd63d5498 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG nova.objects.base [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Object Instance<94de2062-7017-44fe-8df0-0a3cd63d5498> lazy-loaded attributes: resources,numa_topology {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:39:10 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Instance destroyed successfully.
Aug 26 08:39:10 user nova-compute[73104]: DEBUG nova.objects.instance [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Lazy-loading 'resources' on Instance uuid 995a2bd3-4c54-4217-ae9f-056353008547 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-522228798',display_name='tempest-DeleteServersTestJSON-server-522228798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-522228798',id=2,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:37:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='723a18c60d10444189783f4d50d2e6a7',ramdisk_id='',reservation_id='r-oum0sotf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1633599130',owner_user_name='tempest-DeleteServersTestJSON-1633599130-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:37:06Z,user_data=None,user_id='caf726272cda444f9c0b3608c65ddbf1',uuid=995a2bd3-4c54-4217-ae9f-056353008547,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "911335fb-63d7-4381-ac34-a47bb61d2b7e", "address": "fa:16:3e:a3:26:d9", "network": {"id": "377250a7-e055-47b7-b42d-10b634024239", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-158207792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "723a18c60d10444189783f4d50d2e6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap911335fb-63", "ovs_interfaceid": "911335fb-63d7-4381-ac34-a47bb61d2b7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Converting VIF {"id": "911335fb-63d7-4381-ac34-a47bb61d2b7e", "address": "fa:16:3e:a3:26:d9", "network": {"id": "377250a7-e055-47b7-b42d-10b634024239", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-158207792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "723a18c60d10444189783f4d50d2e6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap911335fb-63", "ovs_interfaceid": "911335fb-63d7-4381-ac34-a47bb61d2b7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:26:d9,bridge_name='br-int',has_traffic_filtering=True,id=911335fb-63d7-4381-ac34-a47bb61d2b7e,network=Network(377250a7-e055-47b7-b42d-10b634024239),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap911335fb-63') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG os_vif [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:26:d9,bridge_name='br-int',has_traffic_filtering=True,id=911335fb-63d7-4381-ac34-a47bb61d2b7e,network=Network(377250a7-e055-47b7-b42d-10b634024239),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap911335fb-63') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap911335fb-63, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:10 user nova-compute[73104]: INFO os_vif [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:26:d9,bridge_name='br-int',has_traffic_filtering=True,id=911335fb-63d7-4381-ac34-a47bb61d2b7e,network=Network(377250a7-e055-47b7-b42d-10b634024239),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap911335fb-63')
Aug 26 08:39:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TrmJdIxB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:39:10 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:39:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.434s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df421e12-3ce0-4274-8501-677c55d2f526 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.769s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG nova.network.neutron [req-08c654fc-5f87-475c-bfdf-d457c11f43e9 req-617f5498-ebdb-4324-9d2c-d9110c20c778 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Updated VIF entry in instance network info cache for port 4a3e387d-f638-43fc-bdef-4c0b608d29d4. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG nova.network.neutron [req-08c654fc-5f87-475c-bfdf-d457c11f43e9 req-617f5498-ebdb-4324-9d2c-d9110c20c778 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Updating instance_info_cache with network_info: [{"id": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "address": "fa:16:3e:65:0d:e0", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap4a3e387d-f6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:39:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-08c654fc-5f87-475c-bfdf-d457c11f43e9 req-617f5498-ebdb-4324-9d2c-d9110c20c778 service nova] Releasing lock "refresh_cache-94de2062-7017-44fe-8df0-0a3cd63d5498" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '23536303834383835', 'path': '/dev/sdd'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536303834383835', 'path': '/dev/sdd'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.620s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b3a5f5-89aa-41d8-8dec-b4cde84622c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sFRtjoUh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:39:11 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8feb0146-7cc2-40f7-a46b-670ee128ec67]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc (non-flash)
Aug 26 08:39:11 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:11 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:11 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc (non-flash)
Aug 26 08:39:11 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:11 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:11 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0c4517130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc'): ({'sdb'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Removing single pathed devices sdb {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[971f43d1-e8fb-4132-977b-6a6a1359ba57]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[908940e4-f7ee-43d4-98c9-ff3494d06812]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Flushing IO for device /dev/sdb {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ae54bb-5064-40ad-9ef5-0585e6f8237d]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae4b827-f6f7-4f1f-91d5-4b1bbc400d64]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73e5764-3a54-4493-a1c7-b62b46fbcfbb]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e2f840-e29c-4b39-85fc-a41512bbe8a1]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc, portal: 172.16.0.220,3260]
Aug 26 08:39:11 user nova-compute[73104]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc, portal: 172.16.0.220,3260] successful.
Aug 26 08:39:11 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01730192-0637-4609-a5da-60517dc35abc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65308a0-a32a-40f2-a5c3-09a333c60ab3]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] <== disconnect_volume: return (910ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:39:11 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Deleting instance files /opt/stack/data/nova/instances/995a2bd3-4c54-4217-ae9f-056353008547_del
Aug 26 08:39:11 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Deletion of /opt/stack/data/nova/instances/995a2bd3-4c54-4217-ae9f-056353008547_del complete
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.271s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:39:11 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:39:11 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa058f5c-54fb-42a9-8d40-821618e3491c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:39:11 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd47377-0215-4351-904f-9185835633ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f] added
Aug 26 08:39:11 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:11 user nova-compute[73104]: INFO nova.compute.manager [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Took 1.92 seconds to destroy the instance on the hypervisor.
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[38efbded-7ae9-4342-9555-0be5526f8201]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac3f5da-1eec-4dc4-9061-0b5362ba8ac0]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sFRtjoUh {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sFRtjoUh" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7dcb65-0925-4aa7-b04e-42accc59298c]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sFRtjoUh'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[19029e96-5833-41db-9df1-5d7e48622f56]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7f2daa-d8f2-431d-994b-89493c7ccfb3]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:11 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:11 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:11 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:11 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bbc3d5-7e23-4dad-aff2-69e5dfe33a0d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f, portal: 172.16.0.220,3260]
Aug 26 08:39:11 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f, portal: 172.16.0.220,3260] successful.
Aug 26 08:39:11 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a79654f-ada4-41b1-bb48-7179cabbca51]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[923481b3-5569-4267-952f-86fdc5dfa4c5]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:11 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:11 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:11 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:11 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:11 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:11 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] HCTL ('33', '-', '-', 0) found on session 5 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[381211dd-ed4c-4c34-96c0-55efce3dfa79]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:11 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Searching for a device in session 5 and hctl ['33', '*', '*', 0] yield: None {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.compute.manager [req-2ed8acf2-0e6b-4ad5-adde-f6f75e80b49c req-b4fb63b8-fc4d-4bed-8b88-e0961317c24b service nova] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Received event network-changed-54d197ce-aea5-41ab-b450-e86a182c8bc4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.compute.manager [req-2ed8acf2-0e6b-4ad5-adde-f6f75e80b49c req-b4fb63b8-fc4d-4bed-8b88-e0961317c24b service nova] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Refreshing instance network info cache due to event network-changed-54d197ce-aea5-41ab-b450-e86a182c8bc4. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2ed8acf2-0e6b-4ad5-adde-f6f75e80b49c req-b4fb63b8-fc4d-4bed-8b88-e0961317c24b service nova] Acquiring lock "refresh_cache-afe2c15e-4e27-47f3-8b0b-426f4b8619d1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2ed8acf2-0e6b-4ad5-adde-f6f75e80b49c req-b4fb63b8-fc4d-4bed-8b88-e0961317c24b service nova] Acquired lock "refresh_cache-afe2c15e-4e27-47f3-8b0b-426f4b8619d1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.network.neutron [req-2ed8acf2-0e6b-4ad5-adde-f6f75e80b49c req-b4fb63b8-fc4d-4bed-8b88-e0961317c24b service nova] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Refreshing network info cache for port 54d197ce-aea5-41ab-b450-e86a182c8bc4 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.compute.manager [req-c07cd851-0dd4-4c02-a7bf-83c7fcfbe32c req-721e06fc-a4fa-48f7-b60f-38cad6a89b24 service nova] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Received event network-vif-plugged-911335fb-63d7-4381-ac34-a47bb61d2b7e {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c07cd851-0dd4-4c02-a7bf-83c7fcfbe32c req-721e06fc-a4fa-48f7-b60f-38cad6a89b24 service nova] Acquiring lock "995a2bd3-4c54-4217-ae9f-056353008547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c07cd851-0dd4-4c02-a7bf-83c7fcfbe32c req-721e06fc-a4fa-48f7-b60f-38cad6a89b24 service nova] Lock "995a2bd3-4c54-4217-ae9f-056353008547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c07cd851-0dd4-4c02-a7bf-83c7fcfbe32c req-721e06fc-a4fa-48f7-b60f-38cad6a89b24 service nova] Lock "995a2bd3-4c54-4217-ae9f-056353008547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.compute.manager [req-c07cd851-0dd4-4c02-a7bf-83c7fcfbe32c req-721e06fc-a4fa-48f7-b60f-38cad6a89b24 service nova] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] No waiting events found dispatching network-vif-plugged-911335fb-63d7-4381-ac34-a47bb61d2b7e {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:12 user nova-compute[73104]: WARNING nova.compute.manager [req-c07cd851-0dd4-4c02-a7bf-83c7fcfbe32c req-721e06fc-a4fa-48f7-b60f-38cad6a89b24 service nova] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Received unexpected event network-vif-plugged-911335fb-63d7-4381-ac34-a47bb61d2b7e for instance with vm_state active and task_state deleting.
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:39:12 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Took 0.70 seconds to deallocate network for instance.
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.network.neutron [req-2ed8acf2-0e6b-4ad5-adde-f6f75e80b49c req-b4fb63b8-fc4d-4bed-8b88-e0961317c24b service nova] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Updated VIF entry in instance network info cache for port 54d197ce-aea5-41ab-b450-e86a182c8bc4. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.network.neutron [req-2ed8acf2-0e6b-4ad5-adde-f6f75e80b49c req-b4fb63b8-fc4d-4bed-8b88-e0961317c24b service nova] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Updating instance_info_cache with network_info: [{"id": "54d197ce-aea5-41ab-b450-e86a182c8bc4", "address": "fa:16:3e:66:74:06", "network": {"id": "e0ff8c51-555a-4539-8408-7efee217025c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1595132883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dfab4672f4f4303839a67b98699cae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54d197ce-ae", "ovs_interfaceid": "54d197ce-aea5-41ab-b450-e86a182c8bc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2ed8acf2-0e6b-4ad5-adde-f6f75e80b49c req-b4fb63b8-fc4d-4bed-8b88-e0961317c24b service nova] Releasing lock "refresh_cache-afe2c15e-4e27-47f3-8b0b-426f4b8619d1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Searching for a device in session 5 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sFRtjoUh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] <== connect_volume: return (1623ms) {'type': 'block', 'scsi_wwn': '26465626664356663', 'path': '/dev/sdb'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465626664356663', 'path': '/dev/sdb'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-147720369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-147720369',id=10,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE7N2igt88eWl9+0O3rw7Gr2O3Pf0Clh8aTrKtwxprjLw0oRrQ/YFniZCOny/ulFQwuklyMiP7yX5Gvlz/Qexsg2T/RwJg01QU3Il1Vw2dkTm55TZbc2b3skf3PilOX5A==',key_name='tempest-keypair-1800903172',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac7989e8c5da415a9ccf66845b0d831c',ramdisk_id='',reservation_id='r-bjzqt5n9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2021222373',owner_user_name='tempest-TaggedBootDevicesTest-2021222373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a68183c66ce484aa46ec2a4d897dac8',uuid=e2ec2788-98c7-48a7-933a-433dc215d7ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "949f6e6c-727e-440c-b767-caf76f3f037e", "address": "fa:16:3e:a4:00:26", "network": {"id": "0941b2d8-176a-403b-a9bf-4a4d0de5bcc0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-890813398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap949f6e6c-72", "ovs_interfaceid": "949f6e6c-727e-440c-b767-caf76f3f037e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converting VIF {"id": "949f6e6c-727e-440c-b767-caf76f3f037e", "address": "fa:16:3e:a4:00:26", "network": {"id": "0941b2d8-176a-403b-a9bf-4a4d0de5bcc0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-890813398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap949f6e6c-72", "ovs_interfaceid": "949f6e6c-727e-440c-b767-caf76f3f037e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:00:26,bridge_name='br-int',has_traffic_filtering=True,id=949f6e6c-727e-440c-b767-caf76f3f037e,network=Network(0941b2d8-176a-403b-a9bf-4a4d0de5bcc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap949f6e6c-72') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-147720369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-147720369',id=10,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE7N2igt88eWl9+0O3rw7Gr2O3Pf0Clh8aTrKtwxprjLw0oRrQ/YFniZCOny/ulFQwuklyMiP7yX5Gvlz/Qexsg2T/RwJg01QU3Il1Vw2dkTm55TZbc2b3skf3PilOX5A==',key_name='tempest-keypair-1800903172',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac7989e8c5da415a9ccf66845b0d831c',ramdisk_id='',reservation_id='r-bjzqt5n9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2021222373',owner_user_name='tempest-TaggedBootDevicesTest-2021222373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a68183c66ce484aa46ec2a4d897dac8',uuid=e2ec2788-98c7-48a7-933a-433dc215d7ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7cb8b02-8579-43e0-b058-2cbe69bf0edf", "address": "fa:16:3e:72:2b:2a", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cb8b02-85", "ovs_interfaceid": "d7cb8b02-8579-43e0-b058-2cbe69bf0edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converting VIF {"id": "d7cb8b02-8579-43e0-b058-2cbe69bf0edf", "address": "fa:16:3e:72:2b:2a", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cb8b02-85", "ovs_interfaceid": "d7cb8b02-8579-43e0-b058-2cbe69bf0edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:2b:2a,bridge_name='br-int',has_traffic_filtering=True,id=d7cb8b02-8579-43e0-b058-2cbe69bf0edf,network=Network(8af7a9e2-545f-4a40-9479-22ad7dabf51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd7cb8b02-85') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-147720369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-147720369',id=10,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE7N2igt88eWl9+0O3rw7Gr2O3Pf0Clh8aTrKtwxprjLw0oRrQ/YFniZCOny/ulFQwuklyMiP7yX5Gvlz/Qexsg2T/RwJg01QU3Il1Vw2dkTm55TZbc2b3skf3PilOX5A==',key_name='tempest-keypair-1800903172',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac7989e8c5da415a9ccf66845b0d831c',ramdisk_id='',reservation_id='r-bjzqt5n9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2021222373',owner_user_name='tempest-TaggedBootDevicesTest-2021222373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a68183c66ce484aa46ec2a4d897dac8',uuid=e2ec2788-98c7-48a7-933a-433dc215d7ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55fb8a61-3cfe-422c-af91-ca5199362cc7", "address": "fa:16:3e:04:77:77", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fb8a61-3c", "ovs_interfaceid": "55fb8a61-3cfe-422c-af91-ca5199362cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converting VIF {"id": "55fb8a61-3cfe-422c-af91-ca5199362cc7", "address": "fa:16:3e:04:77:77", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fb8a61-3c", "ovs_interfaceid": "55fb8a61-3cfe-422c-af91-ca5199362cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:77:77,bridge_name='br-int',has_traffic_filtering=True,id=55fb8a61-3cfe-422c-af91-ca5199362cc7,network=Network(8af7a9e2-545f-4a40-9479-22ad7dabf51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap55fb8a61-3c') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-147720369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-147720369',id=10,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE7N2igt88eWl9+0O3rw7Gr2O3Pf0Clh8aTrKtwxprjLw0oRrQ/YFniZCOny/ulFQwuklyMiP7yX5Gvlz/Qexsg2T/RwJg01QU3Il1Vw2dkTm55TZbc2b3skf3PilOX5A==',key_name='tempest-keypair-1800903172',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac7989e8c5da415a9ccf66845b0d831c',ramdisk_id='',reservation_id='r-bjzqt5n9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2021222373',owner_user_name='tempest-TaggedBootDevicesTest-2021222373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a68183c66ce484aa46ec2a4d897dac8',uuid=e2ec2788-98c7-48a7-933a-433dc215d7ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bb400c7-1a44-427c-a38e-860f71f92d31", "address": "fa:16:3e:33:83:63", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb400c7-1a", "ovs_interfaceid": "2bb400c7-1a44-427c-a38e-860f71f92d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converting VIF {"id": "2bb400c7-1a44-427c-a38e-860f71f92d31", "address": "fa:16:3e:33:83:63", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb400c7-1a", "ovs_interfaceid": "2bb400c7-1a44-427c-a38e-860f71f92d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:83:63,bridge_name='br-int',has_traffic_filtering=True,id=2bb400c7-1a44-427c-a38e-860f71f92d31,network=Network(8af7a9e2-545f-4a40-9479-22ad7dabf51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb400c7-1a') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-147720369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-147720369',id=10,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE7N2igt88eWl9+0O3rw7Gr2O3Pf0Clh8aTrKtwxprjLw0oRrQ/YFniZCOny/ulFQwuklyMiP7yX5Gvlz/Qexsg2T/RwJg01QU3Il1Vw2dkTm55TZbc2b3skf3PilOX5A==',key_name='tempest-keypair-1800903172',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac7989e8c5da415a9ccf66845b0d831c',ramdisk_id='',reservation_id='r-bjzqt5n9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2021222373',owner_user_name='tempest-TaggedBootDevicesTest-2021222373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a68183c66ce484aa46ec2a4d897dac8',uuid=e2ec2788-98c7-48a7-933a-433dc215d7ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0cf8f75c-539b-44d0-bc4a-a52f86a24d9c", "address": "fa:16:3e:50:f5:ca", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf8f75c-53", "ovs_interfaceid": "0cf8f75c-539b-44d0-bc4a-a52f86a24d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converting VIF {"id": "0cf8f75c-539b-44d0-bc4a-a52f86a24d9c", "address": "fa:16:3e:50:f5:ca", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf8f75c-53", "ovs_interfaceid": "0cf8f75c-539b-44d0-bc4a-a52f86a24d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:f5:ca,bridge_name='br-int',has_traffic_filtering=True,id=0cf8f75c-539b-44d0-bc4a-a52f86a24d9c,network=Network(8af7a9e2-545f-4a40-9479-22ad7dabf51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cf8f75c-53') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-147720369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-147720369',id=10,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE7N2igt88eWl9+0O3rw7Gr2O3Pf0Clh8aTrKtwxprjLw0oRrQ/YFniZCOny/ulFQwuklyMiP7yX5Gvlz/Qexsg2T/RwJg01QU3Il1Vw2dkTm55TZbc2b3skf3PilOX5A==',key_name='tempest-keypair-1800903172',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac7989e8c5da415a9ccf66845b0d831c',ramdisk_id='',reservation_id='r-bjzqt5n9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2021222373',owner_user_name='tempest-TaggedBootDevicesTest-2021222373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a68183c66ce484aa46ec2a4d897dac8',uuid=e2ec2788-98c7-48a7-933a-433dc215d7ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "971207c4-aee3-47f6-8fb4-ad7d7fc2827e", "address": "fa:16:3e:13:5e:a9", "network": {"id": "b98d43ff-51d0-4328-be34-b7c110358c95", "bridge": "br-int", "label": "tempest-device-tagging-net2-545564459", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap971207c4-ae", "ovs_interfaceid": "971207c4-aee3-47f6-8fb4-ad7d7fc2827e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converting VIF {"id": "971207c4-aee3-47f6-8fb4-ad7d7fc2827e", "address": "fa:16:3e:13:5e:a9", "network": {"id": "b98d43ff-51d0-4328-be34-b7c110358c95", "bridge": "br-int", "label": "tempest-device-tagging-net2-545564459", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap971207c4-ae", "ovs_interfaceid": "971207c4-aee3-47f6-8fb4-ad7d7fc2827e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:5e:a9,bridge_name='br-int',has_traffic_filtering=True,id=971207c4-aee3-47f6-8fb4-ad7d7fc2827e,network=Network(b98d43ff-51d0-4328-be34-b7c110358c95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap971207c4-ae') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-147720369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-147720369',id=10,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE7N2igt88eWl9+0O3rw7Gr2O3Pf0Clh8aTrKtwxprjLw0oRrQ/YFniZCOny/ulFQwuklyMiP7yX5Gvlz/Qexsg2T/RwJg01QU3Il1Vw2dkTm55TZbc2b3skf3PilOX5A==',key_name='tempest-keypair-1800903172',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac7989e8c5da415a9ccf66845b0d831c',ramdisk_id='',reservation_id='r-bjzqt5n9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2021222373',owner_user_name='tempest-TaggedBootDevicesTest-2021222373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a68183c66ce484aa46ec2a4d897dac8',uuid=e2ec2788-98c7-48a7-933a-433dc215d7ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1de67e88-3745-4d54-9b30-17d82513265f", "address": "fa:16:3e:b3:77:f4", "network": {"id": "b98d43ff-51d0-4328-be34-b7c110358c95", "bridge": "br-int", "label": "tempest-device-tagging-net2-545564459", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de67e88-37", "ovs_interfaceid": "1de67e88-3745-4d54-9b30-17d82513265f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converting VIF {"id": "1de67e88-3745-4d54-9b30-17d82513265f", "address": "fa:16:3e:b3:77:f4", "network": {"id": "b98d43ff-51d0-4328-be34-b7c110358c95", "bridge": "br-int", "label": "tempest-device-tagging-net2-545564459", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de67e88-37", "ovs_interfaceid": "1de67e88-3745-4d54-9b30-17d82513265f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:77:f4,bridge_name='br-int',has_traffic_filtering=True,id=1de67e88-3745-4d54-9b30-17d82513265f,network=Network(b98d43ff-51d0-4328-be34-b7c110358c95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1de67e88-37') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.objects.instance [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Lazy-loading 'pci_devices' on Instance uuid e2ec2788-98c7-48a7-933a-433dc215d7ec {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:39:12 user nova-compute[73104]:   <uuid>e2ec2788-98c7-48a7-933a-433dc215d7ec</uuid>
Aug 26 08:39:12 user nova-compute[73104]:   <name>instance-0000000a</name>
Aug 26 08:39:12 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:39:12 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:39:12 user nova-compute[73104]:   <metadata>
Aug 26 08:39:12 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:39:12 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:39:12 user nova-compute[73104]:       <nova:name>tempest-device-tagging-server-147720369</nova:name>
Aug 26 08:39:12 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:39:08</nova:creationTime>
Aug 26 08:39:12 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:39:12 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:39:12 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:39:12 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:39:12 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:39:12 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:39:12 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:39:12 user nova-compute[73104]:       <nova:owner>
Aug 26 08:39:12 user nova-compute[73104]:         <nova:user uuid="9a68183c66ce484aa46ec2a4d897dac8">tempest-TaggedBootDevicesTest-2021222373-project-member</nova:user>
Aug 26 08:39:12 user nova-compute[73104]:         <nova:project uuid="ac7989e8c5da415a9ccf66845b0d831c">tempest-TaggedBootDevicesTest-2021222373</nova:project>
Aug 26 08:39:12 user nova-compute[73104]:       </nova:owner>
Aug 26 08:39:12 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:39:12 user nova-compute[73104]:       <nova:ports>
Aug 26 08:39:12 user nova-compute[73104]:         <nova:port uuid="949f6e6c-727e-440c-b767-caf76f3f037e">
Aug 26 08:39:12 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 08:39:12 user nova-compute[73104]:         </nova:port>
Aug 26 08:39:12 user nova-compute[73104]:         <nova:port uuid="d7cb8b02-8579-43e0-b058-2cbe69bf0edf">
Aug 26 08:39:12 user nova-compute[73104]:           <nova:ip type="fixed" address="10.1.1.161" ipVersion="4"/>
Aug 26 08:39:12 user nova-compute[73104]:         </nova:port>
Aug 26 08:39:12 user nova-compute[73104]:         <nova:port uuid="55fb8a61-3cfe-422c-af91-ca5199362cc7">
Aug 26 08:39:12 user nova-compute[73104]:           <nova:ip type="fixed" address="10.1.1.45" ipVersion="4"/>
Aug 26 08:39:12 user nova-compute[73104]:         </nova:port>
Aug 26 08:39:12 user nova-compute[73104]:         <nova:port uuid="2bb400c7-1a44-427c-a38e-860f71f92d31">
Aug 26 08:39:12 user nova-compute[73104]:           <nova:ip type="fixed" address="10.1.1.231" ipVersion="4"/>
Aug 26 08:39:12 user nova-compute[73104]:         </nova:port>
Aug 26 08:39:12 user nova-compute[73104]:         <nova:port uuid="0cf8f75c-539b-44d0-bc4a-a52f86a24d9c">
Aug 26 08:39:12 user nova-compute[73104]:           <nova:ip type="fixed" address="10.1.1.10" ipVersion="4"/>
Aug 26 08:39:12 user nova-compute[73104]:         </nova:port>
Aug 26 08:39:12 user nova-compute[73104]:         <nova:port uuid="971207c4-aee3-47f6-8fb4-ad7d7fc2827e">
Aug 26 08:39:12 user nova-compute[73104]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 26 08:39:12 user nova-compute[73104]:         </nova:port>
Aug 26 08:39:12 user nova-compute[73104]:         <nova:port uuid="1de67e88-3745-4d54-9b30-17d82513265f">
Aug 26 08:39:12 user nova-compute[73104]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 26 08:39:12 user nova-compute[73104]:         </nova:port>
Aug 26 08:39:12 user nova-compute[73104]:       </nova:ports>
Aug 26 08:39:12 user nova-compute[73104]:     </nova:instance>
Aug 26 08:39:12 user nova-compute[73104]:   </metadata>
Aug 26 08:39:12 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:39:12 user nova-compute[73104]:     <system>
Aug 26 08:39:12 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:39:12 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:39:12 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:39:12 user nova-compute[73104]:       <entry name="serial">e2ec2788-98c7-48a7-933a-433dc215d7ec</entry>
Aug 26 08:39:12 user nova-compute[73104]:       <entry name="uuid">e2ec2788-98c7-48a7-933a-433dc215d7ec</entry>
Aug 26 08:39:12 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:39:12 user nova-compute[73104]:     </system>
Aug 26 08:39:12 user nova-compute[73104]:   </sysinfo>
Aug 26 08:39:12 user nova-compute[73104]:   <os>
Aug 26 08:39:12 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:39:12 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:39:12 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:39:12 user nova-compute[73104]:   </os>
Aug 26 08:39:12 user nova-compute[73104]:   <features>
Aug 26 08:39:12 user nova-compute[73104]:     <acpi/>
Aug 26 08:39:12 user nova-compute[73104]:     <apic/>
Aug 26 08:39:12 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:39:12 user nova-compute[73104]:   </features>
Aug 26 08:39:12 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:39:12 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:39:12 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:39:12 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:39:12 user nova-compute[73104]:   </clock>
Aug 26 08:39:12 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:39:12 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:39:12 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:39:12 user nova-compute[73104]:   </cpu>
Aug 26 08:39:12 user nova-compute[73104]:   <devices>
Aug 26 08:39:12 user nova-compute[73104]:     <disk type="file" device="cdrom">
Aug 26 08:39:12 user nova-compute[73104]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 08:39:12 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/e2ec2788-98c7-48a7-933a-433dc215d7ec/disk.config"/>
Aug 26 08:39:12 user nova-compute[73104]:       <target dev="hda" bus="ide"/>
Aug 26 08:39:12 user nova-compute[73104]:     </disk>
Aug 26 08:39:12 user nova-compute[73104]:     <disk type="block" device="disk">
Aug 26 08:39:12 user nova-compute[73104]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:39:12 user nova-compute[73104]:       <source dev="/dev/sdc"/>
Aug 26 08:39:12 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:39:12 user nova-compute[73104]:       <serial>99dfa21b-e82b-4526-ac24-50a4e0b66646</serial>
Aug 26 08:39:12 user nova-compute[73104]:     </disk>
Aug 26 08:39:12 user nova-compute[73104]:     <disk type="block" device="disk">
Aug 26 08:39:12 user nova-compute[73104]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:39:12 user nova-compute[73104]:       <source dev="/dev/sdd"/>
Aug 26 08:39:12 user nova-compute[73104]:       <target dev="vdb" bus="virtio"/>
Aug 26 08:39:12 user nova-compute[73104]:       <serial>311fdf7a-f6f3-413d-9f9b-a21e89f340dc</serial>
Aug 26 08:39:12 user nova-compute[73104]:     </disk>
Aug 26 08:39:12 user nova-compute[73104]:     <disk type="block" device="disk">
Aug 26 08:39:12 user nova-compute[73104]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:39:12 user nova-compute[73104]:       <source dev="/dev/sdb"/>
Aug 26 08:39:12 user nova-compute[73104]:       <target dev="vdc" bus="virtio"/>
Aug 26 08:39:12 user nova-compute[73104]:       <serial>3e8a725f-797a-49df-a71e-4672e30f9d6f</serial>
Aug 26 08:39:12 user nova-compute[73104]:     </disk>
Aug 26 08:39:12 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:39:12 user nova-compute[73104]:       <mac address="fa:16:3e:a4:00:26"/>
Aug 26 08:39:12 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:39:12 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:39:12 user nova-compute[73104]:       <target dev="tap949f6e6c-72"/>
Aug 26 08:39:12 user nova-compute[73104]:     </interface>
Aug 26 08:39:12 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:39:12 user nova-compute[73104]:       <mac address="fa:16:3e:72:2b:2a"/>
Aug 26 08:39:12 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:39:12 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:39:12 user nova-compute[73104]:       <target dev="tapd7cb8b02-85"/>
Aug 26 08:39:12 user nova-compute[73104]:     </interface>
Aug 26 08:39:12 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:39:12 user nova-compute[73104]:       <mac address="fa:16:3e:04:77:77"/>
Aug 26 08:39:12 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:39:12 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:39:12 user nova-compute[73104]:       <target dev="tap55fb8a61-3c"/>
Aug 26 08:39:12 user nova-compute[73104]:     </interface>
Aug 26 08:39:12 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:39:12 user nova-compute[73104]:       <mac address="fa:16:3e:33:83:63"/>
Aug 26 08:39:12 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:39:12 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:39:12 user nova-compute[73104]:       <target dev="tap2bb400c7-1a"/>
Aug 26 08:39:12 user nova-compute[73104]:     </interface>
Aug 26 08:39:12 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:39:12 user nova-compute[73104]:       <mac address="fa:16:3e:50:f5:ca"/>
Aug 26 08:39:12 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:39:12 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:39:12 user nova-compute[73104]:       <target dev="tap0cf8f75c-53"/>
Aug 26 08:39:12 user nova-compute[73104]:     </interface>
Aug 26 08:39:12 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:39:12 user nova-compute[73104]:       <mac address="fa:16:3e:13:5e:a9"/>
Aug 26 08:39:12 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:39:12 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:39:12 user nova-compute[73104]:       <target dev="tap971207c4-ae"/>
Aug 26 08:39:12 user nova-compute[73104]:     </interface>
Aug 26 08:39:12 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:39:12 user nova-compute[73104]:       <mac address="fa:16:3e:b3:77:f4"/>
Aug 26 08:39:12 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:39:12 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:39:12 user nova-compute[73104]:       <target dev="tap1de67e88-37"/>
Aug 26 08:39:12 user nova-compute[73104]:     </interface>
Aug 26 08:39:12 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:39:12 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/e2ec2788-98c7-48a7-933a-433dc215d7ec/console.log" append="off"/>
Aug 26 08:39:12 user nova-compute[73104]:     </serial>
Aug 26 08:39:12 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:39:12 user nova-compute[73104]:     <video>
Aug 26 08:39:12 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:39:12 user nova-compute[73104]:     </video>
Aug 26 08:39:12 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:39:12 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:39:12 user nova-compute[73104]:     </rng>
Aug 26 08:39:12 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:39:12 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:39:12 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:39:12 user nova-compute[73104]:     </memballoon>
Aug 26 08:39:12 user nova-compute[73104]:   </devices>
Aug 26 08:39:12 user nova-compute[73104]: </domain>
Aug 26 08:39:12 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-147720369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-147720369',id=10,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE7N2igt88eWl9+0O3rw7Gr2O3Pf0Clh8aTrKtwxprjLw0oRrQ/YFniZCOny/ulFQwuklyMiP7yX5Gvlz/Qexsg2T/RwJg01QU3Il1Vw2dkTm55TZbc2b3skf3PilOX5A==',key_name='tempest-keypair-1800903172',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac7989e8c5da415a9ccf66845b0d831c',ramdisk_id='',reservation_id='r-bjzqt5n9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2021222373',owner_user_name='tempest-TaggedBootDevicesTest-2021222373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a68183c66ce484aa46ec2a4d897dac8',uuid=e2ec2788-98c7-48a7-933a-433dc215d7ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "949f6e6c-727e-440c-b767-caf76f3f037e", "address": "fa:16:3e:a4:00:26", "network": {"id": "0941b2d8-176a-403b-a9bf-4a4d0de5bcc0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-890813398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap949f6e6c-72", "ovs_interfaceid": "949f6e6c-727e-440c-b767-caf76f3f037e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converting VIF {"id": "949f6e6c-727e-440c-b767-caf76f3f037e", "address": "fa:16:3e:a4:00:26", "network": {"id": "0941b2d8-176a-403b-a9bf-4a4d0de5bcc0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-890813398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap949f6e6c-72", "ovs_interfaceid": "949f6e6c-727e-440c-b767-caf76f3f037e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:00:26,bridge_name='br-int',has_traffic_filtering=True,id=949f6e6c-727e-440c-b767-caf76f3f037e,network=Network(0941b2d8-176a-403b-a9bf-4a4d0de5bcc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap949f6e6c-72') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG os_vif [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:00:26,bridge_name='br-int',has_traffic_filtering=True,id=949f6e6c-727e-440c-b767-caf76f3f037e,network=Network(0941b2d8-176a-403b-a9bf-4a4d0de5bcc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap949f6e6c-72') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap949f6e6c-72, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap949f6e6c-72, col_values=(('external_ids', {'iface-id': '949f6e6c-727e-440c-b767-caf76f3f037e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:00:26', 'vm-uuid': 'e2ec2788-98c7-48a7-933a-433dc215d7ec'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:39:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:12 user nova-compute[73104]: INFO os_vif [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:00:26,bridge_name='br-int',has_traffic_filtering=True,id=949f6e6c-727e-440c-b767-caf76f3f037e,network=Network(0941b2d8-176a-403b-a9bf-4a4d0de5bcc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap949f6e6c-72')
Aug 26 08:39:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-147720369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-147720369',id=10,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE7N2igt88eWl9+0O3rw7Gr2O3Pf0Clh8aTrKtwxprjLw0oRrQ/YFniZCOny/ulFQwuklyMiP7yX5Gvlz/Qexsg2T/RwJg01QU3Il1Vw2dkTm55TZbc2b3skf3PilOX5A==',key_name='tempest-keypair-1800903172',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac7989e8c5da415a9ccf66845b0d831c',ramdisk_id='',reservation_id='r-bjzqt5n9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2021222373',owner_user_name='tempest-TaggedBootDevicesTest-2021222373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a68183c66ce484aa46ec2a4d897dac8',uuid=e2ec2788-98c7-48a7-933a-433dc215d7ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7cb8b02-8579-43e0-b058-2cbe69bf0edf", "address": "fa:16:3e:72:2b:2a", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cb8b02-85", "ovs_interfaceid": "d7cb8b02-8579-43e0-b058-2cbe69bf0edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converting VIF {"id": "d7cb8b02-8579-43e0-b058-2cbe69bf0edf", "address": "fa:16:3e:72:2b:2a", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cb8b02-85", "ovs_interfaceid": "d7cb8b02-8579-43e0-b058-2cbe69bf0edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:2b:2a,bridge_name='br-int',has_traffic_filtering=True,id=d7cb8b02-8579-43e0-b058-2cbe69bf0edf,network=Network(8af7a9e2-545f-4a40-9479-22ad7dabf51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd7cb8b02-85') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG os_vif [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:2b:2a,bridge_name='br-int',has_traffic_filtering=True,id=d7cb8b02-8579-43e0-b058-2cbe69bf0edf,network=Network(8af7a9e2-545f-4a40-9479-22ad7dabf51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd7cb8b02-85') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7cb8b02-85, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd7cb8b02-85, col_values=(('external_ids', {'iface-id': 'd7cb8b02-8579-43e0-b058-2cbe69bf0edf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:2b:2a', 'vm-uuid': 'e2ec2788-98c7-48a7-933a-433dc215d7ec'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:13 user nova-compute[73104]: INFO os_vif [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:2b:2a,bridge_name='br-int',has_traffic_filtering=True,id=d7cb8b02-8579-43e0-b058-2cbe69bf0edf,network=Network(8af7a9e2-545f-4a40-9479-22ad7dabf51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd7cb8b02-85')
Aug 26 08:39:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-147720369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-147720369',id=10,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE7N2igt88eWl9+0O3rw7Gr2O3Pf0Clh8aTrKtwxprjLw0oRrQ/YFniZCOny/ulFQwuklyMiP7yX5Gvlz/Qexsg2T/RwJg01QU3Il1Vw2dkTm55TZbc2b3skf3PilOX5A==',key_name='tempest-keypair-1800903172',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac7989e8c5da415a9ccf66845b0d831c',ramdisk_id='',reservation_id='r-bjzqt5n9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2021222373',owner_user_name='tempest-TaggedBootDevicesTest-2021222373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a68183c66ce484aa46ec2a4d897dac8',uuid=e2ec2788-98c7-48a7-933a-433dc215d7ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55fb8a61-3cfe-422c-af91-ca5199362cc7", "address": "fa:16:3e:04:77:77", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fb8a61-3c", "ovs_interfaceid": "55fb8a61-3cfe-422c-af91-ca5199362cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converting VIF {"id": "55fb8a61-3cfe-422c-af91-ca5199362cc7", "address": "fa:16:3e:04:77:77", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fb8a61-3c", "ovs_interfaceid": "55fb8a61-3cfe-422c-af91-ca5199362cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:77:77,bridge_name='br-int',has_traffic_filtering=True,id=55fb8a61-3cfe-422c-af91-ca5199362cc7,network=Network(8af7a9e2-545f-4a40-9479-22ad7dabf51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap55fb8a61-3c') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG os_vif [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:77:77,bridge_name='br-int',has_traffic_filtering=True,id=55fb8a61-3cfe-422c-af91-ca5199362cc7,network=Network(8af7a9e2-545f-4a40-9479-22ad7dabf51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap55fb8a61-3c') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55fb8a61-3c, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap55fb8a61-3c, col_values=(('external_ids', {'iface-id': '55fb8a61-3cfe-422c-af91-ca5199362cc7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:77:77', 'vm-uuid': 'e2ec2788-98c7-48a7-933a-433dc215d7ec'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:13 user nova-compute[73104]: INFO os_vif [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:77:77,bridge_name='br-int',has_traffic_filtering=True,id=55fb8a61-3cfe-422c-af91-ca5199362cc7,network=Network(8af7a9e2-545f-4a40-9479-22ad7dabf51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap55fb8a61-3c')
Aug 26 08:39:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-147720369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-147720369',id=10,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE7N2igt88eWl9+0O3rw7Gr2O3Pf0Clh8aTrKtwxprjLw0oRrQ/YFniZCOny/ulFQwuklyMiP7yX5Gvlz/Qexsg2T/RwJg01QU3Il1Vw2dkTm55TZbc2b3skf3PilOX5A==',key_name='tempest-keypair-1800903172',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac7989e8c5da415a9ccf66845b0d831c',ramdisk_id='',reservation_id='r-bjzqt5n9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2021222373',owner_user_name='tempest-TaggedBootDevicesTest-2021222373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a68183c66ce484aa46ec2a4d897dac8',uuid=e2ec2788-98c7-48a7-933a-433dc215d7ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bb400c7-1a44-427c-a38e-860f71f92d31", "address": "fa:16:3e:33:83:63", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb400c7-1a", "ovs_interfaceid": "2bb400c7-1a44-427c-a38e-860f71f92d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converting VIF {"id": "2bb400c7-1a44-427c-a38e-860f71f92d31", "address": "fa:16:3e:33:83:63", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb400c7-1a", "ovs_interfaceid": "2bb400c7-1a44-427c-a38e-860f71f92d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:83:63,bridge_name='br-int',has_traffic_filtering=True,id=2bb400c7-1a44-427c-a38e-860f71f92d31,network=Network(8af7a9e2-545f-4a40-9479-22ad7dabf51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb400c7-1a') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG os_vif [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:83:63,bridge_name='br-int',has_traffic_filtering=True,id=2bb400c7-1a44-427c-a38e-860f71f92d31,network=Network(8af7a9e2-545f-4a40-9479-22ad7dabf51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb400c7-1a') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2bb400c7-1a, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2bb400c7-1a, col_values=(('external_ids', {'iface-id': '2bb400c7-1a44-427c-a38e-860f71f92d31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:83:63', 'vm-uuid': 'e2ec2788-98c7-48a7-933a-433dc215d7ec'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:13 user nova-compute[73104]: INFO os_vif [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:83:63,bridge_name='br-int',has_traffic_filtering=True,id=2bb400c7-1a44-427c-a38e-860f71f92d31,network=Network(8af7a9e2-545f-4a40-9479-22ad7dabf51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb400c7-1a')
Aug 26 08:39:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-147720369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-147720369',id=10,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE7N2igt88eWl9+0O3rw7Gr2O3Pf0Clh8aTrKtwxprjLw0oRrQ/YFniZCOny/ulFQwuklyMiP7yX5Gvlz/Qexsg2T/RwJg01QU3Il1Vw2dkTm55TZbc2b3skf3PilOX5A==',key_name='tempest-keypair-1800903172',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac7989e8c5da415a9ccf66845b0d831c',ramdisk_id='',reservation_id='r-bjzqt5n9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2021222373',owner_user_name='tempest-TaggedBootDevicesTest-2021222373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a68183c66ce484aa46ec2a4d897dac8',uuid=e2ec2788-98c7-48a7-933a-433dc215d7ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0cf8f75c-539b-44d0-bc4a-a52f86a24d9c", "address": "fa:16:3e:50:f5:ca", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf8f75c-53", "ovs_interfaceid": "0cf8f75c-539b-44d0-bc4a-a52f86a24d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converting VIF {"id": "0cf8f75c-539b-44d0-bc4a-a52f86a24d9c", "address": "fa:16:3e:50:f5:ca", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf8f75c-53", "ovs_interfaceid": "0cf8f75c-539b-44d0-bc4a-a52f86a24d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:f5:ca,bridge_name='br-int',has_traffic_filtering=True,id=0cf8f75c-539b-44d0-bc4a-a52f86a24d9c,network=Network(8af7a9e2-545f-4a40-9479-22ad7dabf51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cf8f75c-53') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG os_vif [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:f5:ca,bridge_name='br-int',has_traffic_filtering=True,id=0cf8f75c-539b-44d0-bc4a-a52f86a24d9c,network=Network(8af7a9e2-545f-4a40-9479-22ad7dabf51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cf8f75c-53') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0cf8f75c-53, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0cf8f75c-53, col_values=(('external_ids', {'iface-id': '0cf8f75c-539b-44d0-bc4a-a52f86a24d9c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:f5:ca', 'vm-uuid': 'e2ec2788-98c7-48a7-933a-433dc215d7ec'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:13 user nova-compute[73104]: INFO os_vif [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:f5:ca,bridge_name='br-int',has_traffic_filtering=True,id=0cf8f75c-539b-44d0-bc4a-a52f86a24d9c,network=Network(8af7a9e2-545f-4a40-9479-22ad7dabf51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cf8f75c-53')
Aug 26 08:39:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-147720369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-147720369',id=10,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE7N2igt88eWl9+0O3rw7Gr2O3Pf0Clh8aTrKtwxprjLw0oRrQ/YFniZCOny/ulFQwuklyMiP7yX5Gvlz/Qexsg2T/RwJg01QU3Il1Vw2dkTm55TZbc2b3skf3PilOX5A==',key_name='tempest-keypair-1800903172',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac7989e8c5da415a9ccf66845b0d831c',ramdisk_id='',reservation_id='r-bjzqt5n9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2021222373',owner_user_name='tempest-TaggedBootDevicesTest-2021222373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a68183c66ce484aa46ec2a4d897dac8',uuid=e2ec2788-98c7-48a7-933a-433dc215d7ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "971207c4-aee3-47f6-8fb4-ad7d7fc2827e", "address": "fa:16:3e:13:5e:a9", "network": {"id": "b98d43ff-51d0-4328-be34-b7c110358c95", "bridge": "br-int", "label": "tempest-device-tagging-net2-545564459", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap971207c4-ae", "ovs_interfaceid": "971207c4-aee3-47f6-8fb4-ad7d7fc2827e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converting VIF {"id": "971207c4-aee3-47f6-8fb4-ad7d7fc2827e", "address": "fa:16:3e:13:5e:a9", "network": {"id": "b98d43ff-51d0-4328-be34-b7c110358c95", "bridge": "br-int", "label": "tempest-device-tagging-net2-545564459", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap971207c4-ae", "ovs_interfaceid": "971207c4-aee3-47f6-8fb4-ad7d7fc2827e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:5e:a9,bridge_name='br-int',has_traffic_filtering=True,id=971207c4-aee3-47f6-8fb4-ad7d7fc2827e,network=Network(b98d43ff-51d0-4328-be34-b7c110358c95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap971207c4-ae') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG os_vif [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:5e:a9,bridge_name='br-int',has_traffic_filtering=True,id=971207c4-aee3-47f6-8fb4-ad7d7fc2827e,network=Network(b98d43ff-51d0-4328-be34-b7c110358c95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap971207c4-ae') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:39:13 user nova-compute[73104]: INFO nova.compute.manager [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Took 1.21 seconds to detach 1 volumes for instance.
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap971207c4-ae, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap971207c4-ae, col_values=(('external_ids', {'iface-id': '971207c4-aee3-47f6-8fb4-ad7d7fc2827e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:5e:a9', 'vm-uuid': 'e2ec2788-98c7-48a7-933a-433dc215d7ec'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:13 user nova-compute[73104]: INFO os_vif [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:5e:a9,bridge_name='br-int',has_traffic_filtering=True,id=971207c4-aee3-47f6-8fb4-ad7d7fc2827e,network=Network(b98d43ff-51d0-4328-be34-b7c110358c95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap971207c4-ae')
Aug 26 08:39:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-147720369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-147720369',id=10,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE7N2igt88eWl9+0O3rw7Gr2O3Pf0Clh8aTrKtwxprjLw0oRrQ/YFniZCOny/ulFQwuklyMiP7yX5Gvlz/Qexsg2T/RwJg01QU3Il1Vw2dkTm55TZbc2b3skf3PilOX5A==',key_name='tempest-keypair-1800903172',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac7989e8c5da415a9ccf66845b0d831c',ramdisk_id='',reservation_id='r-bjzqt5n9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2021222373',owner_user_name='tempest-TaggedBootDevicesTest-2021222373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a68183c66ce484aa46ec2a4d897dac8',uuid=e2ec2788-98c7-48a7-933a-433dc215d7ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1de67e88-3745-4d54-9b30-17d82513265f", "address": "fa:16:3e:b3:77:f4", "network": {"id": "b98d43ff-51d0-4328-be34-b7c110358c95", "bridge": "br-int", "label": "tempest-device-tagging-net2-545564459", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de67e88-37", "ovs_interfaceid": "1de67e88-3745-4d54-9b30-17d82513265f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converting VIF {"id": "1de67e88-3745-4d54-9b30-17d82513265f", "address": "fa:16:3e:b3:77:f4", "network": {"id": "b98d43ff-51d0-4328-be34-b7c110358c95", "bridge": "br-int", "label": "tempest-device-tagging-net2-545564459", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de67e88-37", "ovs_interfaceid": "1de67e88-3745-4d54-9b30-17d82513265f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:77:f4,bridge_name='br-int',has_traffic_filtering=True,id=1de67e88-3745-4d54-9b30-17d82513265f,network=Network(b98d43ff-51d0-4328-be34-b7c110358c95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1de67e88-37') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG os_vif [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:77:f4,bridge_name='br-int',has_traffic_filtering=True,id=1de67e88-3745-4d54-9b30-17d82513265f,network=Network(b98d43ff-51d0-4328-be34-b7c110358c95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1de67e88-37') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1de67e88-37, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1de67e88-37, col_values=(('external_ids', {'iface-id': '1de67e88-3745-4d54-9b30-17d82513265f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:77:f4', 'vm-uuid': 'e2ec2788-98c7-48a7-933a-433dc215d7ec'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:13 user nova-compute[73104]: INFO os_vif [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:77:f4,bridge_name='br-int',has_traffic_filtering=True,id=1de67e88-3745-4d54-9b30-17d82513265f,network=Network(b98d43ff-51d0-4328-be34-b7c110358c95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1de67e88-37')
Aug 26 08:39:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] No BDM found with device name hda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] No VIF found with MAC fa:16:3e:a4:00:26, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:39:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] No VIF found with MAC fa:16:3e:50:f5:ca, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:39:13 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Using config drive
Aug 26 08:39:14 user nova-compute[73104]: DEBUG nova.compute.manager [req-0c3e2d0a-a0f1-454a-9428-606e9c0b01e2 req-a997c04e-bb23-4ca9-9afc-9d9f5d4e78b4 service nova] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Received event network-vif-deleted-911335fb-63d7-4381-ac34-a47bb61d2b7e {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:14 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:39:14 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:39:14 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Creating config drive at /opt/stack/data/nova/instances/e2ec2788-98c7-48a7-933a-433dc215d7ec/disk.config
Aug 26 08:39:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e2ec2788-98c7-48a7-933a-433dc215d7ec/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfdya9eph {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.876s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e2ec2788-98c7-48a7-933a-433dc215d7ec/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfdya9eph" returned: 0 in 0.070s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:14 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Deleted allocations for instance 995a2bd3-4c54-4217-ae9f-056353008547
Aug 26 08:39:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0fa8dded-cb7e-4ade-9a52-4ea773721985 tempest-DeleteServersTestJSON-1633599130 tempest-DeleteServersTestJSON-1633599130-project-member] Lock "995a2bd3-4c54-4217-ae9f-056353008547" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.983s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Acquiring lock "afe2c15e-4e27-47f3-8b0b-426f4b8619d1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lock "afe2c15e-4e27-47f3-8b0b-426f4b8619d1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG nova.objects.instance [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lazy-loading 'flavor' on Instance uuid afe2c15e-4e27-47f3-8b0b-426f4b8619d1 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lock "afe2c15e-4e27-47f3-8b0b-426f4b8619d1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.103s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-0a2ce5e7-c8da-4402-8af4-37710811ffcb req-c7216b75-7381-4382-a9fa-a1f6c5a9d93d service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-plugged-949f6e6c-727e-440c-b767-caf76f3f037e {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0a2ce5e7-c8da-4402-8af4-37710811ffcb req-c7216b75-7381-4382-a9fa-a1f6c5a9d93d service nova] Acquiring lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0a2ce5e7-c8da-4402-8af4-37710811ffcb req-c7216b75-7381-4382-a9fa-a1f6c5a9d93d service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0a2ce5e7-c8da-4402-8af4-37710811ffcb req-c7216b75-7381-4382-a9fa-a1f6c5a9d93d service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-0a2ce5e7-c8da-4402-8af4-37710811ffcb req-c7216b75-7381-4382-a9fa-a1f6c5a9d93d service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] No waiting events found dispatching network-vif-plugged-949f6e6c-727e-440c-b767-caf76f3f037e {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:16 user nova-compute[73104]: WARNING nova.compute.manager [req-0a2ce5e7-c8da-4402-8af4-37710811ffcb req-c7216b75-7381-4382-a9fa-a1f6c5a9d93d service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received unexpected event network-vif-plugged-949f6e6c-727e-440c-b767-caf76f3f037e for instance with vm_state building and task_state spawning.
Aug 26 08:39:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Acquiring lock "afe2c15e-4e27-47f3-8b0b-426f4b8619d1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lock "afe2c15e-4e27-47f3-8b0b-426f4b8619d1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:16 user nova-compute[73104]: INFO nova.compute.manager [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Attaching volume 897008b6-2f81-4d7b-b5a9-8b3bbc809d24 to /dev/sdc
Aug 26 08:39:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG os_brick.utils [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d5f24f-146b-4790-ae20-9467b45b7ecf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60c9a13-4c20-4658-a8a6-266ea701ae02]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47fec7a-a707-4455-bc44-f0feb88b05fa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[080b8bed-4a5a-457f-865c-d6e950dd311b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:39:16 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:39:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[74303928-ffda-435b-8de7-6f610ebc4010]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG os_brick.utils [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Updating existing volume attachment record: 51ec04b6-1451-4bc2-ba00-88263eed7d8b {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-e9b39429-f0f1-44ac-9bcf-28624e2fe497 req-e1ae0add-5f2f-4edf-9ec9-cd0c61167c69 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-plugged-d7cb8b02-8579-43e0-b058-2cbe69bf0edf {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e9b39429-f0f1-44ac-9bcf-28624e2fe497 req-e1ae0add-5f2f-4edf-9ec9-cd0c61167c69 service nova] Acquiring lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e9b39429-f0f1-44ac-9bcf-28624e2fe497 req-e1ae0add-5f2f-4edf-9ec9-cd0c61167c69 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e9b39429-f0f1-44ac-9bcf-28624e2fe497 req-e1ae0add-5f2f-4edf-9ec9-cd0c61167c69 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-e9b39429-f0f1-44ac-9bcf-28624e2fe497 req-e1ae0add-5f2f-4edf-9ec9-cd0c61167c69 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] No waiting events found dispatching network-vif-plugged-d7cb8b02-8579-43e0-b058-2cbe69bf0edf {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:16 user nova-compute[73104]: WARNING nova.compute.manager [req-e9b39429-f0f1-44ac-9bcf-28624e2fe497 req-e1ae0add-5f2f-4edf-9ec9-cd0c61167c69 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received unexpected event network-vif-plugged-d7cb8b02-8579-43e0-b058-2cbe69bf0edf for instance with vm_state building and task_state spawning.
Aug 26 08:39:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:18 user nova-compute[73104]: DEBUG nova.compute.manager [req-b29724b4-47de-476c-be6c-1880e042d75d req-57ba7e3f-d75e-4b18-9b98-ef24af70fcf0 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-plugged-949f6e6c-727e-440c-b767-caf76f3f037e {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b29724b4-47de-476c-be6c-1880e042d75d req-57ba7e3f-d75e-4b18-9b98-ef24af70fcf0 service nova] Acquiring lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b29724b4-47de-476c-be6c-1880e042d75d req-57ba7e3f-d75e-4b18-9b98-ef24af70fcf0 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b29724b4-47de-476c-be6c-1880e042d75d req-57ba7e3f-d75e-4b18-9b98-ef24af70fcf0 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:18 user nova-compute[73104]: DEBUG nova.compute.manager [req-b29724b4-47de-476c-be6c-1880e042d75d req-57ba7e3f-d75e-4b18-9b98-ef24af70fcf0 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] No waiting events found dispatching network-vif-plugged-949f6e6c-727e-440c-b767-caf76f3f037e {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:18 user nova-compute[73104]: WARNING nova.compute.manager [req-b29724b4-47de-476c-be6c-1880e042d75d req-57ba7e3f-d75e-4b18-9b98-ef24af70fcf0 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received unexpected event network-vif-plugged-949f6e6c-727e-440c-b767-caf76f3f037e for instance with vm_state building and task_state spawning.
Aug 26 08:39:18 user nova-compute[73104]: DEBUG nova.compute.manager [req-b29724b4-47de-476c-be6c-1880e042d75d req-57ba7e3f-d75e-4b18-9b98-ef24af70fcf0 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-plugged-55fb8a61-3cfe-422c-af91-ca5199362cc7 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b29724b4-47de-476c-be6c-1880e042d75d req-57ba7e3f-d75e-4b18-9b98-ef24af70fcf0 service nova] Acquiring lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b29724b4-47de-476c-be6c-1880e042d75d req-57ba7e3f-d75e-4b18-9b98-ef24af70fcf0 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b29724b4-47de-476c-be6c-1880e042d75d req-57ba7e3f-d75e-4b18-9b98-ef24af70fcf0 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:18 user nova-compute[73104]: DEBUG nova.compute.manager [req-b29724b4-47de-476c-be6c-1880e042d75d req-57ba7e3f-d75e-4b18-9b98-ef24af70fcf0 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] No waiting events found dispatching network-vif-plugged-55fb8a61-3cfe-422c-af91-ca5199362cc7 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:18 user nova-compute[73104]: WARNING nova.compute.manager [req-b29724b4-47de-476c-be6c-1880e042d75d req-57ba7e3f-d75e-4b18-9b98-ef24af70fcf0 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received unexpected event network-vif-plugged-55fb8a61-3cfe-422c-af91-ca5199362cc7 for instance with vm_state building and task_state spawning.
Aug 26 08:39:18 user nova-compute[73104]: DEBUG nova.compute.manager [req-b29724b4-47de-476c-be6c-1880e042d75d req-57ba7e3f-d75e-4b18-9b98-ef24af70fcf0 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-plugged-55fb8a61-3cfe-422c-af91-ca5199362cc7 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b29724b4-47de-476c-be6c-1880e042d75d req-57ba7e3f-d75e-4b18-9b98-ef24af70fcf0 service nova] Acquiring lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b29724b4-47de-476c-be6c-1880e042d75d req-57ba7e3f-d75e-4b18-9b98-ef24af70fcf0 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b29724b4-47de-476c-be6c-1880e042d75d req-57ba7e3f-d75e-4b18-9b98-ef24af70fcf0 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:18 user nova-compute[73104]: DEBUG nova.compute.manager [req-b29724b4-47de-476c-be6c-1880e042d75d req-57ba7e3f-d75e-4b18-9b98-ef24af70fcf0 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] No waiting events found dispatching network-vif-plugged-55fb8a61-3cfe-422c-af91-ca5199362cc7 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:18 user nova-compute[73104]: WARNING nova.compute.manager [req-b29724b4-47de-476c-be6c-1880e042d75d req-57ba7e3f-d75e-4b18-9b98-ef24af70fcf0 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received unexpected event network-vif-plugged-55fb8a61-3cfe-422c-af91-ca5199362cc7 for instance with vm_state building and task_state spawning.
Aug 26 08:39:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:18 user nova-compute[73104]: DEBUG nova.compute.manager [req-99763c27-6b39-44f5-9360-45caa5376f20 req-a9410d4b-f1f1-4f18-bf0e-dbf257b23dab service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-plugged-d7cb8b02-8579-43e0-b058-2cbe69bf0edf {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-99763c27-6b39-44f5-9360-45caa5376f20 req-a9410d4b-f1f1-4f18-bf0e-dbf257b23dab service nova] Acquiring lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-99763c27-6b39-44f5-9360-45caa5376f20 req-a9410d4b-f1f1-4f18-bf0e-dbf257b23dab service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-99763c27-6b39-44f5-9360-45caa5376f20 req-a9410d4b-f1f1-4f18-bf0e-dbf257b23dab service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:18 user nova-compute[73104]: DEBUG nova.compute.manager [req-99763c27-6b39-44f5-9360-45caa5376f20 req-a9410d4b-f1f1-4f18-bf0e-dbf257b23dab service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] No waiting events found dispatching network-vif-plugged-d7cb8b02-8579-43e0-b058-2cbe69bf0edf {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:18 user nova-compute[73104]: WARNING nova.compute.manager [req-99763c27-6b39-44f5-9360-45caa5376f20 req-a9410d4b-f1f1-4f18-bf0e-dbf257b23dab service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received unexpected event network-vif-plugged-d7cb8b02-8579-43e0-b058-2cbe69bf0edf for instance with vm_state building and task_state spawning.
Aug 26 08:39:18 user nova-compute[73104]: DEBUG nova.compute.manager [req-99763c27-6b39-44f5-9360-45caa5376f20 req-a9410d4b-f1f1-4f18-bf0e-dbf257b23dab service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-plugged-2bb400c7-1a44-427c-a38e-860f71f92d31 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-99763c27-6b39-44f5-9360-45caa5376f20 req-a9410d4b-f1f1-4f18-bf0e-dbf257b23dab service nova] Acquiring lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-99763c27-6b39-44f5-9360-45caa5376f20 req-a9410d4b-f1f1-4f18-bf0e-dbf257b23dab service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-99763c27-6b39-44f5-9360-45caa5376f20 req-a9410d4b-f1f1-4f18-bf0e-dbf257b23dab service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:18 user nova-compute[73104]: DEBUG nova.compute.manager [req-99763c27-6b39-44f5-9360-45caa5376f20 req-a9410d4b-f1f1-4f18-bf0e-dbf257b23dab service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] No waiting events found dispatching network-vif-plugged-2bb400c7-1a44-427c-a38e-860f71f92d31 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:18 user nova-compute[73104]: WARNING nova.compute.manager [req-99763c27-6b39-44f5-9360-45caa5376f20 req-a9410d4b-f1f1-4f18-bf0e-dbf257b23dab service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received unexpected event network-vif-plugged-2bb400c7-1a44-427c-a38e-860f71f92d31 for instance with vm_state building and task_state spawning.
Aug 26 08:39:18 user nova-compute[73104]: DEBUG nova.compute.manager [req-99763c27-6b39-44f5-9360-45caa5376f20 req-a9410d4b-f1f1-4f18-bf0e-dbf257b23dab service nova] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Received event network-changed-af8b0ae5-581c-4096-98de-4442fe942572 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:18 user nova-compute[73104]: DEBUG nova.compute.manager [req-99763c27-6b39-44f5-9360-45caa5376f20 req-a9410d4b-f1f1-4f18-bf0e-dbf257b23dab service nova] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Refreshing instance network info cache due to event network-changed-af8b0ae5-581c-4096-98de-4442fe942572. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:39:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-99763c27-6b39-44f5-9360-45caa5376f20 req-a9410d4b-f1f1-4f18-bf0e-dbf257b23dab service nova] Acquiring lock "refresh_cache-93244bcd-34be-46f3-85e6-87bb5e69888d" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:39:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-99763c27-6b39-44f5-9360-45caa5376f20 req-a9410d4b-f1f1-4f18-bf0e-dbf257b23dab service nova] Acquired lock "refresh_cache-93244bcd-34be-46f3-85e6-87bb5e69888d" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:39:18 user nova-compute[73104]: DEBUG nova.network.neutron [req-99763c27-6b39-44f5-9360-45caa5376f20 req-a9410d4b-f1f1-4f18-bf0e-dbf257b23dab service nova] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Refreshing network info cache for port af8b0ae5-581c-4096-98de-4442fe942572 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:39:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:19 user nova-compute[73104]: DEBUG nova.network.neutron [req-99763c27-6b39-44f5-9360-45caa5376f20 req-a9410d4b-f1f1-4f18-bf0e-dbf257b23dab service nova] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Updated VIF entry in instance network info cache for port af8b0ae5-581c-4096-98de-4442fe942572. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:39:19 user nova-compute[73104]: DEBUG nova.network.neutron [req-99763c27-6b39-44f5-9360-45caa5376f20 req-a9410d4b-f1f1-4f18-bf0e-dbf257b23dab service nova] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Updating instance_info_cache with network_info: [{"id": "af8b0ae5-581c-4096-98de-4442fe942572", "address": "fa:16:3e:d5:84:96", "network": {"id": "58299b40-db54-4ba9-b4aa-8a40f0c2c2d4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-295087397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef6f6e226b23400481b2ad063356bc06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8b0ae5-58", "ovs_interfaceid": "af8b0ae5-581c-4096-98de-4442fe942572", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:39:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-99763c27-6b39-44f5-9360-45caa5376f20 req-a9410d4b-f1f1-4f18-bf0e-dbf257b23dab service nova] Releasing lock "refresh_cache-93244bcd-34be-46f3-85e6-87bb5e69888d" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:39:19 user nova-compute[73104]: DEBUG nova.compute.manager [req-99763c27-6b39-44f5-9360-45caa5376f20 req-a9410d4b-f1f1-4f18-bf0e-dbf257b23dab service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-plugged-2bb400c7-1a44-427c-a38e-860f71f92d31 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-99763c27-6b39-44f5-9360-45caa5376f20 req-a9410d4b-f1f1-4f18-bf0e-dbf257b23dab service nova] Acquiring lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-99763c27-6b39-44f5-9360-45caa5376f20 req-a9410d4b-f1f1-4f18-bf0e-dbf257b23dab service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-99763c27-6b39-44f5-9360-45caa5376f20 req-a9410d4b-f1f1-4f18-bf0e-dbf257b23dab service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:19 user nova-compute[73104]: DEBUG nova.compute.manager [req-99763c27-6b39-44f5-9360-45caa5376f20 req-a9410d4b-f1f1-4f18-bf0e-dbf257b23dab service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] No waiting events found dispatching network-vif-plugged-2bb400c7-1a44-427c-a38e-860f71f92d31 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:19 user nova-compute[73104]: WARNING nova.compute.manager [req-99763c27-6b39-44f5-9360-45caa5376f20 req-a9410d4b-f1f1-4f18-bf0e-dbf257b23dab service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received unexpected event network-vif-plugged-2bb400c7-1a44-427c-a38e-860f71f92d31 for instance with vm_state building and task_state spawning.
Aug 26 08:39:19 user nova-compute[73104]: DEBUG nova.compute.manager [req-99763c27-6b39-44f5-9360-45caa5376f20 req-a9410d4b-f1f1-4f18-bf0e-dbf257b23dab service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-plugged-0cf8f75c-539b-44d0-bc4a-a52f86a24d9c {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-99763c27-6b39-44f5-9360-45caa5376f20 req-a9410d4b-f1f1-4f18-bf0e-dbf257b23dab service nova] Acquiring lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-99763c27-6b39-44f5-9360-45caa5376f20 req-a9410d4b-f1f1-4f18-bf0e-dbf257b23dab service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-99763c27-6b39-44f5-9360-45caa5376f20 req-a9410d4b-f1f1-4f18-bf0e-dbf257b23dab service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:19 user nova-compute[73104]: DEBUG nova.compute.manager [req-99763c27-6b39-44f5-9360-45caa5376f20 req-a9410d4b-f1f1-4f18-bf0e-dbf257b23dab service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] No waiting events found dispatching network-vif-plugged-0cf8f75c-539b-44d0-bc4a-a52f86a24d9c {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:19 user nova-compute[73104]: WARNING nova.compute.manager [req-99763c27-6b39-44f5-9360-45caa5376f20 req-a9410d4b-f1f1-4f18-bf0e-dbf257b23dab service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received unexpected event network-vif-plugged-0cf8f75c-539b-44d0-bc4a-a52f86a24d9c for instance with vm_state building and task_state spawning.
Aug 26 08:39:19 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693039144.7655163, 94de2062-7017-44fe-8df0-0a3cd63d5498 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:39:19 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] VM Stopped (Lifecycle Event)
Aug 26 08:39:19 user nova-compute[73104]: DEBUG nova.compute.manager [None req-55bc4cc3-457f-4f1d-bc5e-3614a8c39555 None None] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:39:20 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039160.3122602, e2ec2788-98c7-48a7-933a-433dc215d7ec => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:39:20 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] VM Resumed (Lifecycle Event)
Aug 26 08:39:20 user nova-compute[73104]: DEBUG nova.compute.manager [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:39:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:39:20 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Instance spawned successfully.
Aug 26 08:39:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:39:20 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:39:20 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:39:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:39:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:39:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:39:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:39:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:39:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:39:20 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:39:20 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039160.3132741, e2ec2788-98c7-48a7-933a-433dc215d7ec => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:39:20 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] VM Started (Lifecycle Event)
Aug 26 08:39:20 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:39:20 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:39:20 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:39:20 user nova-compute[73104]: INFO nova.compute.manager [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Took 12.26 seconds to spawn the instance on the hypervisor.
Aug 26 08:39:20 user nova-compute[73104]: DEBUG nova.compute.manager [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:39:20 user nova-compute[73104]: INFO nova.compute.manager [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Took 54.73 seconds to build instance.
Aug 26 08:39:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df769010-f00c-4ac1-82c8-af7c96cc6f93 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 54.836s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:21 user nova-compute[73104]: DEBUG nova.compute.manager [req-153f9c09-c970-457e-b2a9-04860fcda595 req-388d8956-4a50-4a82-b4b5-9817bb1c317a service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-plugged-0cf8f75c-539b-44d0-bc4a-a52f86a24d9c {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-153f9c09-c970-457e-b2a9-04860fcda595 req-388d8956-4a50-4a82-b4b5-9817bb1c317a service nova] Acquiring lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-153f9c09-c970-457e-b2a9-04860fcda595 req-388d8956-4a50-4a82-b4b5-9817bb1c317a service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-153f9c09-c970-457e-b2a9-04860fcda595 req-388d8956-4a50-4a82-b4b5-9817bb1c317a service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:21 user nova-compute[73104]: DEBUG nova.compute.manager [req-153f9c09-c970-457e-b2a9-04860fcda595 req-388d8956-4a50-4a82-b4b5-9817bb1c317a service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] No waiting events found dispatching network-vif-plugged-0cf8f75c-539b-44d0-bc4a-a52f86a24d9c {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:21 user nova-compute[73104]: WARNING nova.compute.manager [req-153f9c09-c970-457e-b2a9-04860fcda595 req-388d8956-4a50-4a82-b4b5-9817bb1c317a service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received unexpected event network-vif-plugged-0cf8f75c-539b-44d0-bc4a-a52f86a24d9c for instance with vm_state active and task_state None.
Aug 26 08:39:21 user nova-compute[73104]: DEBUG nova.compute.manager [req-153f9c09-c970-457e-b2a9-04860fcda595 req-388d8956-4a50-4a82-b4b5-9817bb1c317a service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-plugged-971207c4-aee3-47f6-8fb4-ad7d7fc2827e {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-153f9c09-c970-457e-b2a9-04860fcda595 req-388d8956-4a50-4a82-b4b5-9817bb1c317a service nova] Acquiring lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-153f9c09-c970-457e-b2a9-04860fcda595 req-388d8956-4a50-4a82-b4b5-9817bb1c317a service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-153f9c09-c970-457e-b2a9-04860fcda595 req-388d8956-4a50-4a82-b4b5-9817bb1c317a service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:21 user nova-compute[73104]: DEBUG nova.compute.manager [req-153f9c09-c970-457e-b2a9-04860fcda595 req-388d8956-4a50-4a82-b4b5-9817bb1c317a service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] No waiting events found dispatching network-vif-plugged-971207c4-aee3-47f6-8fb4-ad7d7fc2827e {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:21 user nova-compute[73104]: WARNING nova.compute.manager [req-153f9c09-c970-457e-b2a9-04860fcda595 req-388d8956-4a50-4a82-b4b5-9817bb1c317a service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received unexpected event network-vif-plugged-971207c4-aee3-47f6-8fb4-ad7d7fc2827e for instance with vm_state active and task_state None.
Aug 26 08:39:21 user nova-compute[73104]: DEBUG nova.compute.manager [req-153f9c09-c970-457e-b2a9-04860fcda595 req-388d8956-4a50-4a82-b4b5-9817bb1c317a service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-plugged-971207c4-aee3-47f6-8fb4-ad7d7fc2827e {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-153f9c09-c970-457e-b2a9-04860fcda595 req-388d8956-4a50-4a82-b4b5-9817bb1c317a service nova] Acquiring lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-153f9c09-c970-457e-b2a9-04860fcda595 req-388d8956-4a50-4a82-b4b5-9817bb1c317a service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-153f9c09-c970-457e-b2a9-04860fcda595 req-388d8956-4a50-4a82-b4b5-9817bb1c317a service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:21 user nova-compute[73104]: DEBUG nova.compute.manager [req-153f9c09-c970-457e-b2a9-04860fcda595 req-388d8956-4a50-4a82-b4b5-9817bb1c317a service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] No waiting events found dispatching network-vif-plugged-971207c4-aee3-47f6-8fb4-ad7d7fc2827e {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:21 user nova-compute[73104]: WARNING nova.compute.manager [req-153f9c09-c970-457e-b2a9-04860fcda595 req-388d8956-4a50-4a82-b4b5-9817bb1c317a service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received unexpected event network-vif-plugged-971207c4-aee3-47f6-8fb4-ad7d7fc2827e for instance with vm_state active and task_state None.
Aug 26 08:39:21 user nova-compute[73104]: DEBUG nova.compute.manager [req-153f9c09-c970-457e-b2a9-04860fcda595 req-388d8956-4a50-4a82-b4b5-9817bb1c317a service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-plugged-1de67e88-3745-4d54-9b30-17d82513265f {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-153f9c09-c970-457e-b2a9-04860fcda595 req-388d8956-4a50-4a82-b4b5-9817bb1c317a service nova] Acquiring lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-153f9c09-c970-457e-b2a9-04860fcda595 req-388d8956-4a50-4a82-b4b5-9817bb1c317a service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-153f9c09-c970-457e-b2a9-04860fcda595 req-388d8956-4a50-4a82-b4b5-9817bb1c317a service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:21 user nova-compute[73104]: DEBUG nova.compute.manager [req-153f9c09-c970-457e-b2a9-04860fcda595 req-388d8956-4a50-4a82-b4b5-9817bb1c317a service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] No waiting events found dispatching network-vif-plugged-1de67e88-3745-4d54-9b30-17d82513265f {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:21 user nova-compute[73104]: WARNING nova.compute.manager [req-153f9c09-c970-457e-b2a9-04860fcda595 req-388d8956-4a50-4a82-b4b5-9817bb1c317a service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received unexpected event network-vif-plugged-1de67e88-3745-4d54-9b30-17d82513265f for instance with vm_state active and task_state None.
Aug 26 08:39:21 user nova-compute[73104]: DEBUG nova.compute.manager [req-153f9c09-c970-457e-b2a9-04860fcda595 req-388d8956-4a50-4a82-b4b5-9817bb1c317a service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-plugged-1de67e88-3745-4d54-9b30-17d82513265f {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-153f9c09-c970-457e-b2a9-04860fcda595 req-388d8956-4a50-4a82-b4b5-9817bb1c317a service nova] Acquiring lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-153f9c09-c970-457e-b2a9-04860fcda595 req-388d8956-4a50-4a82-b4b5-9817bb1c317a service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-153f9c09-c970-457e-b2a9-04860fcda595 req-388d8956-4a50-4a82-b4b5-9817bb1c317a service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:21 user nova-compute[73104]: DEBUG nova.compute.manager [req-153f9c09-c970-457e-b2a9-04860fcda595 req-388d8956-4a50-4a82-b4b5-9817bb1c317a service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] No waiting events found dispatching network-vif-plugged-1de67e88-3745-4d54-9b30-17d82513265f {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:21 user nova-compute[73104]: WARNING nova.compute.manager [req-153f9c09-c970-457e-b2a9-04860fcda595 req-388d8956-4a50-4a82-b4b5-9817bb1c317a service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received unexpected event network-vif-plugged-1de67e88-3745-4d54-9b30-17d82513265f for instance with vm_state active and task_state None.
Aug 26 08:39:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG nova.compute.manager [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:39:23 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Creating image(s)
Aug 26 08:39:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Did not create local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Ensure instance console log exists: /opt/stack/data/nova/instances/7170b5a8-12a7-4ddf-8089-fde172570fd1/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Start _get_guest_xml network_info=[{"id": "4f31240a-f297-42c8-a9f5-65c64322c486", "address": "fa:16:3e:e4:82:c2", "network": {"id": "61837c4d-d9ee-4ec5-be90-336082e4264e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-701032687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f31240a-f2", "ovs_interfaceid": "4f31240a-f297-42c8-a9f5-65c64322c486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8469badb-d912-4a8d-ba41-cf4a04664c73", "address": "fa:16:3e:8c:2c:5b", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8469badb-d9", "ovs_interfaceid": "8469badb-d912-4a8d-ba41-cf4a04664c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b", "address": "fa:16:3e:f8:62:20", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa218cb-82", "ovs_interfaceid": "4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7c7615d3-d6db-4a04-884b-34ad12ed49ab", "address": "fa:16:3e:5b:13:e7", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7615d3-d6", "ovs_interfaceid": "7c7615d3-d6db-4a04-884b-34ad12ed49ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56", "address": "fa:16:3e:11:48:11", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9e4cb8-1b", "ovs_interfaceid": "8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e77e909b-af87-4825-b30b-a7062763e3ea", "address": "fa:16:3e:85:9b:36", "network": {"id": "4138826a-130b-48c0-b315-122e80d369ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680959749", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77e909b-af", "ovs_interfaceid": "e77e909b-af87-4825-b30b-a7062763e3ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7aabcef5-79f9-4f25-b095-ac587d15a460", "address": "fa:16:3e:e6:4e:9b", "network": {"id": "4138826a-130b-48c0-b315-122e80d369ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680959749", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aabcef5-79", "ovs_interfaceid": "7aabcef5-79f9-4f25-b095-ac587d15a460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '7863b62e-e797-4c69-a56f-b100ef4e84ad', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ODzqpdnV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7170b5a8-12a7-4ddf-8089-fde172570fd1', 'attached_at': '', 'detached_at': '', 'volume_id': 'd6fd7c84-07ca-43be-9dc8-66cecc82ab75', 'serial': 'd6fd7c84-07ca-43be-9dc8-66cecc82ab75'}, 'device_type': 'disk', 'volume_type': None}, {'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '1fa3291e-b696-40c3-9b45-e9dda118de45', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yOTASVcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7170b5a8-12a7-4ddf-8089-fde172570fd1', 'attached_at': '', 'detached_at': '', 'volume_id': '213ace90-56d6-43cc-8af2-78f1ffe4b49a', 'serial': '213ace90-56d6-43cc-8af2-78f1ffe4b49a'}, 'device_type': 'disk', 'volume_type': None}, {'delete_on_termination': False, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'fe997aa1-653e-4cfc-8161-e78990d58be5', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nzalZsvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7170b5a8-12a7-4ddf-8089-fde172570fd1', 'attached_at': '', 'detached_at': '', 'volume_id': 'f6d15a6a-b090-4ef2-bfbf-968454ababbd', 'serial': 'f6d15a6a-b090-4ef2-bfbf-968454ababbd'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:23 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:39:23 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:39:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ODzqpdnV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:39:23 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:39:23 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:39:23 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:39:23 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:39:23 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:39:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a50ad60-61d3-4c22-9c68-f2d32d6064de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:39:23 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[128395ac-6a9b-418e-bf3a-7bdb9b7b2131]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75] added
Aug 26 08:39:23 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3d6558-f9f4-428d-8c97-e2c98b0fec19]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[40950197-6f18-4ae7-aa5c-0d416b45de4e]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ODzqpdnV {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ODzqpdnV" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b0e1fa-53e9-46ce-a771-7a7184d383d9]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ODzqpdnV'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[924d8311-94e2-4210-b995-bd3d999f5cfc]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[804ec2e0-5f95-4b84-bf4e-30f00bb407e3]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:23 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:23 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:23 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:23 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:23 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:23 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5bb24e-dae0-412a-9e4b-fe1aa6d6381f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75, portal: 172.16.0.220,3260]
Aug 26 08:39:23 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75, portal: 172.16.0.220,3260] successful.
Aug 26 08:39:23 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f8e865-7f95-49d5-996b-75e677dc83b7]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e44594-d7db-48c3-80c0-8aef4e58c69b]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:24 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:24 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:24 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:39:24 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:39:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:24 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:24 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:24 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:39:24 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:39:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:39:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:39:24 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:39:24 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:39:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[050d2dd7-eeee-4bf6-823c-602be5ae41c5]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:24 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:39:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ODzqpdnV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '23261643966333763', 'path': '/dev/sde'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261643966333763', 'path': '/dev/sde'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yOTASVcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:39:25 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:39:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:39:25 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:39:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:39:25 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:39:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a732506-c0bc-4994-a815-ca3a7560ad97]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:39:25 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7889680e-5803-43da-964b-421030aaa2ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a] added
Aug 26 08:39:25 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[70549722-e9fc-48f5-bee3-1a0877e1c5a9]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a27f49-97c3-4266-8fec-b7927bdf5fde]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yOTASVcm {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yOTASVcm" returned: 0 in 0.027s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e46f0dd-3a0d-42b6-9332-50589539863b]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yOTASVcm'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0009368d-6c96-4df1-9c32-a10f113e7d24]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7004a7e2-2b88-4897-977f-c34a40338480]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:25 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:25 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:25 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:39:25 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:25 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:25 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:25 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:39:25 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[18249cd2-f052-40e3-ad50-5657ce18946c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a, portal: 172.16.0.220,3260]
Aug 26 08:39:25 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a, portal: 172.16.0.220,3260] successful.
Aug 26 08:39:25 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693039150.4625385, 995a2bd3-4c54-4217-ae9f-056353008547 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:39:25 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] VM Stopped (Lifecycle Event)
Aug 26 08:39:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75dd239-600c-4a2d-ab48-8f93048268be]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG nova.compute.manager [None req-7c93da60-2147-402d-967c-df3fc20dabb4 None None] [instance: 995a2bd3-4c54-4217-ae9f-056353008547] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9598e146-3ee1-4bad-982b-7d48f8ee33b3]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:25 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:25 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:25 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:39:25 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:39:25 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:25 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:25 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:25 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:39:25 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:39:25 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f4b7d4-0bf9-4368-9646-7e8b574a5c18]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:39:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yOTASVcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] <== connect_volume: return (1427ms) {'type': 'block', 'scsi_wwn': '23766336264303539', 'path': '/dev/sdf'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766336264303539', 'path': '/dev/sdf'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nzalZsvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:39:26 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:39:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:39:26 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:39:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:39:26 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:39:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[55aec0e9-242b-48ca-9c92-1f9b76676fb7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:39:26 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[287a4756-0ab9-4fc4-91d1-7a38e0453ecc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd] added
Aug 26 08:39:26 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48ad17c-5c5b-410e-a824-e3a8306a78fe]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[212e232b-d3b8-458c-a89e-a6b03dbeacda]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nzalZsvq {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nzalZsvq" returned: 0 in 0.027s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1bd966-54bf-4d78-a098-b173513b036d]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nzalZsvq'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28424cb-43ab-4961-9381-6f5e3f42c201]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9afe4df-2502-41ee-9f7d-a395cf0d793f]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:26 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:26 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:26 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:39:26 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:39:26 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:26 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:26 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:26 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:39:26 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:39:26 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9750c462-9260-4da1-8987-a51b319506eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd, portal: 172.16.0.220,3260]
Aug 26 08:39:26 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd, portal: 172.16.0.220,3260] successful.
Aug 26 08:39:26 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e9be7e-97fe-4bf0-abdd-c721719c1a79]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fba2b5f-e4b7-41b3-99bb-6934f22915ab]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:26 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:26 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:26 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:39:26 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:39:26 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:39:26 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:26 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:26 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:26 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:39:26 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:39:26 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:39:26 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[40043e3b-c39e-4b4f-9e94-227656fbb9ec]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:39:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nzalZsvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:39:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:39:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23265346566623161', 'path': '/dev/sdg'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:39:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265346566623161', 'path': '/dev/sdg'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-923765678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-923765678',id=11,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGYu7jnGjsMQMqrqqsnYZ+Rr2o1t2Pb+ktqLbI/eRVG3arD3uw99tX2o2eiIeA2ClXnduicOGInmHlnfRP03ohy6EG9X7PW2YhVQTFMQ+eJ45e4EFYaspRmSOv26WCnjw==',key_name='tempest-keypair-269369520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27c658028a274117a30ecb831e50ddbb',ramdisk_id='',reservation_id='r-45ekea2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-834543942',owner_user_name='tempest-TaggedBootDevicesTest_v242-834543942-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:38:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5592a07f52b84dc9aa87f20bc1b9f0d6',uuid=7170b5a8-12a7-4ddf-8089-fde172570fd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f31240a-f297-42c8-a9f5-65c64322c486", "address": "fa:16:3e:e4:82:c2", "network": {"id": "61837c4d-d9ee-4ec5-be90-336082e4264e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-701032687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f31240a-f2", "ovs_interfaceid": "4f31240a-f297-42c8-a9f5-65c64322c486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converting VIF {"id": "4f31240a-f297-42c8-a9f5-65c64322c486", "address": "fa:16:3e:e4:82:c2", "network": {"id": "61837c4d-d9ee-4ec5-be90-336082e4264e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-701032687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f31240a-f2", "ovs_interfaceid": "4f31240a-f297-42c8-a9f5-65c64322c486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:82:c2,bridge_name='br-int',has_traffic_filtering=True,id=4f31240a-f297-42c8-a9f5-65c64322c486,network=Network(61837c4d-d9ee-4ec5-be90-336082e4264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f31240a-f2') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-923765678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-923765678',id=11,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGYu7jnGjsMQMqrqqsnYZ+Rr2o1t2Pb+ktqLbI/eRVG3arD3uw99tX2o2eiIeA2ClXnduicOGInmHlnfRP03ohy6EG9X7PW2YhVQTFMQ+eJ45e4EFYaspRmSOv26WCnjw==',key_name='tempest-keypair-269369520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27c658028a274117a30ecb831e50ddbb',ramdisk_id='',reservation_id='r-45ekea2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-834543942',owner_user_name='tempest-TaggedBootDevicesTest_v242-834543942-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:38:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5592a07f52b84dc9aa87f20bc1b9f0d6',uuid=7170b5a8-12a7-4ddf-8089-fde172570fd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8469badb-d912-4a8d-ba41-cf4a04664c73", "address": "fa:16:3e:8c:2c:5b", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8469badb-d9", "ovs_interfaceid": "8469badb-d912-4a8d-ba41-cf4a04664c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converting VIF {"id": "8469badb-d912-4a8d-ba41-cf4a04664c73", "address": "fa:16:3e:8c:2c:5b", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8469badb-d9", "ovs_interfaceid": "8469badb-d912-4a8d-ba41-cf4a04664c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:2c:5b,bridge_name='br-int',has_traffic_filtering=True,id=8469badb-d912-4a8d-ba41-cf4a04664c73,network=Network(b7e93d48-5c6e-4585-bc10-800a113733c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8469badb-d9') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-923765678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-923765678',id=11,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGYu7jnGjsMQMqrqqsnYZ+Rr2o1t2Pb+ktqLbI/eRVG3arD3uw99tX2o2eiIeA2ClXnduicOGInmHlnfRP03ohy6EG9X7PW2YhVQTFMQ+eJ45e4EFYaspRmSOv26WCnjw==',key_name='tempest-keypair-269369520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27c658028a274117a30ecb831e50ddbb',ramdisk_id='',reservation_id='r-45ekea2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-834543942',owner_user_name='tempest-TaggedBootDevicesTest_v242-834543942-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:38:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5592a07f52b84dc9aa87f20bc1b9f0d6',uuid=7170b5a8-12a7-4ddf-8089-fde172570fd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b", "address": "fa:16:3e:f8:62:20", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa218cb-82", "ovs_interfaceid": "4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converting VIF {"id": "4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b", "address": "fa:16:3e:f8:62:20", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa218cb-82", "ovs_interfaceid": "4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:62:20,bridge_name='br-int',has_traffic_filtering=True,id=4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b,network=Network(b7e93d48-5c6e-4585-bc10-800a113733c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4fa218cb-82') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-923765678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-923765678',id=11,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGYu7jnGjsMQMqrqqsnYZ+Rr2o1t2Pb+ktqLbI/eRVG3arD3uw99tX2o2eiIeA2ClXnduicOGInmHlnfRP03ohy6EG9X7PW2YhVQTFMQ+eJ45e4EFYaspRmSOv26WCnjw==',key_name='tempest-keypair-269369520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27c658028a274117a30ecb831e50ddbb',ramdisk_id='',reservation_id='r-45ekea2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-834543942',owner_user_name='tempest-TaggedBootDevicesTest_v242-834543942-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:38:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5592a07f52b84dc9aa87f20bc1b9f0d6',uuid=7170b5a8-12a7-4ddf-8089-fde172570fd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c7615d3-d6db-4a04-884b-34ad12ed49ab", "address": "fa:16:3e:5b:13:e7", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7615d3-d6", "ovs_interfaceid": "7c7615d3-d6db-4a04-884b-34ad12ed49ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converting VIF {"id": "7c7615d3-d6db-4a04-884b-34ad12ed49ab", "address": "fa:16:3e:5b:13:e7", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7615d3-d6", "ovs_interfaceid": "7c7615d3-d6db-4a04-884b-34ad12ed49ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:13:e7,bridge_name='br-int',has_traffic_filtering=True,id=7c7615d3-d6db-4a04-884b-34ad12ed49ab,network=Network(b7e93d48-5c6e-4585-bc10-800a113733c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7615d3-d6') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-923765678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-923765678',id=11,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGYu7jnGjsMQMqrqqsnYZ+Rr2o1t2Pb+ktqLbI/eRVG3arD3uw99tX2o2eiIeA2ClXnduicOGInmHlnfRP03ohy6EG9X7PW2YhVQTFMQ+eJ45e4EFYaspRmSOv26WCnjw==',key_name='tempest-keypair-269369520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27c658028a274117a30ecb831e50ddbb',ramdisk_id='',reservation_id='r-45ekea2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-834543942',owner_user_name='tempest-TaggedBootDevicesTest_v242-834543942-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:38:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5592a07f52b84dc9aa87f20bc1b9f0d6',uuid=7170b5a8-12a7-4ddf-8089-fde172570fd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56", "address": "fa:16:3e:11:48:11", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9e4cb8-1b", "ovs_interfaceid": "8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converting VIF {"id": "8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56", "address": "fa:16:3e:11:48:11", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9e4cb8-1b", "ovs_interfaceid": "8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:48:11,bridge_name='br-int',has_traffic_filtering=True,id=8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56,network=Network(b7e93d48-5c6e-4585-bc10-800a113733c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9e4cb8-1b') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-923765678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-923765678',id=11,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGYu7jnGjsMQMqrqqsnYZ+Rr2o1t2Pb+ktqLbI/eRVG3arD3uw99tX2o2eiIeA2ClXnduicOGInmHlnfRP03ohy6EG9X7PW2YhVQTFMQ+eJ45e4EFYaspRmSOv26WCnjw==',key_name='tempest-keypair-269369520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27c658028a274117a30ecb831e50ddbb',ramdisk_id='',reservation_id='r-45ekea2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-834543942',owner_user_name='tempest-TaggedBootDevicesTest_v242-834543942-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:38:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5592a07f52b84dc9aa87f20bc1b9f0d6',uuid=7170b5a8-12a7-4ddf-8089-fde172570fd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e77e909b-af87-4825-b30b-a7062763e3ea", "address": "fa:16:3e:85:9b:36", "network": {"id": "4138826a-130b-48c0-b315-122e80d369ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680959749", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77e909b-af", "ovs_interfaceid": "e77e909b-af87-4825-b30b-a7062763e3ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converting VIF {"id": "e77e909b-af87-4825-b30b-a7062763e3ea", "address": "fa:16:3e:85:9b:36", "network": {"id": "4138826a-130b-48c0-b315-122e80d369ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680959749", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77e909b-af", "ovs_interfaceid": "e77e909b-af87-4825-b30b-a7062763e3ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:9b:36,bridge_name='br-int',has_traffic_filtering=True,id=e77e909b-af87-4825-b30b-a7062763e3ea,network=Network(4138826a-130b-48c0-b315-122e80d369ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape77e909b-af') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-923765678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-923765678',id=11,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGYu7jnGjsMQMqrqqsnYZ+Rr2o1t2Pb+ktqLbI/eRVG3arD3uw99tX2o2eiIeA2ClXnduicOGInmHlnfRP03ohy6EG9X7PW2YhVQTFMQ+eJ45e4EFYaspRmSOv26WCnjw==',key_name='tempest-keypair-269369520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27c658028a274117a30ecb831e50ddbb',ramdisk_id='',reservation_id='r-45ekea2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-834543942',owner_user_name='tempest-TaggedBootDevicesTest_v242-834543942-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:38:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5592a07f52b84dc9aa87f20bc1b9f0d6',uuid=7170b5a8-12a7-4ddf-8089-fde172570fd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7aabcef5-79f9-4f25-b095-ac587d15a460", "address": "fa:16:3e:e6:4e:9b", "network": {"id": "4138826a-130b-48c0-b315-122e80d369ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680959749", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aabcef5-79", "ovs_interfaceid": "7aabcef5-79f9-4f25-b095-ac587d15a460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converting VIF {"id": "7aabcef5-79f9-4f25-b095-ac587d15a460", "address": "fa:16:3e:e6:4e:9b", "network": {"id": "4138826a-130b-48c0-b315-122e80d369ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680959749", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aabcef5-79", "ovs_interfaceid": "7aabcef5-79f9-4f25-b095-ac587d15a460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:4e:9b,bridge_name='br-int',has_traffic_filtering=True,id=7aabcef5-79f9-4f25-b095-ac587d15a460,network=Network(4138826a-130b-48c0-b315-122e80d369ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aabcef5-79') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.objects.instance [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Lazy-loading 'pci_devices' on Instance uuid 7170b5a8-12a7-4ddf-8089-fde172570fd1 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:39:28 user nova-compute[73104]:   <uuid>7170b5a8-12a7-4ddf-8089-fde172570fd1</uuid>
Aug 26 08:39:28 user nova-compute[73104]:   <name>instance-0000000b</name>
Aug 26 08:39:28 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:39:28 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:39:28 user nova-compute[73104]:   <metadata>
Aug 26 08:39:28 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:39:28 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:39:28 user nova-compute[73104]:       <nova:name>tempest-device-tagging-server-923765678</nova:name>
Aug 26 08:39:28 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:39:23</nova:creationTime>
Aug 26 08:39:28 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:39:28 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:39:28 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:39:28 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:39:28 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:39:28 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:39:28 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:39:28 user nova-compute[73104]:       <nova:owner>
Aug 26 08:39:28 user nova-compute[73104]:         <nova:user uuid="5592a07f52b84dc9aa87f20bc1b9f0d6">tempest-TaggedBootDevicesTest_v242-834543942-project-member</nova:user>
Aug 26 08:39:28 user nova-compute[73104]:         <nova:project uuid="27c658028a274117a30ecb831e50ddbb">tempest-TaggedBootDevicesTest_v242-834543942</nova:project>
Aug 26 08:39:28 user nova-compute[73104]:       </nova:owner>
Aug 26 08:39:28 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:39:28 user nova-compute[73104]:       <nova:ports>
Aug 26 08:39:28 user nova-compute[73104]:         <nova:port uuid="4f31240a-f297-42c8-a9f5-65c64322c486">
Aug 26 08:39:28 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 08:39:28 user nova-compute[73104]:         </nova:port>
Aug 26 08:39:28 user nova-compute[73104]:         <nova:port uuid="8469badb-d912-4a8d-ba41-cf4a04664c73">
Aug 26 08:39:28 user nova-compute[73104]:           <nova:ip type="fixed" address="10.1.1.161" ipVersion="4"/>
Aug 26 08:39:28 user nova-compute[73104]:         </nova:port>
Aug 26 08:39:28 user nova-compute[73104]:         <nova:port uuid="4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b">
Aug 26 08:39:28 user nova-compute[73104]:           <nova:ip type="fixed" address="10.1.1.71" ipVersion="4"/>
Aug 26 08:39:28 user nova-compute[73104]:         </nova:port>
Aug 26 08:39:28 user nova-compute[73104]:         <nova:port uuid="7c7615d3-d6db-4a04-884b-34ad12ed49ab">
Aug 26 08:39:28 user nova-compute[73104]:           <nova:ip type="fixed" address="10.1.1.252" ipVersion="4"/>
Aug 26 08:39:28 user nova-compute[73104]:         </nova:port>
Aug 26 08:39:28 user nova-compute[73104]:         <nova:port uuid="8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56">
Aug 26 08:39:28 user nova-compute[73104]:           <nova:ip type="fixed" address="10.1.1.129" ipVersion="4"/>
Aug 26 08:39:28 user nova-compute[73104]:         </nova:port>
Aug 26 08:39:28 user nova-compute[73104]:         <nova:port uuid="e77e909b-af87-4825-b30b-a7062763e3ea">
Aug 26 08:39:28 user nova-compute[73104]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 26 08:39:28 user nova-compute[73104]:         </nova:port>
Aug 26 08:39:28 user nova-compute[73104]:         <nova:port uuid="7aabcef5-79f9-4f25-b095-ac587d15a460">
Aug 26 08:39:28 user nova-compute[73104]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 26 08:39:28 user nova-compute[73104]:         </nova:port>
Aug 26 08:39:28 user nova-compute[73104]:       </nova:ports>
Aug 26 08:39:28 user nova-compute[73104]:     </nova:instance>
Aug 26 08:39:28 user nova-compute[73104]:   </metadata>
Aug 26 08:39:28 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:39:28 user nova-compute[73104]:     <system>
Aug 26 08:39:28 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:39:28 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:39:28 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:39:28 user nova-compute[73104]:       <entry name="serial">7170b5a8-12a7-4ddf-8089-fde172570fd1</entry>
Aug 26 08:39:28 user nova-compute[73104]:       <entry name="uuid">7170b5a8-12a7-4ddf-8089-fde172570fd1</entry>
Aug 26 08:39:28 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:39:28 user nova-compute[73104]:     </system>
Aug 26 08:39:28 user nova-compute[73104]:   </sysinfo>
Aug 26 08:39:28 user nova-compute[73104]:   <os>
Aug 26 08:39:28 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:39:28 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:39:28 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:39:28 user nova-compute[73104]:   </os>
Aug 26 08:39:28 user nova-compute[73104]:   <features>
Aug 26 08:39:28 user nova-compute[73104]:     <acpi/>
Aug 26 08:39:28 user nova-compute[73104]:     <apic/>
Aug 26 08:39:28 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:39:28 user nova-compute[73104]:   </features>
Aug 26 08:39:28 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:39:28 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:39:28 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:39:28 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:39:28 user nova-compute[73104]:   </clock>
Aug 26 08:39:28 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:39:28 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:39:28 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:39:28 user nova-compute[73104]:   </cpu>
Aug 26 08:39:28 user nova-compute[73104]:   <devices>
Aug 26 08:39:28 user nova-compute[73104]:     <disk type="file" device="cdrom">
Aug 26 08:39:28 user nova-compute[73104]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 08:39:28 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/7170b5a8-12a7-4ddf-8089-fde172570fd1/disk.config"/>
Aug 26 08:39:28 user nova-compute[73104]:       <target dev="hda" bus="ide"/>
Aug 26 08:39:28 user nova-compute[73104]:     </disk>
Aug 26 08:39:28 user nova-compute[73104]:     <disk type="block" device="disk">
Aug 26 08:39:28 user nova-compute[73104]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:39:28 user nova-compute[73104]:       <source dev="/dev/sde"/>
Aug 26 08:39:28 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:39:28 user nova-compute[73104]:       <serial>d6fd7c84-07ca-43be-9dc8-66cecc82ab75</serial>
Aug 26 08:39:28 user nova-compute[73104]:     </disk>
Aug 26 08:39:28 user nova-compute[73104]:     <disk type="block" device="disk">
Aug 26 08:39:28 user nova-compute[73104]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:39:28 user nova-compute[73104]:       <source dev="/dev/sdf"/>
Aug 26 08:39:28 user nova-compute[73104]:       <target dev="vdb" bus="virtio"/>
Aug 26 08:39:28 user nova-compute[73104]:       <serial>213ace90-56d6-43cc-8af2-78f1ffe4b49a</serial>
Aug 26 08:39:28 user nova-compute[73104]:     </disk>
Aug 26 08:39:28 user nova-compute[73104]:     <disk type="block" device="disk">
Aug 26 08:39:28 user nova-compute[73104]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:39:28 user nova-compute[73104]:       <source dev="/dev/sdg"/>
Aug 26 08:39:28 user nova-compute[73104]:       <target dev="vdc" bus="virtio"/>
Aug 26 08:39:28 user nova-compute[73104]:       <serial>f6d15a6a-b090-4ef2-bfbf-968454ababbd</serial>
Aug 26 08:39:28 user nova-compute[73104]:     </disk>
Aug 26 08:39:28 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:39:28 user nova-compute[73104]:       <mac address="fa:16:3e:e4:82:c2"/>
Aug 26 08:39:28 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:39:28 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:39:28 user nova-compute[73104]:       <target dev="tap4f31240a-f2"/>
Aug 26 08:39:28 user nova-compute[73104]:     </interface>
Aug 26 08:39:28 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:39:28 user nova-compute[73104]:       <mac address="fa:16:3e:8c:2c:5b"/>
Aug 26 08:39:28 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:39:28 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:39:28 user nova-compute[73104]:       <target dev="tap8469badb-d9"/>
Aug 26 08:39:28 user nova-compute[73104]:     </interface>
Aug 26 08:39:28 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:39:28 user nova-compute[73104]:       <mac address="fa:16:3e:f8:62:20"/>
Aug 26 08:39:28 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:39:28 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:39:28 user nova-compute[73104]:       <target dev="tap4fa218cb-82"/>
Aug 26 08:39:28 user nova-compute[73104]:     </interface>
Aug 26 08:39:28 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:39:28 user nova-compute[73104]:       <mac address="fa:16:3e:5b:13:e7"/>
Aug 26 08:39:28 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:39:28 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:39:28 user nova-compute[73104]:       <target dev="tap7c7615d3-d6"/>
Aug 26 08:39:28 user nova-compute[73104]:     </interface>
Aug 26 08:39:28 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:39:28 user nova-compute[73104]:       <mac address="fa:16:3e:11:48:11"/>
Aug 26 08:39:28 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:39:28 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:39:28 user nova-compute[73104]:       <target dev="tap8b9e4cb8-1b"/>
Aug 26 08:39:28 user nova-compute[73104]:     </interface>
Aug 26 08:39:28 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:39:28 user nova-compute[73104]:       <mac address="fa:16:3e:85:9b:36"/>
Aug 26 08:39:28 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:39:28 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:39:28 user nova-compute[73104]:       <target dev="tape77e909b-af"/>
Aug 26 08:39:28 user nova-compute[73104]:     </interface>
Aug 26 08:39:28 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:39:28 user nova-compute[73104]:       <mac address="fa:16:3e:e6:4e:9b"/>
Aug 26 08:39:28 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:39:28 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:39:28 user nova-compute[73104]:       <target dev="tap7aabcef5-79"/>
Aug 26 08:39:28 user nova-compute[73104]:     </interface>
Aug 26 08:39:28 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:39:28 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/7170b5a8-12a7-4ddf-8089-fde172570fd1/console.log" append="off"/>
Aug 26 08:39:28 user nova-compute[73104]:     </serial>
Aug 26 08:39:28 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:39:28 user nova-compute[73104]:     <video>
Aug 26 08:39:28 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:39:28 user nova-compute[73104]:     </video>
Aug 26 08:39:28 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:39:28 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:39:28 user nova-compute[73104]:     </rng>
Aug 26 08:39:28 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:39:28 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:39:28 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:39:28 user nova-compute[73104]:     </memballoon>
Aug 26 08:39:28 user nova-compute[73104]:   </devices>
Aug 26 08:39:28 user nova-compute[73104]: </domain>
Aug 26 08:39:28 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-923765678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-923765678',id=11,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGYu7jnGjsMQMqrqqsnYZ+Rr2o1t2Pb+ktqLbI/eRVG3arD3uw99tX2o2eiIeA2ClXnduicOGInmHlnfRP03ohy6EG9X7PW2YhVQTFMQ+eJ45e4EFYaspRmSOv26WCnjw==',key_name='tempest-keypair-269369520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27c658028a274117a30ecb831e50ddbb',ramdisk_id='',reservation_id='r-45ekea2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-834543942',owner_user_name='tempest-TaggedBootDevicesTest_v242-834543942-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:38:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5592a07f52b84dc9aa87f20bc1b9f0d6',uuid=7170b5a8-12a7-4ddf-8089-fde172570fd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f31240a-f297-42c8-a9f5-65c64322c486", "address": "fa:16:3e:e4:82:c2", "network": {"id": "61837c4d-d9ee-4ec5-be90-336082e4264e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-701032687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f31240a-f2", "ovs_interfaceid": "4f31240a-f297-42c8-a9f5-65c64322c486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converting VIF {"id": "4f31240a-f297-42c8-a9f5-65c64322c486", "address": "fa:16:3e:e4:82:c2", "network": {"id": "61837c4d-d9ee-4ec5-be90-336082e4264e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-701032687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f31240a-f2", "ovs_interfaceid": "4f31240a-f297-42c8-a9f5-65c64322c486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:82:c2,bridge_name='br-int',has_traffic_filtering=True,id=4f31240a-f297-42c8-a9f5-65c64322c486,network=Network(61837c4d-d9ee-4ec5-be90-336082e4264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f31240a-f2') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG os_vif [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:82:c2,bridge_name='br-int',has_traffic_filtering=True,id=4f31240a-f297-42c8-a9f5-65c64322c486,network=Network(61837c4d-d9ee-4ec5-be90-336082e4264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f31240a-f2') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f31240a-f2, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4f31240a-f2, col_values=(('external_ids', {'iface-id': '4f31240a-f297-42c8-a9f5-65c64322c486', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:82:c2', 'vm-uuid': '7170b5a8-12a7-4ddf-8089-fde172570fd1'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:28 user nova-compute[73104]: INFO os_vif [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:82:c2,bridge_name='br-int',has_traffic_filtering=True,id=4f31240a-f297-42c8-a9f5-65c64322c486,network=Network(61837c4d-d9ee-4ec5-be90-336082e4264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f31240a-f2')
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-923765678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-923765678',id=11,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGYu7jnGjsMQMqrqqsnYZ+Rr2o1t2Pb+ktqLbI/eRVG3arD3uw99tX2o2eiIeA2ClXnduicOGInmHlnfRP03ohy6EG9X7PW2YhVQTFMQ+eJ45e4EFYaspRmSOv26WCnjw==',key_name='tempest-keypair-269369520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27c658028a274117a30ecb831e50ddbb',ramdisk_id='',reservation_id='r-45ekea2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-834543942',owner_user_name='tempest-TaggedBootDevicesTest_v242-834543942-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:38:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5592a07f52b84dc9aa87f20bc1b9f0d6',uuid=7170b5a8-12a7-4ddf-8089-fde172570fd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8469badb-d912-4a8d-ba41-cf4a04664c73", "address": "fa:16:3e:8c:2c:5b", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8469badb-d9", "ovs_interfaceid": "8469badb-d912-4a8d-ba41-cf4a04664c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converting VIF {"id": "8469badb-d912-4a8d-ba41-cf4a04664c73", "address": "fa:16:3e:8c:2c:5b", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8469badb-d9", "ovs_interfaceid": "8469badb-d912-4a8d-ba41-cf4a04664c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:2c:5b,bridge_name='br-int',has_traffic_filtering=True,id=8469badb-d912-4a8d-ba41-cf4a04664c73,network=Network(b7e93d48-5c6e-4585-bc10-800a113733c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8469badb-d9') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG os_vif [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:2c:5b,bridge_name='br-int',has_traffic_filtering=True,id=8469badb-d912-4a8d-ba41-cf4a04664c73,network=Network(b7e93d48-5c6e-4585-bc10-800a113733c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8469badb-d9') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8469badb-d9, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8469badb-d9, col_values=(('external_ids', {'iface-id': '8469badb-d912-4a8d-ba41-cf4a04664c73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:2c:5b', 'vm-uuid': '7170b5a8-12a7-4ddf-8089-fde172570fd1'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:28 user nova-compute[73104]: INFO os_vif [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:2c:5b,bridge_name='br-int',has_traffic_filtering=True,id=8469badb-d912-4a8d-ba41-cf4a04664c73,network=Network(b7e93d48-5c6e-4585-bc10-800a113733c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8469badb-d9')
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-923765678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-923765678',id=11,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGYu7jnGjsMQMqrqqsnYZ+Rr2o1t2Pb+ktqLbI/eRVG3arD3uw99tX2o2eiIeA2ClXnduicOGInmHlnfRP03ohy6EG9X7PW2YhVQTFMQ+eJ45e4EFYaspRmSOv26WCnjw==',key_name='tempest-keypair-269369520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27c658028a274117a30ecb831e50ddbb',ramdisk_id='',reservation_id='r-45ekea2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-834543942',owner_user_name='tempest-TaggedBootDevicesTest_v242-834543942-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:38:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5592a07f52b84dc9aa87f20bc1b9f0d6',uuid=7170b5a8-12a7-4ddf-8089-fde172570fd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b", "address": "fa:16:3e:f8:62:20", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa218cb-82", "ovs_interfaceid": "4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converting VIF {"id": "4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b", "address": "fa:16:3e:f8:62:20", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa218cb-82", "ovs_interfaceid": "4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:62:20,bridge_name='br-int',has_traffic_filtering=True,id=4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b,network=Network(b7e93d48-5c6e-4585-bc10-800a113733c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4fa218cb-82') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG os_vif [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:62:20,bridge_name='br-int',has_traffic_filtering=True,id=4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b,network=Network(b7e93d48-5c6e-4585-bc10-800a113733c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4fa218cb-82') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4fa218cb-82, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4fa218cb-82, col_values=(('external_ids', {'iface-id': '4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:62:20', 'vm-uuid': '7170b5a8-12a7-4ddf-8089-fde172570fd1'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:28 user nova-compute[73104]: INFO os_vif [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:62:20,bridge_name='br-int',has_traffic_filtering=True,id=4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b,network=Network(b7e93d48-5c6e-4585-bc10-800a113733c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4fa218cb-82')
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-923765678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-923765678',id=11,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGYu7jnGjsMQMqrqqsnYZ+Rr2o1t2Pb+ktqLbI/eRVG3arD3uw99tX2o2eiIeA2ClXnduicOGInmHlnfRP03ohy6EG9X7PW2YhVQTFMQ+eJ45e4EFYaspRmSOv26WCnjw==',key_name='tempest-keypair-269369520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27c658028a274117a30ecb831e50ddbb',ramdisk_id='',reservation_id='r-45ekea2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-834543942',owner_user_name='tempest-TaggedBootDevicesTest_v242-834543942-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:38:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5592a07f52b84dc9aa87f20bc1b9f0d6',uuid=7170b5a8-12a7-4ddf-8089-fde172570fd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c7615d3-d6db-4a04-884b-34ad12ed49ab", "address": "fa:16:3e:5b:13:e7", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7615d3-d6", "ovs_interfaceid": "7c7615d3-d6db-4a04-884b-34ad12ed49ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converting VIF {"id": "7c7615d3-d6db-4a04-884b-34ad12ed49ab", "address": "fa:16:3e:5b:13:e7", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7615d3-d6", "ovs_interfaceid": "7c7615d3-d6db-4a04-884b-34ad12ed49ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:13:e7,bridge_name='br-int',has_traffic_filtering=True,id=7c7615d3-d6db-4a04-884b-34ad12ed49ab,network=Network(b7e93d48-5c6e-4585-bc10-800a113733c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7615d3-d6') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG os_vif [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:13:e7,bridge_name='br-int',has_traffic_filtering=True,id=7c7615d3-d6db-4a04-884b-34ad12ed49ab,network=Network(b7e93d48-5c6e-4585-bc10-800a113733c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7615d3-d6') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c7615d3-d6, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7c7615d3-d6, col_values=(('external_ids', {'iface-id': '7c7615d3-d6db-4a04-884b-34ad12ed49ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:13:e7', 'vm-uuid': '7170b5a8-12a7-4ddf-8089-fde172570fd1'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:28 user nova-compute[73104]: INFO os_vif [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:13:e7,bridge_name='br-int',has_traffic_filtering=True,id=7c7615d3-d6db-4a04-884b-34ad12ed49ab,network=Network(b7e93d48-5c6e-4585-bc10-800a113733c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7615d3-d6')
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-923765678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-923765678',id=11,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGYu7jnGjsMQMqrqqsnYZ+Rr2o1t2Pb+ktqLbI/eRVG3arD3uw99tX2o2eiIeA2ClXnduicOGInmHlnfRP03ohy6EG9X7PW2YhVQTFMQ+eJ45e4EFYaspRmSOv26WCnjw==',key_name='tempest-keypair-269369520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27c658028a274117a30ecb831e50ddbb',ramdisk_id='',reservation_id='r-45ekea2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-834543942',owner_user_name='tempest-TaggedBootDevicesTest_v242-834543942-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:38:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5592a07f52b84dc9aa87f20bc1b9f0d6',uuid=7170b5a8-12a7-4ddf-8089-fde172570fd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56", "address": "fa:16:3e:11:48:11", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9e4cb8-1b", "ovs_interfaceid": "8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converting VIF {"id": "8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56", "address": "fa:16:3e:11:48:11", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9e4cb8-1b", "ovs_interfaceid": "8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:48:11,bridge_name='br-int',has_traffic_filtering=True,id=8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56,network=Network(b7e93d48-5c6e-4585-bc10-800a113733c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9e4cb8-1b') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG os_vif [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:48:11,bridge_name='br-int',has_traffic_filtering=True,id=8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56,network=Network(b7e93d48-5c6e-4585-bc10-800a113733c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9e4cb8-1b') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b9e4cb8-1b, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8b9e4cb8-1b, col_values=(('external_ids', {'iface-id': '8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:48:11', 'vm-uuid': '7170b5a8-12a7-4ddf-8089-fde172570fd1'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:28 user nova-compute[73104]: INFO os_vif [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:48:11,bridge_name='br-int',has_traffic_filtering=True,id=8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56,network=Network(b7e93d48-5c6e-4585-bc10-800a113733c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9e4cb8-1b')
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-923765678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-923765678',id=11,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGYu7jnGjsMQMqrqqsnYZ+Rr2o1t2Pb+ktqLbI/eRVG3arD3uw99tX2o2eiIeA2ClXnduicOGInmHlnfRP03ohy6EG9X7PW2YhVQTFMQ+eJ45e4EFYaspRmSOv26WCnjw==',key_name='tempest-keypair-269369520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27c658028a274117a30ecb831e50ddbb',ramdisk_id='',reservation_id='r-45ekea2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-834543942',owner_user_name='tempest-TaggedBootDevicesTest_v242-834543942-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:38:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5592a07f52b84dc9aa87f20bc1b9f0d6',uuid=7170b5a8-12a7-4ddf-8089-fde172570fd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e77e909b-af87-4825-b30b-a7062763e3ea", "address": "fa:16:3e:85:9b:36", "network": {"id": "4138826a-130b-48c0-b315-122e80d369ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680959749", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77e909b-af", "ovs_interfaceid": "e77e909b-af87-4825-b30b-a7062763e3ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converting VIF {"id": "e77e909b-af87-4825-b30b-a7062763e3ea", "address": "fa:16:3e:85:9b:36", "network": {"id": "4138826a-130b-48c0-b315-122e80d369ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680959749", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77e909b-af", "ovs_interfaceid": "e77e909b-af87-4825-b30b-a7062763e3ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:9b:36,bridge_name='br-int',has_traffic_filtering=True,id=e77e909b-af87-4825-b30b-a7062763e3ea,network=Network(4138826a-130b-48c0-b315-122e80d369ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape77e909b-af') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG os_vif [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:9b:36,bridge_name='br-int',has_traffic_filtering=True,id=e77e909b-af87-4825-b30b-a7062763e3ea,network=Network(4138826a-130b-48c0-b315-122e80d369ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape77e909b-af') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape77e909b-af, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape77e909b-af, col_values=(('external_ids', {'iface-id': 'e77e909b-af87-4825-b30b-a7062763e3ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:9b:36', 'vm-uuid': '7170b5a8-12a7-4ddf-8089-fde172570fd1'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:28 user nova-compute[73104]: INFO os_vif [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:9b:36,bridge_name='br-int',has_traffic_filtering=True,id=e77e909b-af87-4825-b30b-a7062763e3ea,network=Network(4138826a-130b-48c0-b315-122e80d369ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape77e909b-af')
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-923765678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-923765678',id=11,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGYu7jnGjsMQMqrqqsnYZ+Rr2o1t2Pb+ktqLbI/eRVG3arD3uw99tX2o2eiIeA2ClXnduicOGInmHlnfRP03ohy6EG9X7PW2YhVQTFMQ+eJ45e4EFYaspRmSOv26WCnjw==',key_name='tempest-keypair-269369520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27c658028a274117a30ecb831e50ddbb',ramdisk_id='',reservation_id='r-45ekea2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-834543942',owner_user_name='tempest-TaggedBootDevicesTest_v242-834543942-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:38:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5592a07f52b84dc9aa87f20bc1b9f0d6',uuid=7170b5a8-12a7-4ddf-8089-fde172570fd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7aabcef5-79f9-4f25-b095-ac587d15a460", "address": "fa:16:3e:e6:4e:9b", "network": {"id": "4138826a-130b-48c0-b315-122e80d369ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680959749", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aabcef5-79", "ovs_interfaceid": "7aabcef5-79f9-4f25-b095-ac587d15a460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converting VIF {"id": "7aabcef5-79f9-4f25-b095-ac587d15a460", "address": "fa:16:3e:e6:4e:9b", "network": {"id": "4138826a-130b-48c0-b315-122e80d369ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680959749", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aabcef5-79", "ovs_interfaceid": "7aabcef5-79f9-4f25-b095-ac587d15a460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:4e:9b,bridge_name='br-int',has_traffic_filtering=True,id=7aabcef5-79f9-4f25-b095-ac587d15a460,network=Network(4138826a-130b-48c0-b315-122e80d369ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aabcef5-79') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG os_vif [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:4e:9b,bridge_name='br-int',has_traffic_filtering=True,id=7aabcef5-79f9-4f25-b095-ac587d15a460,network=Network(4138826a-130b-48c0-b315-122e80d369ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aabcef5-79') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7aabcef5-79, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7aabcef5-79, col_values=(('external_ids', {'iface-id': '7aabcef5-79f9-4f25-b095-ac587d15a460', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:4e:9b', 'vm-uuid': '7170b5a8-12a7-4ddf-8089-fde172570fd1'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:28 user nova-compute[73104]: INFO os_vif [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:4e:9b,bridge_name='br-int',has_traffic_filtering=True,id=7aabcef5-79f9-4f25-b095-ac587d15a460,network=Network(4138826a-130b-48c0-b315-122e80d369ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aabcef5-79')
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] No BDM found with device name hda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] No VIF found with MAC fa:16:3e:e4:82:c2, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] No VIF found with MAC fa:16:3e:11:48:11, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:39:28 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Using config drive
Aug 26 08:39:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:28 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Creating config drive at /opt/stack/data/nova/instances/7170b5a8-12a7-4ddf-8089-fde172570fd1/disk.config
Aug 26 08:39:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7170b5a8-12a7-4ddf-8089-fde172570fd1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpabj0d5lf {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7170b5a8-12a7-4ddf-8089-fde172570fd1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpabj0d5lf" returned: 0 in 0.059s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:29 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:39:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NjVCTKox', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:39:29 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:39:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:39:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:39:29 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:39:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:39:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:39:29 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:39:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:29 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9caf36-3cf4-4103-b791-717ac3f9d70a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:39:29 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:29 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31892b2-7104-4976-b219-299cd5bde70e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24] added
Aug 26 08:39:29 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:29 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f5282d-b8fe-45cd-8e3c-f6b12ee37e14]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:29 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f30a16-1fef-459a-b013-08d883667ba9]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NjVCTKox {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NjVCTKox" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:29 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e132d3-a3b8-464d-9b01-74825fab922d]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NjVCTKox'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75e9777-b6e4-4d6e-90c3-5b856e4a92bc]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd426d23-4b3c-4d01-be7d-cef452359bb5]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:30 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:30 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:30 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:39:30 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:39:30 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:39:30 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:30 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:30 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:30 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:39:30 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:39:30 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:39:30 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5249d250-0dde-4c83-bd01-de66b7a3680a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24, portal: 172.16.0.220,3260]
Aug 26 08:39:30 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24, portal: 172.16.0.220,3260] successful.
Aug 26 08:39:30 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20a62d3-22ba-4945-8c98-326b2e69b91e]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33e0c67-35d6-45c1-8cd8-27732f679289]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:30 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:30 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:30 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:39:30 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:39:30 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:39:30 user nova-compute[73104]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24 (non-flash)
Aug 26 08:39:30 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:30 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:30 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:30 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:39:30 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:39:30 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:39:30 user nova-compute[73104]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24 (non-flash)
Aug 26 08:39:30 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.391s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdeee31-3f37-4bb5-856c-96a3936071ef]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NjVCTKox', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG nova.compute.manager [req-1c3a35e3-4cf7-491a-b02a-6b34c4450864 req-5ca42bed-3c03-4af1-97d4-3816f620cb37 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-plugged-4f31240a-f297-42c8-a9f5-65c64322c486 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1c3a35e3-4cf7-491a-b02a-6b34c4450864 req-5ca42bed-3c03-4af1-97d4-3816f620cb37 service nova] Acquiring lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1c3a35e3-4cf7-491a-b02a-6b34c4450864 req-5ca42bed-3c03-4af1-97d4-3816f620cb37 service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1c3a35e3-4cf7-491a-b02a-6b34c4450864 req-5ca42bed-3c03-4af1-97d4-3816f620cb37 service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG nova.compute.manager [req-1c3a35e3-4cf7-491a-b02a-6b34c4450864 req-5ca42bed-3c03-4af1-97d4-3816f620cb37 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] No waiting events found dispatching network-vif-plugged-4f31240a-f297-42c8-a9f5-65c64322c486 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:30 user nova-compute[73104]: WARNING nova.compute.manager [req-1c3a35e3-4cf7-491a-b02a-6b34c4450864 req-5ca42bed-3c03-4af1-97d4-3816f620cb37 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received unexpected event network-vif-plugged-4f31240a-f297-42c8-a9f5-65c64322c486 for instance with vm_state building and task_state spawning.
Aug 26 08:39:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:31 user nova-compute[73104]: DEBUG nova.compute.manager [req-3f397b49-202e-48ba-a86e-d240d8235c8f req-96707412-aa55-4383-8396-2b5e625fefe2 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-plugged-8469badb-d912-4a8d-ba41-cf4a04664c73 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3f397b49-202e-48ba-a86e-d240d8235c8f req-96707412-aa55-4383-8396-2b5e625fefe2 service nova] Acquiring lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3f397b49-202e-48ba-a86e-d240d8235c8f req-96707412-aa55-4383-8396-2b5e625fefe2 service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3f397b49-202e-48ba-a86e-d240d8235c8f req-96707412-aa55-4383-8396-2b5e625fefe2 service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:31 user nova-compute[73104]: DEBUG nova.compute.manager [req-3f397b49-202e-48ba-a86e-d240d8235c8f req-96707412-aa55-4383-8396-2b5e625fefe2 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] No waiting events found dispatching network-vif-plugged-8469badb-d912-4a8d-ba41-cf4a04664c73 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:31 user nova-compute[73104]: WARNING nova.compute.manager [req-3f397b49-202e-48ba-a86e-d240d8235c8f req-96707412-aa55-4383-8396-2b5e625fefe2 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received unexpected event network-vif-plugged-8469badb-d912-4a8d-ba41-cf4a04664c73 for instance with vm_state building and task_state spawning.
Aug 26 08:39:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:31 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.444s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:39:31 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] <== connect_volume: return (1447ms) {'type': 'block', 'scsi_wwn': '26662383138633730', 'path': '/dev/sdh'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:39:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662383138633730', 'path': '/dev/sdh'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:39:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:31 user nova-compute[73104]: DEBUG nova.objects.instance [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lazy-loading 'flavor' on Instance uuid afe2c15e-4e27-47f3-8b0b-426f4b8619d1 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:39:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 08:39:31 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:39:31 user nova-compute[73104]:   <source dev="/dev/sdh"/>
Aug 26 08:39:31 user nova-compute[73104]:   <target dev="sdc" bus="scsi"/>
Aug 26 08:39:31 user nova-compute[73104]:   <serial>897008b6-2f81-4d7b-b5a9-8b3bbc809d24</serial>
Aug 26 08:39:31 user nova-compute[73104]:   <address type="drive" controller="0" unit="2"/>
Aug 26 08:39:31 user nova-compute[73104]: </disk>
Aug 26 08:39:31 user nova-compute[73104]:  {{(pid=73104) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 08:39:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CnVhZiGL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:39:32 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:39:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:39:32 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:39:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:39:32 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:39:32 user nova-compute[73104]: DEBUG nova.compute.manager [req-bff1e3b9-ad20-4d78-bceb-634c87df6911 req-fb536c57-4ce0-444e-bcf2-15eaaa1e8165 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-plugged-8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-bff1e3b9-ad20-4d78-bceb-634c87df6911 req-fb536c57-4ce0-444e-bcf2-15eaaa1e8165 service nova] Acquiring lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-bff1e3b9-ad20-4d78-bceb-634c87df6911 req-fb536c57-4ce0-444e-bcf2-15eaaa1e8165 service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-bff1e3b9-ad20-4d78-bceb-634c87df6911 req-fb536c57-4ce0-444e-bcf2-15eaaa1e8165 service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG nova.compute.manager [req-bff1e3b9-ad20-4d78-bceb-634c87df6911 req-fb536c57-4ce0-444e-bcf2-15eaaa1e8165 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] No waiting events found dispatching network-vif-plugged-8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:32 user nova-compute[73104]: WARNING nova.compute.manager [req-bff1e3b9-ad20-4d78-bceb-634c87df6911 req-fb536c57-4ce0-444e-bcf2-15eaaa1e8165 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received unexpected event network-vif-plugged-8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56 for instance with vm_state building and task_state spawning.
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cb11b7-1c06-4ce5-ab61-ff6dcc9af557]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:39:32 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5b7667-a133-46eb-8778-b92dba287e93]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966] added
Aug 26 08:39:32 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[482e1938-705a-4c50-8af5-76bad0500c17]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[108efcd2-9ca1-4ecd-8fb7-d8ad828df6b0]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CnVhZiGL {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CnVhZiGL" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f43b4b-c6a1-4991-8616-47e422071d7e]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CnVhZiGL'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Acquiring lock "93244bcd-34be-46f3-85e6-87bb5e69888d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "93244bcd-34be-46f3-85e6-87bb5e69888d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG nova.objects.instance [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lazy-loading 'flavor' on Instance uuid 93244bcd-34be-46f3-85e6-87bb5e69888d {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b2ac10-c111-4e3c-b8fc-2203b7c5c8df]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6722acb4-1caf-4807-8be4-d5643d39a46c]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:32 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:32 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:32 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:39:32 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:39:32 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:39:32 user nova-compute[73104]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24 (non-flash)
Aug 26 08:39:32 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:32 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:32 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:32 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:39:32 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:39:32 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:39:32 user nova-compute[73104]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24 (non-flash)
Aug 26 08:39:32 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "93244bcd-34be-46f3-85e6-87bb5e69888d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 -p 172.16.0.220:3260 --login" returned: 0 in 0.110s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70e2517-bdf6-4a4f-a7a6-5599717a3a91]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966, portal: 172.16.0.220,3260]
Aug 26 08:39:32 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966, portal: 172.16.0.220,3260] successful.
Aug 26 08:39:32 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[709a20f3-29ab-4c68-838c-b641fafe71bc]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] No BDM found with device name sda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] No VIF found with MAC fa:16:3e:66:74:06, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7dad85-0b70-4d47-bc2d-47cdd0a3bb0f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:39:32 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:32 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:32 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:32 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:39:32 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:39:32 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:39:32 user nova-compute[73104]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24 (non-flash)
Aug 26 08:39:32 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:39:32 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:32 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:32 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:32 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:39:32 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:39:32 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:39:32 user nova-compute[73104]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24 (non-flash)
Aug 26 08:39:32 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.447s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9010d4-ea4d-4aee-a538-1d3d11575077]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CnVhZiGL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Acquiring lock "93244bcd-34be-46f3-85e6-87bb5e69888d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "93244bcd-34be-46f3-85e6-87bb5e69888d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:32 user nova-compute[73104]: INFO nova.compute.manager [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Attaching volume 4337d46c-79a9-4192-bfb5-490c342e1c25 to /dev/vdb
Aug 26 08:39:32 user nova-compute[73104]: DEBUG nova.compute.manager [req-a071044e-7e6e-47ef-8273-acbd90fb7e7e req-c5f5283b-5b23-4b48-988a-05c2c5139acf service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-plugged-4f31240a-f297-42c8-a9f5-65c64322c486 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a071044e-7e6e-47ef-8273-acbd90fb7e7e req-c5f5283b-5b23-4b48-988a-05c2c5139acf service nova] Acquiring lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a071044e-7e6e-47ef-8273-acbd90fb7e7e req-c5f5283b-5b23-4b48-988a-05c2c5139acf service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a071044e-7e6e-47ef-8273-acbd90fb7e7e req-c5f5283b-5b23-4b48-988a-05c2c5139acf service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG nova.compute.manager [req-a071044e-7e6e-47ef-8273-acbd90fb7e7e req-c5f5283b-5b23-4b48-988a-05c2c5139acf service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] No waiting events found dispatching network-vif-plugged-4f31240a-f297-42c8-a9f5-65c64322c486 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:32 user nova-compute[73104]: WARNING nova.compute.manager [req-a071044e-7e6e-47ef-8273-acbd90fb7e7e req-c5f5283b-5b23-4b48-988a-05c2c5139acf service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received unexpected event network-vif-plugged-4f31240a-f297-42c8-a9f5-65c64322c486 for instance with vm_state building and task_state spawning.
Aug 26 08:39:32 user nova-compute[73104]: DEBUG nova.compute.manager [req-a071044e-7e6e-47ef-8273-acbd90fb7e7e req-c5f5283b-5b23-4b48-988a-05c2c5139acf service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-plugged-7c7615d3-d6db-4a04-884b-34ad12ed49ab {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a071044e-7e6e-47ef-8273-acbd90fb7e7e req-c5f5283b-5b23-4b48-988a-05c2c5139acf service nova] Acquiring lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a071044e-7e6e-47ef-8273-acbd90fb7e7e req-c5f5283b-5b23-4b48-988a-05c2c5139acf service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a071044e-7e6e-47ef-8273-acbd90fb7e7e req-c5f5283b-5b23-4b48-988a-05c2c5139acf service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG nova.compute.manager [req-a071044e-7e6e-47ef-8273-acbd90fb7e7e req-c5f5283b-5b23-4b48-988a-05c2c5139acf service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] No waiting events found dispatching network-vif-plugged-7c7615d3-d6db-4a04-884b-34ad12ed49ab {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:32 user nova-compute[73104]: WARNING nova.compute.manager [req-a071044e-7e6e-47ef-8273-acbd90fb7e7e req-c5f5283b-5b23-4b48-988a-05c2c5139acf service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received unexpected event network-vif-plugged-7c7615d3-d6db-4a04-884b-34ad12ed49ab for instance with vm_state building and task_state spawning.
Aug 26 08:39:32 user nova-compute[73104]: DEBUG nova.compute.manager [req-a071044e-7e6e-47ef-8273-acbd90fb7e7e req-c5f5283b-5b23-4b48-988a-05c2c5139acf service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-plugged-7c7615d3-d6db-4a04-884b-34ad12ed49ab {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a071044e-7e6e-47ef-8273-acbd90fb7e7e req-c5f5283b-5b23-4b48-988a-05c2c5139acf service nova] Acquiring lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a071044e-7e6e-47ef-8273-acbd90fb7e7e req-c5f5283b-5b23-4b48-988a-05c2c5139acf service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a071044e-7e6e-47ef-8273-acbd90fb7e7e req-c5f5283b-5b23-4b48-988a-05c2c5139acf service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG nova.compute.manager [req-a071044e-7e6e-47ef-8273-acbd90fb7e7e req-c5f5283b-5b23-4b48-988a-05c2c5139acf service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] No waiting events found dispatching network-vif-plugged-7c7615d3-d6db-4a04-884b-34ad12ed49ab {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:32 user nova-compute[73104]: WARNING nova.compute.manager [req-a071044e-7e6e-47ef-8273-acbd90fb7e7e req-c5f5283b-5b23-4b48-988a-05c2c5139acf service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received unexpected event network-vif-plugged-7c7615d3-d6db-4a04-884b-34ad12ed49ab for instance with vm_state building and task_state spawning.
Aug 26 08:39:32 user nova-compute[73104]: DEBUG nova.compute.manager [req-a071044e-7e6e-47ef-8273-acbd90fb7e7e req-c5f5283b-5b23-4b48-988a-05c2c5139acf service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-plugged-e77e909b-af87-4825-b30b-a7062763e3ea {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a071044e-7e6e-47ef-8273-acbd90fb7e7e req-c5f5283b-5b23-4b48-988a-05c2c5139acf service nova] Acquiring lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a071044e-7e6e-47ef-8273-acbd90fb7e7e req-c5f5283b-5b23-4b48-988a-05c2c5139acf service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a071044e-7e6e-47ef-8273-acbd90fb7e7e req-c5f5283b-5b23-4b48-988a-05c2c5139acf service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG nova.compute.manager [req-a071044e-7e6e-47ef-8273-acbd90fb7e7e req-c5f5283b-5b23-4b48-988a-05c2c5139acf service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] No waiting events found dispatching network-vif-plugged-e77e909b-af87-4825-b30b-a7062763e3ea {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:32 user nova-compute[73104]: WARNING nova.compute.manager [req-a071044e-7e6e-47ef-8273-acbd90fb7e7e req-c5f5283b-5b23-4b48-988a-05c2c5139acf service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received unexpected event network-vif-plugged-e77e909b-af87-4825-b30b-a7062763e3ea for instance with vm_state building and task_state spawning.
Aug 26 08:39:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG os_brick.utils [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b4c8b0-3800-453a-b736-21f745064a3b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1c2b39ec-e4b6-4c02-90bb-e8ffc658880d tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lock "afe2c15e-4e27-47f3-8b0b-426f4b8619d1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.494s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[357384bb-c6d7-4885-a419-32af88021939]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2086afc4-5fdf-4eb4-876d-08eec9274a54]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[836b5d81-328f-4ec0-acb6-0ca073a59095]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:32 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:39:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9f0a94-c0f9-40a9-8796-5236b71b177a]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG os_brick.utils [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] <== get_connector_properties: return (193ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:39:32 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Updating existing volume attachment record: 5b29cb79-ae77-4d41-bf04-d70fecc02d4a {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 08:39:33 user nova-compute[73104]: DEBUG nova.compute.manager [req-236d5c9f-72df-4295-a35a-5d7133201de4 req-d9950507-b974-44d4-8b24-dd0f063266cd service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-plugged-8469badb-d912-4a8d-ba41-cf4a04664c73 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-236d5c9f-72df-4295-a35a-5d7133201de4 req-d9950507-b974-44d4-8b24-dd0f063266cd service nova] Acquiring lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-236d5c9f-72df-4295-a35a-5d7133201de4 req-d9950507-b974-44d4-8b24-dd0f063266cd service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-236d5c9f-72df-4295-a35a-5d7133201de4 req-d9950507-b974-44d4-8b24-dd0f063266cd service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:33 user nova-compute[73104]: DEBUG nova.compute.manager [req-236d5c9f-72df-4295-a35a-5d7133201de4 req-d9950507-b974-44d4-8b24-dd0f063266cd service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] No waiting events found dispatching network-vif-plugged-8469badb-d912-4a8d-ba41-cf4a04664c73 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:33 user nova-compute[73104]: WARNING nova.compute.manager [req-236d5c9f-72df-4295-a35a-5d7133201de4 req-d9950507-b974-44d4-8b24-dd0f063266cd service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received unexpected event network-vif-plugged-8469badb-d912-4a8d-ba41-cf4a04664c73 for instance with vm_state building and task_state spawning.
Aug 26 08:39:33 user nova-compute[73104]: DEBUG nova.compute.manager [req-236d5c9f-72df-4295-a35a-5d7133201de4 req-d9950507-b974-44d4-8b24-dd0f063266cd service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-plugged-4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-236d5c9f-72df-4295-a35a-5d7133201de4 req-d9950507-b974-44d4-8b24-dd0f063266cd service nova] Acquiring lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-236d5c9f-72df-4295-a35a-5d7133201de4 req-d9950507-b974-44d4-8b24-dd0f063266cd service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-236d5c9f-72df-4295-a35a-5d7133201de4 req-d9950507-b974-44d4-8b24-dd0f063266cd service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:33 user nova-compute[73104]: DEBUG nova.compute.manager [req-236d5c9f-72df-4295-a35a-5d7133201de4 req-d9950507-b974-44d4-8b24-dd0f063266cd service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] No waiting events found dispatching network-vif-plugged-4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:33 user nova-compute[73104]: WARNING nova.compute.manager [req-236d5c9f-72df-4295-a35a-5d7133201de4 req-d9950507-b974-44d4-8b24-dd0f063266cd service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received unexpected event network-vif-plugged-4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b for instance with vm_state building and task_state spawning.
Aug 26 08:39:33 user nova-compute[73104]: DEBUG nova.compute.manager [req-236d5c9f-72df-4295-a35a-5d7133201de4 req-d9950507-b974-44d4-8b24-dd0f063266cd service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-plugged-4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-236d5c9f-72df-4295-a35a-5d7133201de4 req-d9950507-b974-44d4-8b24-dd0f063266cd service nova] Acquiring lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-236d5c9f-72df-4295-a35a-5d7133201de4 req-d9950507-b974-44d4-8b24-dd0f063266cd service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-236d5c9f-72df-4295-a35a-5d7133201de4 req-d9950507-b974-44d4-8b24-dd0f063266cd service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:33 user nova-compute[73104]: DEBUG nova.compute.manager [req-236d5c9f-72df-4295-a35a-5d7133201de4 req-d9950507-b974-44d4-8b24-dd0f063266cd service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] No waiting events found dispatching network-vif-plugged-4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:33 user nova-compute[73104]: WARNING nova.compute.manager [req-236d5c9f-72df-4295-a35a-5d7133201de4 req-d9950507-b974-44d4-8b24-dd0f063266cd service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received unexpected event network-vif-plugged-4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b for instance with vm_state building and task_state spawning.
Aug 26 08:39:33 user nova-compute[73104]: DEBUG nova.compute.manager [req-236d5c9f-72df-4295-a35a-5d7133201de4 req-d9950507-b974-44d4-8b24-dd0f063266cd service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-plugged-7aabcef5-79f9-4f25-b095-ac587d15a460 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-236d5c9f-72df-4295-a35a-5d7133201de4 req-d9950507-b974-44d4-8b24-dd0f063266cd service nova] Acquiring lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-236d5c9f-72df-4295-a35a-5d7133201de4 req-d9950507-b974-44d4-8b24-dd0f063266cd service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-236d5c9f-72df-4295-a35a-5d7133201de4 req-d9950507-b974-44d4-8b24-dd0f063266cd service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:33 user nova-compute[73104]: DEBUG nova.compute.manager [req-236d5c9f-72df-4295-a35a-5d7133201de4 req-d9950507-b974-44d4-8b24-dd0f063266cd service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] No waiting events found dispatching network-vif-plugged-7aabcef5-79f9-4f25-b095-ac587d15a460 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:33 user nova-compute[73104]: WARNING nova.compute.manager [req-236d5c9f-72df-4295-a35a-5d7133201de4 req-d9950507-b974-44d4-8b24-dd0f063266cd service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received unexpected event network-vif-plugged-7aabcef5-79f9-4f25-b095-ac587d15a460 for instance with vm_state building and task_state spawning.
Aug 26 08:39:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.504s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:39:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] <== connect_volume: return (1506ms) {'type': 'block', 'scsi_wwn': '23731356366346562', 'path': '/dev/sdi'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:39:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731356366346562', 'path': '/dev/sdi'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:39:33 user nova-compute[73104]: DEBUG nova.objects.instance [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lazy-loading 'flavor' on Instance uuid 13200b79-17a6-4c18-87da-653311946a04 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:39:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 08:39:33 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:39:33 user nova-compute[73104]:   <source dev="/dev/sdi"/>
Aug 26 08:39:33 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:39:33 user nova-compute[73104]:   <serial>509cda48-d4cc-4341-bd5b-25cc81265966</serial>
Aug 26 08:39:33 user nova-compute[73104]: </disk>
Aug 26 08:39:33 user nova-compute[73104]:  {{(pid=73104) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 08:39:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-de170ca7-8177-475b-973a-2734b848824e tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Acquiring lock "afe2c15e-4e27-47f3-8b0b-426f4b8619d1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-de170ca7-8177-475b-973a-2734b848824e tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lock "afe2c15e-4e27-47f3-8b0b-426f4b8619d1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:33 user nova-compute[73104]: INFO nova.compute.manager [None req-de170ca7-8177-475b-973a-2734b848824e tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Detaching volume 897008b6-2f81-4d7b-b5a9-8b3bbc809d24
Aug 26 08:39:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Acquiring lock "b04e96c7-f098-4612-b0b8-92cf6fd58865" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Lock "b04e96c7-f098-4612-b0b8-92cf6fd58865" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:33 user nova-compute[73104]: INFO nova.virt.block_device [None req-de170ca7-8177-475b-973a-2734b848824e tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Attempting to driver detach volume 897008b6-2f81-4d7b-b5a9-8b3bbc809d24 from mountpoint /dev/sdc
Aug 26 08:39:33 user nova-compute[73104]: DEBUG nova.objects.instance [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Lazy-loading 'flavor' on Instance uuid b04e96c7-f098-4612-b0b8-92cf6fd58865 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:39:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-de170ca7-8177-475b-973a-2734b848824e tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Attempting to detach device sdc from instance afe2c15e-4e27-47f3-8b0b-426f4b8619d1 from the persistent domain config. {{(pid=73104) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 08:39:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-de170ca7-8177-475b-973a-2734b848824e tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:39:33 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:39:33 user nova-compute[73104]:   <source dev="/dev/sdh"/>
Aug 26 08:39:33 user nova-compute[73104]:   <target dev="sdc" bus="scsi"/>
Aug 26 08:39:33 user nova-compute[73104]:   <serial>897008b6-2f81-4d7b-b5a9-8b3bbc809d24</serial>
Aug 26 08:39:33 user nova-compute[73104]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 26 08:39:33 user nova-compute[73104]: </disk>
Aug 26 08:39:33 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:39:33 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-de170ca7-8177-475b-973a-2734b848824e tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Successfully detached device sdc from instance afe2c15e-4e27-47f3-8b0b-426f4b8619d1 from the persistent domain config.
Aug 26 08:39:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-de170ca7-8177-475b-973a-2734b848824e tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance afe2c15e-4e27-47f3-8b0b-426f4b8619d1 from the live domain config. {{(pid=73104) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 08:39:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-de170ca7-8177-475b-973a-2734b848824e tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:39:33 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:39:33 user nova-compute[73104]:   <source dev="/dev/sdh"/>
Aug 26 08:39:33 user nova-compute[73104]:   <target dev="sdc" bus="scsi"/>
Aug 26 08:39:33 user nova-compute[73104]:   <serial>897008b6-2f81-4d7b-b5a9-8b3bbc809d24</serial>
Aug 26 08:39:33 user nova-compute[73104]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 26 08:39:33 user nova-compute[73104]: </disk>
Aug 26 08:39:33 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:39:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Lock "b04e96c7-f098-4612-b0b8-92cf6fd58865" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] No VIF found with MAC fa:16:3e:16:f1:1c, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG nova.compute.manager [req-606013dc-5e8b-4d0c-9170-28cef9f86a1a req-c9abbe55-9d03-48c9-92ee-2ce1ff0fe77c service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-plugged-8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-606013dc-5e8b-4d0c-9170-28cef9f86a1a req-c9abbe55-9d03-48c9-92ee-2ce1ff0fe77c service nova] Acquiring lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-606013dc-5e8b-4d0c-9170-28cef9f86a1a req-c9abbe55-9d03-48c9-92ee-2ce1ff0fe77c service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-606013dc-5e8b-4d0c-9170-28cef9f86a1a req-c9abbe55-9d03-48c9-92ee-2ce1ff0fe77c service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG nova.compute.manager [req-606013dc-5e8b-4d0c-9170-28cef9f86a1a req-c9abbe55-9d03-48c9-92ee-2ce1ff0fe77c service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] No waiting events found dispatching network-vif-plugged-8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:34 user nova-compute[73104]: WARNING nova.compute.manager [req-606013dc-5e8b-4d0c-9170-28cef9f86a1a req-c9abbe55-9d03-48c9-92ee-2ce1ff0fe77c service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received unexpected event network-vif-plugged-8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56 for instance with vm_state building and task_state spawning.
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Acquiring lock "b04e96c7-f098-4612-b0b8-92cf6fd58865" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Lock "b04e96c7-f098-4612-b0b8-92cf6fd58865" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.004s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:34 user nova-compute[73104]: INFO nova.compute.manager [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Attaching volume bfe480fb-da99-4daa-afa2-9b2e89bd76b3 to /dev/vdb
Aug 26 08:39:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-4c7b4bef-a399-425a-a2ad-cfea9d502cb1 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "13200b79-17a6-4c18-87da-653311946a04" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.070s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG os_brick.utils [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Received event <DeviceRemovedEvent: 1693039174.3314974, afe2c15e-4e27-47f3-8b0b-426f4b8619d1 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73104) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-de170ca7-8177-475b-973a-2734b848824e tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance afe2c15e-4e27-47f3-8b0b-426f4b8619d1 {{(pid=73104) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ea7e2e-9bf4-4d0e-9713-87f62d9fb49f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:34 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-de170ca7-8177-475b-973a-2734b848824e tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Successfully detached device sdc from instance afe2c15e-4e27-47f3-8b0b-426f4b8619d1 from the live domain config.
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de170ca7-8177-475b-973a-2734b848824e tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-de170ca7-8177-475b-973a-2734b848824e tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NjVCTKox', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:39:34 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-de170ca7-8177-475b-973a-2734b848824e tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:39:34 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-de170ca7-8177-475b-973a-2734b848824e tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-de170ca7-8177-475b-973a-2734b848824e tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-de170ca7-8177-475b-973a-2734b848824e tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7288f1-35f0-45a8-a2b9-8ffd4c6709c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8134bba0-cf11-4c78-a12a-d150f39db83d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fac8a1a-211e-4c8b-887b-e3cb689fd47e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb4f62b-130c-46a8-b7dc-c4ac412d1f2f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[767a1e44-03d6-4eb8-87fc-c737d428e5e0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-de170ca7-8177-475b-973a-2734b848824e tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:39:34 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:34 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:34 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:34 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:39:34 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:39:34 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:39:34 user nova-compute[73104]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24 (non-flash)
Aug 26 08:39:34 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-de170ca7-8177-475b-973a-2734b848824e tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:39:34 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:34 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:34 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:34 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:39:34 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:39:34 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:39:34 user nova-compute[73104]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24 (non-flash)
Aug 26 08:39:34 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-de170ca7-8177-475b-973a-2734b848824e tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0c4612c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24'): ({'sdh'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-de170ca7-8177-475b-973a-2734b848824e tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Removing single pathed devices sdh {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:39:34 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a319282-0f11-4897-99a7-621cbdd4512b]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG os_brick.utils [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Updating existing volume attachment record: 7348d3c6-d1ea-4cec-9063-95573db73359 {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f07c3f-4bf5-40db-80d6-fd9efba1d85c]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca48181-b5b1-47fe-b094-d8a1878bf83f]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-de170ca7-8177-475b-973a-2734b848824e tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Flushing IO for device /dev/sdh {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1043b47e-d992-4d79-b234-a29306ac6d47]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-de170ca7-8177-475b-973a-2734b848824e tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.039s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2e63ab-90f7-4b03-a9db-8c40f39cd35d]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-de170ca7-8177-475b-973a-2734b848824e tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-de170ca7-8177-475b-973a-2734b848824e tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] SCSI volumes sdh have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-de170ca7-8177-475b-973a-2734b848824e tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d45d845-cd73-425a-b80a-869ee3807184]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-de170ca7-8177-475b-973a-2734b848824e tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[61abd6fe-3998-4606-96ca-0bd0a49bf81d]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-de170ca7-8177-475b-973a-2734b848824e tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24, portal: 172.16.0.220,3260]
Aug 26 08:39:34 user nova-compute[73104]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24, portal: 172.16.0.220,3260] successful.
Aug 26 08:39:34 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:897008b6-2f81-4d7b-b5a9-8b3bbc809d24 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75558dc-c79d-44d4-9db9-9e037f36514e]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-de170ca7-8177-475b-973a-2734b848824e tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-de170ca7-8177-475b-973a-2734b848824e tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-de170ca7-8177-475b-973a-2734b848824e tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] <== disconnect_volume: return (364ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de170ca7-8177-475b-973a-2734b848824e tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG nova.compute.manager [req-84281fa2-b2c7-4bc9-a8e6-1a771971b6f2 req-4bebef37-6e5f-4bcb-9c1b-c07dded1dfb1 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-plugged-e77e909b-af87-4825-b30b-a7062763e3ea {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-84281fa2-b2c7-4bc9-a8e6-1a771971b6f2 req-4bebef37-6e5f-4bcb-9c1b-c07dded1dfb1 service nova] Acquiring lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-84281fa2-b2c7-4bc9-a8e6-1a771971b6f2 req-4bebef37-6e5f-4bcb-9c1b-c07dded1dfb1 service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-84281fa2-b2c7-4bc9-a8e6-1a771971b6f2 req-4bebef37-6e5f-4bcb-9c1b-c07dded1dfb1 service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:34 user nova-compute[73104]: DEBUG nova.compute.manager [req-84281fa2-b2c7-4bc9-a8e6-1a771971b6f2 req-4bebef37-6e5f-4bcb-9c1b-c07dded1dfb1 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] No waiting events found dispatching network-vif-plugged-e77e909b-af87-4825-b30b-a7062763e3ea {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:34 user nova-compute[73104]: WARNING nova.compute.manager [req-84281fa2-b2c7-4bc9-a8e6-1a771971b6f2 req-4bebef37-6e5f-4bcb-9c1b-c07dded1dfb1 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received unexpected event network-vif-plugged-e77e909b-af87-4825-b30b-a7062763e3ea for instance with vm_state building and task_state spawning.
Aug 26 08:39:35 user nova-compute[73104]: DEBUG nova.compute.manager [req-87c2e7c7-818c-4d13-9794-5f66fe3d263e req-ff44a483-136c-4607-b566-0bf19a54570a service nova] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Received event network-changed-e589161d-f15a-4143-8dcc-445bb29fbdff {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:35 user nova-compute[73104]: DEBUG nova.compute.manager [req-87c2e7c7-818c-4d13-9794-5f66fe3d263e req-ff44a483-136c-4607-b566-0bf19a54570a service nova] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Refreshing instance network info cache due to event network-changed-e589161d-f15a-4143-8dcc-445bb29fbdff. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:39:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-87c2e7c7-818c-4d13-9794-5f66fe3d263e req-ff44a483-136c-4607-b566-0bf19a54570a service nova] Acquiring lock "refresh_cache-b04e96c7-f098-4612-b0b8-92cf6fd58865" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:39:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-87c2e7c7-818c-4d13-9794-5f66fe3d263e req-ff44a483-136c-4607-b566-0bf19a54570a service nova] Acquired lock "refresh_cache-b04e96c7-f098-4612-b0b8-92cf6fd58865" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:39:35 user nova-compute[73104]: DEBUG nova.network.neutron [req-87c2e7c7-818c-4d13-9794-5f66fe3d263e req-ff44a483-136c-4607-b566-0bf19a54570a service nova] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Refreshing network info cache for port e589161d-f15a-4143-8dcc-445bb29fbdff {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:39:35 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039175.342938, 7170b5a8-12a7-4ddf-8089-fde172570fd1 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:39:35 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] VM Resumed (Lifecycle Event)
Aug 26 08:39:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:39:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:39:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:39:35 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Instance spawned successfully.
Aug 26 08:39:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:39:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:39:35 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:39:35 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039175.3467798, 7170b5a8-12a7-4ddf-8089-fde172570fd1 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:39:35 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] VM Started (Lifecycle Event)
Aug 26 08:39:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:39:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:39:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:39:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:39:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:39:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:39:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:39:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:39:35 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:39:35 user nova-compute[73104]: INFO nova.compute.manager [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Took 11.93 seconds to spawn the instance on the hypervisor.
Aug 26 08:39:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:39:35 user nova-compute[73104]: INFO nova.compute.manager [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Took 62.10 seconds to build instance.
Aug 26 08:39:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1a48ad68-cb21-40db-8d4b-7ff194d24815 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 62.308s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:35 user nova-compute[73104]: DEBUG nova.network.neutron [req-87c2e7c7-818c-4d13-9794-5f66fe3d263e req-ff44a483-136c-4607-b566-0bf19a54570a service nova] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Updated VIF entry in instance network info cache for port e589161d-f15a-4143-8dcc-445bb29fbdff. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:39:35 user nova-compute[73104]: DEBUG nova.network.neutron [req-87c2e7c7-818c-4d13-9794-5f66fe3d263e req-ff44a483-136c-4607-b566-0bf19a54570a service nova] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Updating instance_info_cache with network_info: [{"id": "e589161d-f15a-4143-8dcc-445bb29fbdff", "address": "fa:16:3e:23:5b:3a", "network": {"id": "6e5e1144-fa42-42e5-83e5-82d1825ede71", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-135318777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "251199a8e75247e897551cb5bc1aec00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape589161d-f1", "ovs_interfaceid": "e589161d-f15a-4143-8dcc-445bb29fbdff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:39:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-87c2e7c7-818c-4d13-9794-5f66fe3d263e req-ff44a483-136c-4607-b566-0bf19a54570a service nova] Releasing lock "refresh_cache-b04e96c7-f098-4612-b0b8-92cf6fd58865" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:39:35 user nova-compute[73104]: DEBUG nova.compute.manager [req-87c2e7c7-818c-4d13-9794-5f66fe3d263e req-ff44a483-136c-4607-b566-0bf19a54570a service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-plugged-7aabcef5-79f9-4f25-b095-ac587d15a460 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-87c2e7c7-818c-4d13-9794-5f66fe3d263e req-ff44a483-136c-4607-b566-0bf19a54570a service nova] Acquiring lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-87c2e7c7-818c-4d13-9794-5f66fe3d263e req-ff44a483-136c-4607-b566-0bf19a54570a service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-87c2e7c7-818c-4d13-9794-5f66fe3d263e req-ff44a483-136c-4607-b566-0bf19a54570a service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:35 user nova-compute[73104]: DEBUG nova.compute.manager [req-87c2e7c7-818c-4d13-9794-5f66fe3d263e req-ff44a483-136c-4607-b566-0bf19a54570a service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] No waiting events found dispatching network-vif-plugged-7aabcef5-79f9-4f25-b095-ac587d15a460 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:35 user nova-compute[73104]: WARNING nova.compute.manager [req-87c2e7c7-818c-4d13-9794-5f66fe3d263e req-ff44a483-136c-4607-b566-0bf19a54570a service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received unexpected event network-vif-plugged-7aabcef5-79f9-4f25-b095-ac587d15a460 for instance with vm_state building and task_state spawning.
Aug 26 08:39:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:43 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:39:43 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 08:39:43 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Skipping network cache update for instance because it has been migrated to another host. {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9886}}
Aug 26 08:39:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-13200b79-17a6-4c18-87da-653311946a04" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:39:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-13200b79-17a6-4c18-87da-653311946a04" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:39:43 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 13200b79-17a6-4c18-87da-653311946a04] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 08:39:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:44 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 13200b79-17a6-4c18-87da-653311946a04] Updating instance_info_cache with network_info: [{"id": "76ccf91d-d705-4512-8bd8-d6747105f390", "address": "fa:16:3e:16:f1:1c", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ccf91d-d7", "ovs_interfaceid": "76ccf91d-d705-4512-8bd8-d6747105f390", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:39:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-13200b79-17a6-4c18-87da-653311946a04" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:39:44 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 13200b79-17a6-4c18-87da-653311946a04] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 08:39:44 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:39:44 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:39:44 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:39:44 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 08:39:44 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:39:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:44 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 08:39:44 user nova-compute[73104]: DEBUG nova.objects.instance [None req-de170ca7-8177-475b-973a-2734b848824e tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lazy-loading 'flavor' on Instance uuid afe2c15e-4e27-47f3-8b0b-426f4b8619d1 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:39:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-de170ca7-8177-475b-973a-2734b848824e tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lock "afe2c15e-4e27-47f3-8b0b-426f4b8619d1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 10.994s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:39:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:39:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:39:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe2c15e-4e27-47f3-8b0b-426f4b8619d1/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:45 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe2c15e-4e27-47f3-8b0b-426f4b8619d1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:45 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe2c15e-4e27-47f3-8b0b-426f4b8619d1/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:45 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe2c15e-4e27-47f3-8b0b-426f4b8619d1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:45 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85eea82a-c221-4661-9525-06a925b57e1c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:45 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85eea82a-c221-4661-9525-06a925b57e1c/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:45 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85eea82a-c221-4661-9525-06a925b57e1c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ad84eacf-cc9e-454f-84df-6303d34eb3f3 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Acquiring lock "afe2c15e-4e27-47f3-8b0b-426f4b8619d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ad84eacf-cc9e-454f-84df-6303d34eb3f3 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lock "afe2c15e-4e27-47f3-8b0b-426f4b8619d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ad84eacf-cc9e-454f-84df-6303d34eb3f3 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Acquiring lock "afe2c15e-4e27-47f3-8b0b-426f4b8619d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ad84eacf-cc9e-454f-84df-6303d34eb3f3 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lock "afe2c15e-4e27-47f3-8b0b-426f4b8619d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ad84eacf-cc9e-454f-84df-6303d34eb3f3 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lock "afe2c15e-4e27-47f3-8b0b-426f4b8619d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:45 user nova-compute[73104]: INFO nova.compute.manager [None req-ad84eacf-cc9e-454f-84df-6303d34eb3f3 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Terminating instance
Aug 26 08:39:45 user nova-compute[73104]: DEBUG nova.compute.manager [None req-ad84eacf-cc9e-454f-84df-6303d34eb3f3 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 08:39:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:45 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85eea82a-c221-4661-9525-06a925b57e1c/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:39:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:39:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:39:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:45 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:45 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:45 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:46 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:39:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04e96c7-f098-4612-b0b8-92cf6fd58865/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:46 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Instance destroyed successfully.
Aug 26 08:39:46 user nova-compute[73104]: DEBUG nova.objects.instance [None req-ad84eacf-cc9e-454f-84df-6303d34eb3f3 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lazy-loading 'resources' on Instance uuid afe2c15e-4e27-47f3-8b0b-426f4b8619d1 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:39:46 user nova-compute[73104]: DEBUG nova.compute.manager [req-aa1aa94d-bc73-436b-8e7a-2c5a0429b05c req-6a870623-84a3-41f9-a2f5-c7fe8584c5ae service nova] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Received event network-vif-unplugged-54d197ce-aea5-41ab-b450-e86a182c8bc4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-aa1aa94d-bc73-436b-8e7a-2c5a0429b05c req-6a870623-84a3-41f9-a2f5-c7fe8584c5ae service nova] Acquiring lock "afe2c15e-4e27-47f3-8b0b-426f4b8619d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-aa1aa94d-bc73-436b-8e7a-2c5a0429b05c req-6a870623-84a3-41f9-a2f5-c7fe8584c5ae service nova] Lock "afe2c15e-4e27-47f3-8b0b-426f4b8619d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-aa1aa94d-bc73-436b-8e7a-2c5a0429b05c req-6a870623-84a3-41f9-a2f5-c7fe8584c5ae service nova] Lock "afe2c15e-4e27-47f3-8b0b-426f4b8619d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:46 user nova-compute[73104]: DEBUG nova.compute.manager [req-aa1aa94d-bc73-436b-8e7a-2c5a0429b05c req-6a870623-84a3-41f9-a2f5-c7fe8584c5ae service nova] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] No waiting events found dispatching network-vif-unplugged-54d197ce-aea5-41ab-b450-e86a182c8bc4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:46 user nova-compute[73104]: DEBUG nova.compute.manager [req-aa1aa94d-bc73-436b-8e7a-2c5a0429b05c req-6a870623-84a3-41f9-a2f5-c7fe8584c5ae service nova] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Received event network-vif-unplugged-54d197ce-aea5-41ab-b450-e86a182c8bc4 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:39:46 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-ad84eacf-cc9e-454f-84df-6303d34eb3f3 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:37:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1322977777',display_name='tempest-AttachSCSIVolumeTestJSON-server-1322977777',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1322977777',id=6,image_ref='e401a7c1-a4d7-4a65-ac53-540cca411897',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5Cij8zzsqNQ3suHvcWHlj8vdwh3bDjHGyHymq20YHDioVhNYfec41mqWnzYQQBxAZyfs+RvLmFx6OgsuZnRz3xWUzUTO240PiMzhHbQBoji/KTOh75/CQeig0NkNHfQA==',key_name='tempest-keypair-502951310',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:37:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3dfab4672f4f4303839a67b98699cae5',ramdisk_id='',reservation_id='r-76pw76wt',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e401a7c1-a4d7-4a65-ac53-540cca411897',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-662982876',owner_user_name='tempest-AttachSCSIVolumeTestJSON-662982876-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:37:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a60dca728ca341b2a6908ba984a799e4',uuid=afe2c15e-4e27-47f3-8b0b-426f4b8619d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54d197ce-aea5-41ab-b450-e86a182c8bc4", "address": "fa:16:3e:66:74:06", "network": {"id": "e0ff8c51-555a-4539-8408-7efee217025c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1595132883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dfab4672f4f4303839a67b98699cae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54d197ce-ae", "ovs_interfaceid": "54d197ce-aea5-41ab-b450-e86a182c8bc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:39:46 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-ad84eacf-cc9e-454f-84df-6303d34eb3f3 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Converting VIF {"id": "54d197ce-aea5-41ab-b450-e86a182c8bc4", "address": "fa:16:3e:66:74:06", "network": {"id": "e0ff8c51-555a-4539-8408-7efee217025c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1595132883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dfab4672f4f4303839a67b98699cae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54d197ce-ae", "ovs_interfaceid": "54d197ce-aea5-41ab-b450-e86a182c8bc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:39:46 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-ad84eacf-cc9e-454f-84df-6303d34eb3f3 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:74:06,bridge_name='br-int',has_traffic_filtering=True,id=54d197ce-aea5-41ab-b450-e86a182c8bc4,network=Network(e0ff8c51-555a-4539-8408-7efee217025c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54d197ce-ae') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:39:46 user nova-compute[73104]: DEBUG os_vif [None req-ad84eacf-cc9e-454f-84df-6303d34eb3f3 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:74:06,bridge_name='br-int',has_traffic_filtering=True,id=54d197ce-aea5-41ab-b450-e86a182c8bc4,network=Network(e0ff8c51-555a-4539-8408-7efee217025c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54d197ce-ae') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:39:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04e96c7-f098-4612-b0b8-92cf6fd58865/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54d197ce-ae, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04e96c7-f098-4612-b0b8-92cf6fd58865/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:39:46 user nova-compute[73104]: INFO os_vif [None req-ad84eacf-cc9e-454f-84df-6303d34eb3f3 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:74:06,bridge_name='br-int',has_traffic_filtering=True,id=54d197ce-aea5-41ab-b450-e86a182c8bc4,network=Network(e0ff8c51-555a-4539-8408-7efee217025c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54d197ce-ae')
Aug 26 08:39:46 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-ad84eacf-cc9e-454f-84df-6303d34eb3f3 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Deleting instance files /opt/stack/data/nova/instances/afe2c15e-4e27-47f3-8b0b-426f4b8619d1_del
Aug 26 08:39:46 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-ad84eacf-cc9e-454f-84df-6303d34eb3f3 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Deletion of /opt/stack/data/nova/instances/afe2c15e-4e27-47f3-8b0b-426f4b8619d1_del complete
Aug 26 08:39:46 user nova-compute[73104]: INFO nova.compute.manager [None req-ad84eacf-cc9e-454f-84df-6303d34eb3f3 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 26 08:39:46 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-ad84eacf-cc9e-454f-84df-6303d34eb3f3 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 08:39:46 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 08:39:46 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 08:39:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04e96c7-f098-4612-b0b8-92cf6fd58865/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:47 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:39:47 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jYyrpFvI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:39:47 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:39:47 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:39:47 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:39:47 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:39:47 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:39:47 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:39:47 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:39:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d4c05-720a-4dc7-afa0-ac823e70060a/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:47 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[96700212-6f18-4a25-bdbc-f1c80bcef90f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:47 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:39:47 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:47 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5a76a2-58b4-47fc-9130-b50a95b4fae8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:47 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25] added
Aug 26 08:39:47 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:47 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ddc922-2b7e-480c-9643-6f12c7946ed2]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:47 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5ba7c3-1c68-42f8-8625-0072cff6ec43]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jYyrpFvI {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jYyrpFvI" returned: 0 in 0.027s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0950a85f-47e1-4a6b-b58a-2f4ee9f758e9]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jYyrpFvI'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a40e9d-ea44-46d6-9ae8-3f27c4311c77]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d4c05-720a-4dc7-afa0-ac823e70060a/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d4c05-720a-4dc7-afa0-ac823e70060a/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafe32d2-2974-4995-98b8-3e1f15a4bb0a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:39:48 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:48 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:48 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:48 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:39:48 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:39:48 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:39:48 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:39:48 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:48 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:48 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:48 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:39:48 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:39:48 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:39:48 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25 -p 172.16.0.220:3260 --login" returned: 0 in 0.116s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[58df1942-394f-4f2b-88ec-a78d9479d5f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25, portal: 172.16.0.220,3260]
Aug 26 08:39:48 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25, portal: 172.16.0.220,3260] successful.
Aug 26 08:39:48 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce91f14-d352-4545-9b53-3dc2557db5bb]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d4c05-720a-4dc7-afa0-ac823e70060a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[402b468d-5dfb-40fc-b983-d759966d92c0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:39:48 user nova-compute[73104]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25 (non-flash)
Aug 26 08:39:48 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:48 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:48 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:48 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:39:48 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:39:48 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:39:48 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:39:48 user nova-compute[73104]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25 (non-flash)
Aug 26 08:39:48 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:48 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:48 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:48 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:39:48 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:39:48 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:39:48 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.497s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] HCTL ('39', '-', '-', 0) found on session 11 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:39:48 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e18f5b4-252e-422a-aabb-97cf8e4ac43d]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-813567fa-cc4c-4df5-87f3-0e13fdf27e99 req-af5244e1-ac58-4b8d-8809-a8d9b06d0865 service nova] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Received event network-vif-plugged-54d197ce-aea5-41ab-b450-e86a182c8bc4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-813567fa-cc4c-4df5-87f3-0e13fdf27e99 req-af5244e1-ac58-4b8d-8809-a8d9b06d0865 service nova] Acquiring lock "afe2c15e-4e27-47f3-8b0b-426f4b8619d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-813567fa-cc4c-4df5-87f3-0e13fdf27e99 req-af5244e1-ac58-4b8d-8809-a8d9b06d0865 service nova] Lock "afe2c15e-4e27-47f3-8b0b-426f4b8619d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-813567fa-cc4c-4df5-87f3-0e13fdf27e99 req-af5244e1-ac58-4b8d-8809-a8d9b06d0865 service nova] Lock "afe2c15e-4e27-47f3-8b0b-426f4b8619d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-813567fa-cc4c-4df5-87f3-0e13fdf27e99 req-af5244e1-ac58-4b8d-8809-a8d9b06d0865 service nova] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] No waiting events found dispatching network-vif-plugged-54d197ce-aea5-41ab-b450-e86a182c8bc4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:49 user nova-compute[73104]: WARNING nova.compute.manager [req-813567fa-cc4c-4df5-87f3-0e13fdf27e99 req-af5244e1-ac58-4b8d-8809-a8d9b06d0865 service nova] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Received unexpected event network-vif-plugged-54d197ce-aea5-41ab-b450-e86a182c8bc4 for instance with vm_state active and task_state deleting.
Aug 26 08:39:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-cc1075a8-404d-4323-b83e-37436323ed16 req-bcdf8a74-fe11-44f4-8e5f-2a42824caa2c service nova] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Received event network-vif-deleted-54d197ce-aea5-41ab-b450-e86a182c8bc4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:49 user nova-compute[73104]: INFO nova.compute.manager [req-cc1075a8-404d-4323-b83e-37436323ed16 req-bcdf8a74-fe11-44f4-8e5f-2a42824caa2c service nova] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Neutron deleted interface 54d197ce-aea5-41ab-b450-e86a182c8bc4; detaching it from the instance and deleting it from the info cache
Aug 26 08:39:49 user nova-compute[73104]: DEBUG nova.network.neutron [req-cc1075a8-404d-4323-b83e-37436323ed16 req-bcdf8a74-fe11-44f4-8e5f-2a42824caa2c service nova] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Searching for a device in session 11 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jYyrpFvI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.255s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] <== connect_volume: return (1257ms) {'type': 'block', 'scsi_wwn': '23732333539663530', 'path': '/dev/sdh'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732333539663530', 'path': '/dev/sdh'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eKSqZRTx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:39:49 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:39:49 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:39:49 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:39:49 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:39:49 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:49 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Took 2.61 seconds to deallocate network for instance.
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2944bb50-f41f-42ca-a45a-64348d6d763c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:49 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:39:49 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:39:49 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=7104MB free_disk=24.560535430908203GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:39:49 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-cc1075a8-404d-4323-b83e-37436323ed16 req-bcdf8a74-fe11-44f4-8e5f-2a42824caa2c service nova] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Detach interface failed, port_id=54d197ce-aea5-41ab-b450-e86a182c8bc4, reason: Instance afe2c15e-4e27-47f3-8b0b-426f4b8619d1 could not be found. {{(pid=73104) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG nova.objects.instance [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lazy-loading 'flavor' on Instance uuid 93244bcd-34be-46f3-85e6-87bb5e69888d {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a762b7-6971-47de-9c74-a48cb64db556]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3] added
Aug 26 08:39:49 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 08:39:49 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:39:49 user nova-compute[73104]:   <source dev="/dev/sdh"/>
Aug 26 08:39:49 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:39:49 user nova-compute[73104]:   <serial>4337d46c-79a9-4192-bfb5-490c342e1c25</serial>
Aug 26 08:39:49 user nova-compute[73104]: </disk>
Aug 26 08:39:49 user nova-compute[73104]:  {{(pid=73104) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ad84eacf-cc9e-454f-84df-6303d34eb3f3 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5b2dc3-4f52-4c73-a612-b5fd33e2fd6c]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f5a669-969b-4958-bf1a-871a0f067e1c]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eKSqZRTx {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eKSqZRTx" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e26b18-5c85-4959-aae6-ce0156476f5e]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eKSqZRTx'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[677efe89-2fe5-4b65-b3d2-758530b836e5]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4942b2b4-63db-4538-8b1b-21ab337d9865]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:39:49 user nova-compute[73104]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25 (non-flash)
Aug 26 08:39:49 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:49 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:49 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:49 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:39:49 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:39:49 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:39:49 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:39:49 user nova-compute[73104]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25 (non-flash)
Aug 26 08:39:49 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:49 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:49 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:49 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:39:49 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:39:49 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:39:49 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance dcec7631-b94f-4dbf-b85d-e8ad9c6396b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 13200b79-17a6-4c18-87da-653311946a04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 385c6d93-907d-42d7-9b43-479e6caf66f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance afe2c15e-4e27-47f3-8b0b-426f4b8619d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 93244bcd-34be-46f3-85e6-87bb5e69888d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance b04e96c7-f098-4612-b0b8-92cf6fd58865 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 85eea82a-c221-4661-9525-06a925b57e1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance e2ec2788-98c7-48a7-933a-433dc215d7ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 7170b5a8-12a7-4ddf-8089-fde172570fd1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance f22d4c05-720a-4dc7-afa0-ac823e70060a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance da850cb3-3d57-4243-8af8-13c7f3251787 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "da850cb3-3d57-4243-8af8-13c7f3251787" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "da850cb3-3d57-4243-8af8-13c7f3251787" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.111s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a90555-340c-478a-81b1-a6eb63138a3e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3, portal: 172.16.0.220,3260]
Aug 26 08:39:49 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3, portal: 172.16.0.220,3260] successful.
Aug 26 08:39:49 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG nova.compute.manager [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e654093-b0a8-4a55-bff0-e0869cbd2cad]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f4b02e-9a0a-4776-9a76-b7cc6a2f33c4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:39:49 user nova-compute[73104]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25 (non-flash)
Aug 26 08:39:49 user nova-compute[73104]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3 (non-flash)
Aug 26 08:39:49 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:49 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:49 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:49 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:39:49 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:39:49 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:39:49 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:39:49 user nova-compute[73104]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25 (non-flash)
Aug 26 08:39:49 user nova-compute[73104]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3 (non-flash)
Aug 26 08:39:49 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:49 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:49 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:49 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:39:49 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:39:49 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:39:49 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.428s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] HCTL ('41', '-', '-', 0) found on session 12 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8007eb6-bb90-4bcf-bd9c-b61d35313917]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Searching for a device in session 12 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eKSqZRTx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] No VIF found with MAC fa:16:3e:d5:84:96, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7df4533b-4eeb-4764-bc4b-18ba300666c0 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "93244bcd-34be-46f3-85e6-87bb5e69888d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.216s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.704s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ad84eacf-cc9e-454f-84df-6303d34eb3f3 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.653s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:50 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-ad84eacf-cc9e-454f-84df-6303d34eb3f3 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:39:50 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-ad84eacf-cc9e-454f-84df-6303d34eb3f3 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:39:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ad84eacf-cc9e-454f-84df-6303d34eb3f3 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.593s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:50 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:39:50 user nova-compute[73104]: INFO nova.compute.claims [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Claim successful on node user
Aug 26 08:39:50 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-ad84eacf-cc9e-454f-84df-6303d34eb3f3 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Deleted allocations for instance afe2c15e-4e27-47f3-8b0b-426f4b8619d1
Aug 26 08:39:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ad84eacf-cc9e-454f-84df-6303d34eb3f3 tempest-AttachSCSIVolumeTestJSON-662982876 tempest-AttachSCSIVolumeTestJSON-662982876-project-member] Lock "afe2c15e-4e27-47f3-8b0b-426f4b8619d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.857s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:50 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.469s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:39:50 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] <== connect_volume: return (1470ms) {'type': 'block', 'scsi_wwn': '26238326539306531', 'path': '/dev/sdj'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:39:50 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238326539306531', 'path': '/dev/sdj'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:39:50 user nova-compute[73104]: DEBUG nova.objects.instance [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Lazy-loading 'flavor' on Instance uuid b04e96c7-f098-4612-b0b8-92cf6fd58865 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:39:50 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:39:50 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:39:50 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] attach device xml: <disk type="block" device="disk">
Aug 26 08:39:50 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:39:50 user nova-compute[73104]:   <source dev="/dev/sdj"/>
Aug 26 08:39:50 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:39:50 user nova-compute[73104]:   <serial>bfe480fb-da99-4daa-afa2-9b2e89bd76b3</serial>
Aug 26 08:39:50 user nova-compute[73104]: </disk>
Aug 26 08:39:50 user nova-compute[73104]:  {{(pid=73104) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 08:39:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.459s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:50 user nova-compute[73104]: DEBUG nova.compute.manager [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:39:50 user nova-compute[73104]: DEBUG nova.compute.manager [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:39:50 user nova-compute[73104]: DEBUG nova.network.neutron [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:39:50 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:39:50 user nova-compute[73104]: DEBUG nova.compute.manager [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:39:50 user nova-compute[73104]: DEBUG nova.policy [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '062587ed00ae457889f884346c99e11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad68e5623014e2fb3f10ba92d388291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:39:50 user nova-compute[73104]: DEBUG nova.compute.manager [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:39:50 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:39:50 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Creating image(s)
Aug 26 08:39:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "/opt/stack/data/nova/instances/da850cb3-3d57-4243-8af8-13c7f3251787/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "/opt/stack/data/nova/instances/da850cb3-3d57-4243-8af8-13c7f3251787/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "/opt/stack/data/nova/instances/da850cb3-3d57-4243-8af8-13c7f3251787/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-f93f4646-6778-4a31-b6b3-05a798de6c05 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Acquiring lock "93244bcd-34be-46f3-85e6-87bb5e69888d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-f93f4646-6778-4a31-b6b3-05a798de6c05 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "93244bcd-34be-46f3-85e6-87bb5e69888d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:51 user nova-compute[73104]: INFO nova.compute.manager [None req-f93f4646-6778-4a31-b6b3-05a798de6c05 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Detaching volume 4337d46c-79a9-4192-bfb5-490c342e1c25
Aug 26 08:39:51 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] No VIF found with MAC fa:16:3e:23:5b:3a, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.203s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:51 user nova-compute[73104]: INFO nova.virt.block_device [None req-f93f4646-6778-4a31-b6b3-05a798de6c05 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Attempting to driver detach volume 4337d46c-79a9-4192-bfb5-490c342e1c25 from mountpoint /dev/vdb
Aug 26 08:39:51 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-f93f4646-6778-4a31-b6b3-05a798de6c05 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Attempting to detach device vdb from instance 93244bcd-34be-46f3-85e6-87bb5e69888d from the persistent domain config. {{(pid=73104) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-f93f4646-6778-4a31-b6b3-05a798de6c05 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:39:51 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:39:51 user nova-compute[73104]:   <source dev="/dev/sdh"/>
Aug 26 08:39:51 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:39:51 user nova-compute[73104]:   <serial>4337d46c-79a9-4192-bfb5-490c342e1c25</serial>
Aug 26 08:39:51 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 08:39:51 user nova-compute[73104]: </disk>
Aug 26 08:39:51 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:39:51 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-f93f4646-6778-4a31-b6b3-05a798de6c05 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Successfully detached device vdb from instance 93244bcd-34be-46f3-85e6-87bb5e69888d from the persistent domain config.
Aug 26 08:39:51 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-f93f4646-6778-4a31-b6b3-05a798de6c05 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 93244bcd-34be-46f3-85e6-87bb5e69888d from the live domain config. {{(pid=73104) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-f93f4646-6778-4a31-b6b3-05a798de6c05 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:39:51 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:39:51 user nova-compute[73104]:   <source dev="/dev/sdh"/>
Aug 26 08:39:51 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:39:51 user nova-compute[73104]:   <serial>4337d46c-79a9-4192-bfb5-490c342e1c25</serial>
Aug 26 08:39:51 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 08:39:51 user nova-compute[73104]: </disk>
Aug 26 08:39:51 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d82642f2-bc41-4c4a-abe2-34cfc7f8d0b1 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Lock "b04e96c7-f098-4612-b0b8-92cf6fd58865" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.168s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.189s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/da850cb3-3d57-4243-8af8-13c7f3251787/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/da850cb3-3d57-4243-8af8-13c7f3251787/disk 1073741824" returned: 0 in 0.045s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.185s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Checking if we can resize image /opt/stack/data/nova/instances/da850cb3-3d57-4243-8af8-13c7f3251787/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da850cb3-3d57-4243-8af8-13c7f3251787/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG nova.network.neutron [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Successfully created port: c0227129-949b-4dec-9100-d8282dfa4b87 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Received event <DeviceRemovedEvent: 1693039191.731384, 93244bcd-34be-46f3-85e6-87bb5e69888d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73104) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-f93f4646-6778-4a31-b6b3-05a798de6c05 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 93244bcd-34be-46f3-85e6-87bb5e69888d {{(pid=73104) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 08:39:51 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-f93f4646-6778-4a31-b6b3-05a798de6c05 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Successfully detached device vdb from instance 93244bcd-34be-46f3-85e6-87bb5e69888d from the live domain config.
Aug 26 08:39:51 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f93f4646-6778-4a31-b6b3-05a798de6c05 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93f4646-6778-4a31-b6b3-05a798de6c05 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jYyrpFvI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:39:51 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-f93f4646-6778-4a31-b6b3-05a798de6c05 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:39:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-f93f4646-6778-4a31-b6b3-05a798de6c05 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-f93f4646-6778-4a31-b6b3-05a798de6c05 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93f4646-6778-4a31-b6b3-05a798de6c05 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb20fb2-4cd5-4c02-adc6-9f40509d2eee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da850cb3-3d57-4243-8af8-13c7f3251787/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Cannot resize image /opt/stack/data/nova/instances/da850cb3-3d57-4243-8af8-13c7f3251787/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Ensure instance console log exists: /opt/stack/data/nova/instances/da850cb3-3d57-4243-8af8-13c7f3251787/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[192fd607-b3b8-4723-9516-777a0bdaa144]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93f4646-6778-4a31-b6b3-05a798de6c05 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:39:51 user nova-compute[73104]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25 (non-flash)
Aug 26 08:39:51 user nova-compute[73104]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3 (non-flash)
Aug 26 08:39:51 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:51 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:51 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:51 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:39:51 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:39:51 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:39:51 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93f4646-6778-4a31-b6b3-05a798de6c05 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:39:51 user nova-compute[73104]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25 (non-flash)
Aug 26 08:39:51 user nova-compute[73104]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3 (non-flash)
Aug 26 08:39:51 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:51 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:51 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:51 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:39:51 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:39:51 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:39:51 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93f4646-6778-4a31-b6b3-05a798de6c05 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0c468a9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25'): ({'sdh'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-f93f4646-6778-4a31-b6b3-05a798de6c05 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Removing single pathed devices sdh {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-f9853d4b-33c6-4fc8-99c2-60696ab2b73d tempest-VolumesAssistedSnapshotsTest-1012641673 tempest-VolumesAssistedSnapshotsTest-1012641673-project] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] volume_snapshot_create: create_info: {'snapshot_id': 'ba4fd684-af65-4689-9a06-04403db97dec', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73104) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-f9853d4b-33c6-4fc8-99c2-60696ab2b73d tempest-VolumesAssistedSnapshotsTest-1012641673 tempest-VolumesAssistedSnapshotsTest-1012641673-project] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] snap xml: <domainsnapshot>
Aug 26 08:39:51 user nova-compute[73104]:   <disks>
Aug 26 08:39:51 user nova-compute[73104]:     <disk name="/dev/sdj" snapshot="external" type="file">
Aug 26 08:39:51 user nova-compute[73104]:       <source file="/dev/new_file"/>
Aug 26 08:39:51 user nova-compute[73104]:     </disk>
Aug 26 08:39:51 user nova-compute[73104]:     <disk name="vda" snapshot="no"/>
Aug 26 08:39:51 user nova-compute[73104]:   </disks>
Aug 26 08:39:51 user nova-compute[73104]: </domainsnapshot>
Aug 26 08:39:51 user nova-compute[73104]:  {{(pid=73104) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG nova.objects.instance [None req-f9853d4b-33c6-4fc8-99c2-60696ab2b73d tempest-VolumesAssistedSnapshotsTest-1012641673 tempest-VolumesAssistedSnapshotsTest-1012641673-project] Lazy-loading 'system_metadata' on Instance uuid b04e96c7-f098-4612-b0b8-92cf6fd58865 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[badcdf81-e530-449d-8e5a-4102df554792]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bde690-38cf-4522-946e-9c062a62dc4e]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-f93f4646-6778-4a31-b6b3-05a798de6c05 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Flushing IO for device /dev/sdh {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d06360-7d0d-4b78-a503-62bd2163ad27]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-f93f4646-6778-4a31-b6b3-05a798de6c05 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:51 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-f9853d4b-33c6-4fc8-99c2-60696ab2b73d tempest-VolumesAssistedSnapshotsTest-1012641673 tempest-VolumesAssistedSnapshotsTest-1012641673-project] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [None req-f9853d4b-33c6-4fc8-99c2-60696ab2b73d tempest-VolumesAssistedSnapshotsTest-1012641673 tempest-VolumesAssistedSnapshotsTest-1012641673-project] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Traceback (most recent call last):
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]     rv = execute(f, *args, **kwargs)
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]     six.reraise(c, e, tb)
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]     raise value
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]     rv = meth(*args, **kwargs)
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] 
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [None req-f9853d4b-33c6-4fc8-99c2-60696ab2b73d tempest-VolumesAssistedSnapshotsTest-1012641673 tempest-VolumesAssistedSnapshotsTest-1012641673-project] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Traceback (most recent call last):
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]     self._volume_snapshot_create(context, instance, guest,
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]     rv = execute(f, *args, **kwargs)
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]     six.reraise(c, e, tb)
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]     raise value
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]     rv = meth(*args, **kwargs)
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] 
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.047s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f48e56-9552-450d-af72-57c532da838e]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-29dcf1b6-bd9b-4b2e-8aea-6b880c0a9ecb tempest-VolumesAssistedSnapshotsTest-1012641673 tempest-VolumesAssistedSnapshotsTest-1012641673-project] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] volume_snapshot_delete: delete_info: {'volume_id': 'bfe480fb-da99-4daa-afa2-9b2e89bd76b3'} {{(pid=73104) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [None req-29dcf1b6-bd9b-4b2e-8aea-6b880c0a9ecb tempest-VolumesAssistedSnapshotsTest-1012641673 tempest-VolumesAssistedSnapshotsTest-1012641673-project] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Traceback (most recent call last):
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865]     if delete_info['type'] != 'qcow2':
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] KeyError: 'type'
Aug 26 08:39:51 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] 
Aug 26 08:39:51 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-f93f4646-6778-4a31-b6b3-05a798de6c05 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-f93f4646-6778-4a31-b6b3-05a798de6c05 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] SCSI volumes sdh have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93f4646-6778-4a31-b6b3-05a798de6c05 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:39:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [None req-f9853d4b-33c6-4fc8-99c2-60696ab2b73d tempest-VolumesAssistedSnapshotsTest-1012641673 tempest-VolumesAssistedSnapshotsTest-1012641673-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot ba4fd684-af65-4689-9a06-04403db97dec could not be found.
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     raise value
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver 
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver 
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot ba4fd684-af65-4689-9a06-04403db97dec could not be found. (HTTP 404) (Request-ID: req-e6ce86f3-cf41-4dc9-983e-46604113fdb4)
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver 
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver 
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot ba4fd684-af65-4689-9a06-04403db97dec could not be found.
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver 
Aug 26 08:39:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e164b5-9d45-461a-a483-30657c0af0f5]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93f4646-6778-4a31-b6b3-05a798de6c05 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver [None req-29dcf1b6-bd9b-4b2e-8aea-6b880c0a9ecb tempest-VolumesAssistedSnapshotsTest-1012641673 tempest-VolumesAssistedSnapshotsTest-1012641673-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver 
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver 
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-0531b251-d6b2-404d-89bb-920ad5a8cc97)
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver 
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver 
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 26 08:39:52 user nova-compute[73104]: ERROR nova.virt.libvirt.driver 
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server [None req-f9853d4b-33c6-4fc8-99c2-60696ab2b73d tempest-VolumesAssistedSnapshotsTest-1012641673 tempest-VolumesAssistedSnapshotsTest-1012641673-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     raise value
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server 
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server [None req-29dcf1b6-bd9b-4b2e-8aea-6b880c0a9ecb tempest-VolumesAssistedSnapshotsTest-1012641673 tempest-VolumesAssistedSnapshotsTest-1012641673-project] Exception during message handling: KeyError: 'type'
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 26 08:39:52 user nova-compute[73104]: ERROR oslo_messaging.rpc.server 
Aug 26 08:39:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25 -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d381cb-4524-46c1-b5c2-e9b43ffce99e]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93f4646-6778-4a31-b6b3-05a798de6c05 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25, portal: 172.16.0.220,3260]
Aug 26 08:39:52 user nova-compute[73104]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25, portal: 172.16.0.220,3260] successful.
Aug 26 08:39:52 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4337d46c-79a9-4192-bfb5-490c342e1c25 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c740c7cb-043d-48e9-a8ab-7a32f149ca6b]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93f4646-6778-4a31-b6b3-05a798de6c05 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-f93f4646-6778-4a31-b6b3-05a798de6c05 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.415s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93f4646-6778-4a31-b6b3-05a798de6c05 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] <== disconnect_volume: return (416ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f93f4646-6778-4a31-b6b3-05a798de6c05 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d2ec493e-ec2d-4570-a355-1f3409939ee8 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Acquiring lock "b04e96c7-f098-4612-b0b8-92cf6fd58865" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d2ec493e-ec2d-4570-a355-1f3409939ee8 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Lock "b04e96c7-f098-4612-b0b8-92cf6fd58865" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:52 user nova-compute[73104]: INFO nova.compute.manager [None req-d2ec493e-ec2d-4570-a355-1f3409939ee8 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Detaching volume bfe480fb-da99-4daa-afa2-9b2e89bd76b3
Aug 26 08:39:52 user nova-compute[73104]: INFO nova.virt.block_device [None req-d2ec493e-ec2d-4570-a355-1f3409939ee8 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Attempting to driver detach volume bfe480fb-da99-4daa-afa2-9b2e89bd76b3 from mountpoint /dev/vdb
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d2ec493e-ec2d-4570-a355-1f3409939ee8 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Attempting to detach device vdb from instance b04e96c7-f098-4612-b0b8-92cf6fd58865 from the persistent domain config. {{(pid=73104) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-d2ec493e-ec2d-4570-a355-1f3409939ee8 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] detach device xml: <disk type="block" device="disk">
Aug 26 08:39:52 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:39:52 user nova-compute[73104]:   <source dev="/dev/sdj"/>
Aug 26 08:39:52 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:39:52 user nova-compute[73104]:   <serial>bfe480fb-da99-4daa-afa2-9b2e89bd76b3</serial>
Aug 26 08:39:52 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 08:39:52 user nova-compute[73104]: </disk>
Aug 26 08:39:52 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:39:52 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-d2ec493e-ec2d-4570-a355-1f3409939ee8 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Successfully detached device vdb from instance b04e96c7-f098-4612-b0b8-92cf6fd58865 from the persistent domain config.
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d2ec493e-ec2d-4570-a355-1f3409939ee8 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b04e96c7-f098-4612-b0b8-92cf6fd58865 from the live domain config. {{(pid=73104) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-d2ec493e-ec2d-4570-a355-1f3409939ee8 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] detach device xml: <disk type="block" device="disk">
Aug 26 08:39:52 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:39:52 user nova-compute[73104]:   <source dev="/dev/sdj"/>
Aug 26 08:39:52 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:39:52 user nova-compute[73104]:   <serial>bfe480fb-da99-4daa-afa2-9b2e89bd76b3</serial>
Aug 26 08:39:52 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 08:39:52 user nova-compute[73104]: </disk>
Aug 26 08:39:52 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.network.neutron [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Successfully updated port: c0227129-949b-4dec-9100-d8282dfa4b87 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "refresh_cache-da850cb3-3d57-4243-8af8-13c7f3251787" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquired lock "refresh_cache-da850cb3-3d57-4243-8af8-13c7f3251787" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.network.neutron [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.compute.manager [req-216dab59-e388-44bf-80e0-35843522e941 req-456d828b-0d2e-4ae7-8240-582a163153d9 service nova] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Received event network-changed-c0227129-949b-4dec-9100-d8282dfa4b87 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.compute.manager [req-216dab59-e388-44bf-80e0-35843522e941 req-456d828b-0d2e-4ae7-8240-582a163153d9 service nova] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Refreshing instance network info cache due to event network-changed-c0227129-949b-4dec-9100-d8282dfa4b87. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-216dab59-e388-44bf-80e0-35843522e941 req-456d828b-0d2e-4ae7-8240-582a163153d9 service nova] Acquiring lock "refresh_cache-da850cb3-3d57-4243-8af8-13c7f3251787" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.network.neutron [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Received event <DeviceRemovedEvent: 1693039192.89563, b04e96c7-f098-4612-b0b8-92cf6fd58865 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73104) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.network.neutron [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Updating instance_info_cache with network_info: [{"id": "c0227129-949b-4dec-9100-d8282dfa4b87", "address": "fa:16:3e:63:d8:06", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0227129-94", "ovs_interfaceid": "c0227129-949b-4dec-9100-d8282dfa4b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d2ec493e-ec2d-4570-a355-1f3409939ee8 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b04e96c7-f098-4612-b0b8-92cf6fd58865 {{(pid=73104) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 08:39:52 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-d2ec493e-ec2d-4570-a355-1f3409939ee8 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Successfully detached device vdb from instance b04e96c7-f098-4612-b0b8-92cf6fd58865 from the live domain config.
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2ec493e-ec2d-4570-a355-1f3409939ee8 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec493e-ec2d-4570-a355-1f3409939ee8 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eKSqZRTx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:39:52 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-d2ec493e-ec2d-4570-a355-1f3409939ee8 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:39:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-d2ec493e-ec2d-4570-a355-1f3409939ee8 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-d2ec493e-ec2d-4570-a355-1f3409939ee8 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec493e-ec2d-4570-a355-1f3409939ee8 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Releasing lock "refresh_cache-da850cb3-3d57-4243-8af8-13c7f3251787" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.compute.manager [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Instance network_info: |[{"id": "c0227129-949b-4dec-9100-d8282dfa4b87", "address": "fa:16:3e:63:d8:06", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0227129-94", "ovs_interfaceid": "c0227129-949b-4dec-9100-d8282dfa4b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-216dab59-e388-44bf-80e0-35843522e941 req-456d828b-0d2e-4ae7-8240-582a163153d9 service nova] Acquired lock "refresh_cache-da850cb3-3d57-4243-8af8-13c7f3251787" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.network.neutron [req-216dab59-e388-44bf-80e0-35843522e941 req-456d828b-0d2e-4ae7-8240-582a163153d9 service nova] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Refreshing network info cache for port c0227129-949b-4dec-9100-d8282dfa4b87 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Start _get_guest_xml network_info=[{"id": "c0227129-949b-4dec-9100-d8282dfa4b87", "address": "fa:16:3e:63:d8:06", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0227129-94", "ovs_interfaceid": "c0227129-949b-4dec-9100-d8282dfa4b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:39:52 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:39:52 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:39:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e6adb2-1ea5-4d86-82d8-04a4fa65943b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:39:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1948580857',display_name='tempest-AttachVolumeNegativeTest-server-1948580857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1948580857',id=13,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEalDMDm3bWX+y2VD0g97vGCJXuv0dkrAXho/niYXWZQ03OmCezCCUXxscILCpWel9c7I4u3lDpLwhqvtOGSRceLR3Q3ciigyVsoR4Qi3sqa0pBFmqOiaFOE//oFS5rdyQ==',key_name='tempest-keypair-236508621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ad68e5623014e2fb3f10ba92d388291',ramdisk_id='',reservation_id='r-5fvdxjp8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1286694855',owner_user_name='tempest-AttachVolumeNegativeTest-1286694855-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='062587ed00ae457889f884346c99e11b',uuid=da850cb3-3d57-4243-8af8-13c7f3251787,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0227129-949b-4dec-9100-d8282dfa4b87", "address": "fa:16:3e:63:d8:06", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0227129-94", "ovs_interfaceid": "c0227129-949b-4dec-9100-d8282dfa4b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Converting VIF {"id": "c0227129-949b-4dec-9100-d8282dfa4b87", "address": "fa:16:3e:63:d8:06", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0227129-94", "ovs_interfaceid": "c0227129-949b-4dec-9100-d8282dfa4b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:d8:06,bridge_name='br-int',has_traffic_filtering=True,id=c0227129-949b-4dec-9100-d8282dfa4b87,network=Network(ea6c6ce0-85a4-40db-96e2-ca078887ab66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0227129-94') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.objects.instance [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lazy-loading 'pci_devices' on Instance uuid da850cb3-3d57-4243-8af8-13c7f3251787 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fcf5e8-a44e-4919-88aa-991325bf7c91]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec493e-ec2d-4570-a355-1f3409939ee8 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:39:52 user nova-compute[73104]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3 (non-flash)
Aug 26 08:39:52 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:52 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:52 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:52 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:39:52 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:39:52 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:39:52 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec493e-ec2d-4570-a355-1f3409939ee8 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:39:52 user nova-compute[73104]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3 (non-flash)
Aug 26 08:39:52 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:39:52 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:39:52 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:39:52 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:39:52 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:39:52 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:39:52 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec493e-ec2d-4570-a355-1f3409939ee8 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0c4183520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3'): ({'sdj'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-d2ec493e-ec2d-4570-a355-1f3409939ee8 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Removing single pathed devices sdj {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:39:52 user nova-compute[73104]:   <uuid>da850cb3-3d57-4243-8af8-13c7f3251787</uuid>
Aug 26 08:39:52 user nova-compute[73104]:   <name>instance-0000000d</name>
Aug 26 08:39:52 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:39:52 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:39:52 user nova-compute[73104]:   <metadata>
Aug 26 08:39:52 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:39:52 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:39:52 user nova-compute[73104]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1948580857</nova:name>
Aug 26 08:39:52 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:39:52</nova:creationTime>
Aug 26 08:39:52 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:39:52 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:39:52 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:39:52 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:39:52 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:39:52 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:39:52 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:39:52 user nova-compute[73104]:       <nova:owner>
Aug 26 08:39:52 user nova-compute[73104]:         <nova:user uuid="062587ed00ae457889f884346c99e11b">tempest-AttachVolumeNegativeTest-1286694855-project-member</nova:user>
Aug 26 08:39:52 user nova-compute[73104]:         <nova:project uuid="4ad68e5623014e2fb3f10ba92d388291">tempest-AttachVolumeNegativeTest-1286694855</nova:project>
Aug 26 08:39:52 user nova-compute[73104]:       </nova:owner>
Aug 26 08:39:52 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:39:52 user nova-compute[73104]:       <nova:ports>
Aug 26 08:39:52 user nova-compute[73104]:         <nova:port uuid="c0227129-949b-4dec-9100-d8282dfa4b87">
Aug 26 08:39:52 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 08:39:52 user nova-compute[73104]:         </nova:port>
Aug 26 08:39:52 user nova-compute[73104]:       </nova:ports>
Aug 26 08:39:52 user nova-compute[73104]:     </nova:instance>
Aug 26 08:39:52 user nova-compute[73104]:   </metadata>
Aug 26 08:39:52 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:39:52 user nova-compute[73104]:     <system>
Aug 26 08:39:52 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:39:52 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:39:52 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:39:52 user nova-compute[73104]:       <entry name="serial">da850cb3-3d57-4243-8af8-13c7f3251787</entry>
Aug 26 08:39:52 user nova-compute[73104]:       <entry name="uuid">da850cb3-3d57-4243-8af8-13c7f3251787</entry>
Aug 26 08:39:52 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:39:52 user nova-compute[73104]:     </system>
Aug 26 08:39:52 user nova-compute[73104]:   </sysinfo>
Aug 26 08:39:52 user nova-compute[73104]:   <os>
Aug 26 08:39:52 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:39:52 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:39:52 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:39:52 user nova-compute[73104]:   </os>
Aug 26 08:39:52 user nova-compute[73104]:   <features>
Aug 26 08:39:52 user nova-compute[73104]:     <acpi/>
Aug 26 08:39:52 user nova-compute[73104]:     <apic/>
Aug 26 08:39:52 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:39:52 user nova-compute[73104]:   </features>
Aug 26 08:39:52 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:39:52 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:39:52 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:39:52 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:39:52 user nova-compute[73104]:   </clock>
Aug 26 08:39:52 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:39:52 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:39:52 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:39:52 user nova-compute[73104]:   </cpu>
Aug 26 08:39:52 user nova-compute[73104]:   <devices>
Aug 26 08:39:52 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:39:52 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:39:52 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/da850cb3-3d57-4243-8af8-13c7f3251787/disk"/>
Aug 26 08:39:52 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:39:52 user nova-compute[73104]:     </disk>
Aug 26 08:39:52 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:39:52 user nova-compute[73104]:       <mac address="fa:16:3e:63:d8:06"/>
Aug 26 08:39:52 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:39:52 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:39:52 user nova-compute[73104]:       <target dev="tapc0227129-94"/>
Aug 26 08:39:52 user nova-compute[73104]:     </interface>
Aug 26 08:39:52 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:39:52 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/da850cb3-3d57-4243-8af8-13c7f3251787/console.log" append="off"/>
Aug 26 08:39:52 user nova-compute[73104]:     </serial>
Aug 26 08:39:52 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:39:52 user nova-compute[73104]:     <video>
Aug 26 08:39:52 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:39:52 user nova-compute[73104]:     </video>
Aug 26 08:39:52 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:39:52 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:39:52 user nova-compute[73104]:     </rng>
Aug 26 08:39:52 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:39:52 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:39:52 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:39:52 user nova-compute[73104]:     </memballoon>
Aug 26 08:39:52 user nova-compute[73104]:   </devices>
Aug 26 08:39:52 user nova-compute[73104]: </domain>
Aug 26 08:39:52 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:39:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1948580857',display_name='tempest-AttachVolumeNegativeTest-server-1948580857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1948580857',id=13,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEalDMDm3bWX+y2VD0g97vGCJXuv0dkrAXho/niYXWZQ03OmCezCCUXxscILCpWel9c7I4u3lDpLwhqvtOGSRceLR3Q3ciigyVsoR4Qi3sqa0pBFmqOiaFOE//oFS5rdyQ==',key_name='tempest-keypair-236508621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ad68e5623014e2fb3f10ba92d388291',ramdisk_id='',reservation_id='r-5fvdxjp8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1286694855',owner_user_name='tempest-AttachVolumeNegativeTest-1286694855-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='062587ed00ae457889f884346c99e11b',uuid=da850cb3-3d57-4243-8af8-13c7f3251787,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0227129-949b-4dec-9100-d8282dfa4b87", "address": "fa:16:3e:63:d8:06", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0227129-94", "ovs_interfaceid": "c0227129-949b-4dec-9100-d8282dfa4b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Converting VIF {"id": "c0227129-949b-4dec-9100-d8282dfa4b87", "address": "fa:16:3e:63:d8:06", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0227129-94", "ovs_interfaceid": "c0227129-949b-4dec-9100-d8282dfa4b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:d8:06,bridge_name='br-int',has_traffic_filtering=True,id=c0227129-949b-4dec-9100-d8282dfa4b87,network=Network(ea6c6ce0-85a4-40db-96e2-ca078887ab66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0227129-94') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG os_vif [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:d8:06,bridge_name='br-int',has_traffic_filtering=True,id=c0227129-949b-4dec-9100-d8282dfa4b87,network=Network(ea6c6ce0-85a4-40db-96e2-ca078887ab66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0227129-94') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0227129-94, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc0227129-94, col_values=(('external_ids', {'iface-id': 'c0227129-949b-4dec-9100-d8282dfa4b87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:d8:06', 'vm-uuid': 'da850cb3-3d57-4243-8af8-13c7f3251787'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de4f3fa-cd76-4c64-b475-a7400c90728c]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:53 user nova-compute[73104]: INFO os_vif [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:d8:06,bridge_name='br-int',has_traffic_filtering=True,id=c0227129-949b-4dec-9100-d8282dfa4b87,network=Network(ea6c6ce0-85a4-40db-96e2-ca078887ab66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0227129-94')
Aug 26 08:39:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a5d38f-5650-46df-aade-91df26a5c716]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-d2ec493e-ec2d-4570-a355-1f3409939ee8 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Flushing IO for device /dev/sdj {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27dde99-fff2-495a-8da8-4c6e0e81d064]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-d2ec493e-ec2d-4570-a355-1f3409939ee8 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] No VIF found with MAC fa:16:3e:63:d8:06, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG nova.objects.instance [None req-f93f4646-6778-4a31-b6b3-05a798de6c05 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lazy-loading 'flavor' on Instance uuid 93244bcd-34be-46f3-85e6-87bb5e69888d {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.052s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7b2a38-0af7-4424-b9fc-7411527b5b80]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-d2ec493e-ec2d-4570-a355-1f3409939ee8 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-d2ec493e-ec2d-4570-a355-1f3409939ee8 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] SCSI volumes sdj have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec493e-ec2d-4570-a355-1f3409939ee8 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e70ca0-44bc-4b3a-b642-008438b9f8c9]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec493e-ec2d-4570-a355-1f3409939ee8 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-f93f4646-6778-4a31-b6b3-05a798de6c05 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "93244bcd-34be-46f3-85e6-87bb5e69888d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.134s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f94ca71-5ac4-4d70-ad6f-2d56a9e5c109]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec493e-ec2d-4570-a355-1f3409939ee8 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3, portal: 172.16.0.220,3260]
Aug 26 08:39:53 user nova-compute[73104]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3, portal: 172.16.0.220,3260] successful.
Aug 26 08:39:53 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe480fb-da99-4daa-afa2-9b2e89bd76b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1e8333-fdd1-48e0-8086-859da6068f69]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec493e-ec2d-4570-a355-1f3409939ee8 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-d2ec493e-ec2d-4570-a355-1f3409939ee8 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec493e-ec2d-4570-a355-1f3409939ee8 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] <== disconnect_volume: return (382ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2ec493e-ec2d-4570-a355-1f3409939ee8 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG nova.network.neutron [req-216dab59-e388-44bf-80e0-35843522e941 req-456d828b-0d2e-4ae7-8240-582a163153d9 service nova] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Updated VIF entry in instance network info cache for port c0227129-949b-4dec-9100-d8282dfa4b87. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG nova.network.neutron [req-216dab59-e388-44bf-80e0-35843522e941 req-456d828b-0d2e-4ae7-8240-582a163153d9 service nova] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Updating instance_info_cache with network_info: [{"id": "c0227129-949b-4dec-9100-d8282dfa4b87", "address": "fa:16:3e:63:d8:06", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0227129-94", "ovs_interfaceid": "c0227129-949b-4dec-9100-d8282dfa4b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-216dab59-e388-44bf-80e0-35843522e941 req-456d828b-0d2e-4ae7-8240-582a163153d9 service nova] Releasing lock "refresh_cache-da850cb3-3d57-4243-8af8-13c7f3251787" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:39:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:54 user nova-compute[73104]: DEBUG nova.objects.instance [None req-d2ec493e-ec2d-4570-a355-1f3409939ee8 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Lazy-loading 'flavor' on Instance uuid b04e96c7-f098-4612-b0b8-92cf6fd58865 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:39:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d2ec493e-ec2d-4570-a355-1f3409939ee8 tempest-VolumesAssistedSnapshotsTest-81132353 tempest-VolumesAssistedSnapshotsTest-81132353-project-admin] Lock "b04e96c7-f098-4612-b0b8-92cf6fd58865" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-6646e713-28a4-4b9f-8450-680aa88f28c5 req-0ef50fce-fa1d-466c-a716-5734310760e9 service nova] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Received event network-vif-plugged-c0227129-949b-4dec-9100-d8282dfa4b87 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6646e713-28a4-4b9f-8450-680aa88f28c5 req-0ef50fce-fa1d-466c-a716-5734310760e9 service nova] Acquiring lock "da850cb3-3d57-4243-8af8-13c7f3251787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6646e713-28a4-4b9f-8450-680aa88f28c5 req-0ef50fce-fa1d-466c-a716-5734310760e9 service nova] Lock "da850cb3-3d57-4243-8af8-13c7f3251787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6646e713-28a4-4b9f-8450-680aa88f28c5 req-0ef50fce-fa1d-466c-a716-5734310760e9 service nova] Lock "da850cb3-3d57-4243-8af8-13c7f3251787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-6646e713-28a4-4b9f-8450-680aa88f28c5 req-0ef50fce-fa1d-466c-a716-5734310760e9 service nova] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] No waiting events found dispatching network-vif-plugged-c0227129-949b-4dec-9100-d8282dfa4b87 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:54 user nova-compute[73104]: WARNING nova.compute.manager [req-6646e713-28a4-4b9f-8450-680aa88f28c5 req-0ef50fce-fa1d-466c-a716-5734310760e9 service nova] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Received unexpected event network-vif-plugged-c0227129-949b-4dec-9100-d8282dfa4b87 for instance with vm_state building and task_state spawning.
Aug 26 08:39:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:56 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039196.5850778, da850cb3-3d57-4243-8af8-13c7f3251787 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:39:56 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] VM Resumed (Lifecycle Event)
Aug 26 08:39:56 user nova-compute[73104]: DEBUG nova.compute.manager [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:39:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:39:56 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Instance spawned successfully.
Aug 26 08:39:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:39:56 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:39:56 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:39:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:39:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:39:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:39:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:39:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:39:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:39:56 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:39:56 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039196.5868192, da850cb3-3d57-4243-8af8-13c7f3251787 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:39:56 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] VM Started (Lifecycle Event)
Aug 26 08:39:56 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:39:56 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:39:56 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:39:56 user nova-compute[73104]: INFO nova.compute.manager [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Took 5.75 seconds to spawn the instance on the hypervisor.
Aug 26 08:39:56 user nova-compute[73104]: DEBUG nova.compute.manager [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:39:56 user nova-compute[73104]: DEBUG nova.compute.manager [req-65974d0d-7090-4144-949e-0400583168be req-e0308aa4-311f-4f8c-9297-fa6fcfe26ee3 service nova] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Received event network-vif-plugged-c0227129-949b-4dec-9100-d8282dfa4b87 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:39:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-65974d0d-7090-4144-949e-0400583168be req-e0308aa4-311f-4f8c-9297-fa6fcfe26ee3 service nova] Acquiring lock "da850cb3-3d57-4243-8af8-13c7f3251787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:39:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-65974d0d-7090-4144-949e-0400583168be req-e0308aa4-311f-4f8c-9297-fa6fcfe26ee3 service nova] Lock "da850cb3-3d57-4243-8af8-13c7f3251787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:39:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-65974d0d-7090-4144-949e-0400583168be req-e0308aa4-311f-4f8c-9297-fa6fcfe26ee3 service nova] Lock "da850cb3-3d57-4243-8af8-13c7f3251787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:56 user nova-compute[73104]: DEBUG nova.compute.manager [req-65974d0d-7090-4144-949e-0400583168be req-e0308aa4-311f-4f8c-9297-fa6fcfe26ee3 service nova] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] No waiting events found dispatching network-vif-plugged-c0227129-949b-4dec-9100-d8282dfa4b87 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:39:56 user nova-compute[73104]: WARNING nova.compute.manager [req-65974d0d-7090-4144-949e-0400583168be req-e0308aa4-311f-4f8c-9297-fa6fcfe26ee3 service nova] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Received unexpected event network-vif-plugged-c0227129-949b-4dec-9100-d8282dfa4b87 for instance with vm_state building and task_state spawning.
Aug 26 08:39:56 user nova-compute[73104]: INFO nova.compute.manager [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Took 7.20 seconds to build instance.
Aug 26 08:39:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-28b9217c-041f-4fde-9d22-7066eba26e12 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "da850cb3-3d57-4243-8af8-13c7f3251787" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.351s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:39:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:39:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:01 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693039186.3159795, afe2c15e-4e27-47f3-8b0b-426f4b8619d1 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:40:01 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] VM Stopped (Lifecycle Event)
Aug 26 08:40:01 user nova-compute[73104]: DEBUG nova.compute.manager [None req-8d0e1b92-fa00-41ea-9f30-700b2aa94f6b None None] [instance: afe2c15e-4e27-47f3-8b0b-426f4b8619d1] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:40:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:06 user nova-compute[73104]: DEBUG nova.compute.manager [req-6cbdfe3a-0e9e-40dc-a7aa-da825046f226 req-b9abca48-b74d-489d-9ecc-d24cfa08f197 service nova] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Received event network-changed-5ca70232-e7ad-4989-b581-3c9c5b983db8 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:40:06 user nova-compute[73104]: DEBUG nova.compute.manager [req-6cbdfe3a-0e9e-40dc-a7aa-da825046f226 req-b9abca48-b74d-489d-9ecc-d24cfa08f197 service nova] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Refreshing instance network info cache due to event network-changed-5ca70232-e7ad-4989-b581-3c9c5b983db8. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:40:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6cbdfe3a-0e9e-40dc-a7aa-da825046f226 req-b9abca48-b74d-489d-9ecc-d24cfa08f197 service nova] Acquiring lock "refresh_cache-85eea82a-c221-4661-9525-06a925b57e1c" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:40:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6cbdfe3a-0e9e-40dc-a7aa-da825046f226 req-b9abca48-b74d-489d-9ecc-d24cfa08f197 service nova] Acquired lock "refresh_cache-85eea82a-c221-4661-9525-06a925b57e1c" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:40:06 user nova-compute[73104]: DEBUG nova.network.neutron [req-6cbdfe3a-0e9e-40dc-a7aa-da825046f226 req-b9abca48-b74d-489d-9ecc-d24cfa08f197 service nova] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Refreshing network info cache for port 5ca70232-e7ad-4989-b581-3c9c5b983db8 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:40:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Acquiring lock "85eea82a-c221-4661-9525-06a925b57e1c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:40:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "85eea82a-c221-4661-9525-06a925b57e1c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:40:07 user nova-compute[73104]: DEBUG nova.objects.instance [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lazy-loading 'flavor' on Instance uuid 85eea82a-c221-4661-9525-06a925b57e1c {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:40:07 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Ignoring supplied device name: /dev/vdb
Aug 26 08:40:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "85eea82a-c221-4661-9525-06a925b57e1c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:40:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Acquiring lock "85eea82a-c221-4661-9525-06a925b57e1c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:40:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "85eea82a-c221-4661-9525-06a925b57e1c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:40:07 user nova-compute[73104]: INFO nova.compute.manager [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Attaching volume df5d05f1-af9b-4ce1-b7fa-447815c826c5 to /dev/vdb
Aug 26 08:40:07 user nova-compute[73104]: DEBUG nova.network.neutron [req-6cbdfe3a-0e9e-40dc-a7aa-da825046f226 req-b9abca48-b74d-489d-9ecc-d24cfa08f197 service nova] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Updated VIF entry in instance network info cache for port 5ca70232-e7ad-4989-b581-3c9c5b983db8. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:40:07 user nova-compute[73104]: DEBUG nova.network.neutron [req-6cbdfe3a-0e9e-40dc-a7aa-da825046f226 req-b9abca48-b74d-489d-9ecc-d24cfa08f197 service nova] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Updating instance_info_cache with network_info: [{"id": "5ca70232-e7ad-4989-b581-3c9c5b983db8", "address": "fa:16:3e:8b:1d:d1", "network": {"id": "84dc5f73-5b46-4788-8e58-69d57f2f089f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-856831086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbb61cb896e4b3cbbdc04d82df1cea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ca70232-e7", "ovs_interfaceid": "5ca70232-e7ad-4989-b581-3c9c5b983db8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:40:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6cbdfe3a-0e9e-40dc-a7aa-da825046f226 req-b9abca48-b74d-489d-9ecc-d24cfa08f197 service nova] Releasing lock "refresh_cache-85eea82a-c221-4661-9525-06a925b57e1c" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:40:07 user nova-compute[73104]: DEBUG os_brick.utils [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:40:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:07 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[50579643-51c5-4d90-99db-7710591585a1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:40:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:07 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88cad54-c640-4da0-a950-b4be7abf0a35]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:40:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:07 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fd45ab-f4fb-4bff-9504-7cac820ab386]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:40:07 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a1aea1-2292-42e0-9e3b-3695fc09b902]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:40:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:40:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:40:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:40:07 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:40:07 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b733d7-e175-4f25-8963-590da9a5c3bc]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:40:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:40:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:40:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:40:07 user nova-compute[73104]: DEBUG os_brick.utils [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:40:07 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Updating existing volume attachment record: 2a270291-0941-451d-8d80-48f8f4a4b38f {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 08:40:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aDcPxbdJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:40:20 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:40:20 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:40:20 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:40:20 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:40:20 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:40:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4257a844-8ac3-4481-b7b1-8f017ab9f636]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:40:20 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6b3c60-d77b-4379-a98a-8064c57f6464]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5] added
Aug 26 08:40:20 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2e3d14-30ed-4d8e-b04e-7825e0af8224]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd314661-589a-4ecd-8d5a-89df91883fea]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aDcPxbdJ {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aDcPxbdJ" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc768c78-24f7-4f18-9cba-853afad6934d]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aDcPxbdJ'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[097c0f45-5023-4f43-b862-e3f0d9a6492f]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d9bf46-c7b7-41d6-9348-0363f143f81a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:40:20 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:40:20 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:40:20 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:40:20 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:40:20 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:40:20 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:40:20 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:40:20 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:40:20 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:40:20 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:40:20 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:40:20 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:40:20 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:40:20 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4405765d-a83a-437e-8b84-7cb08be6f8b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5, portal: 172.16.0.220,3260]
Aug 26 08:40:20 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5, portal: 172.16.0.220,3260] successful.
Aug 26 08:40:20 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7c60e0-50e4-4dee-8c5a-76494a7d7646]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0beb9a-0304-442a-9e1b-369b282b9ad3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:40:20 user nova-compute[73104]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)
Aug 26 08:40:20 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:40:20 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:40:20 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:40:20 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:40:20 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:40:20 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:40:20 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:40:20 user nova-compute[73104]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)
Aug 26 08:40:20 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:40:20 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:40:20 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:40:20 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:40:20 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:40:20 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:40:20 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] HCTL ('39', '-', '-', 0) found on session 13 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0614ee47-3ae4-4a3d-9626-52520c22744e]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Searching for a device in session 13 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aDcPxbdJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:40:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:21 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:40:21 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23839663635646337', 'path': '/dev/sdh'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:40:21 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839663635646337', 'path': '/dev/sdh'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:40:21 user nova-compute[73104]: DEBUG nova.objects.instance [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lazy-loading 'flavor' on Instance uuid 85eea82a-c221-4661-9525-06a925b57e1c {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:40:21 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 08:40:21 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:40:21 user nova-compute[73104]:   <source dev="/dev/sdh"/>
Aug 26 08:40:21 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:40:21 user nova-compute[73104]:   <serial>df5d05f1-af9b-4ce1-b7fa-447815c826c5</serial>
Aug 26 08:40:21 user nova-compute[73104]: </disk>
Aug 26 08:40:21 user nova-compute[73104]:  {{(pid=73104) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 08:40:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:40:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:40:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] No VIF found with MAC fa:16:3e:8b:1d:d1, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:40:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c23a453b-7273-4bd0-b403-55b06fd97438 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "85eea82a-c221-4661-9525-06a925b57e1c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.903s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:40:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7877cfa7-36b5-496b-aadb-12baa2f12f11 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Acquiring lock "f22d4c05-720a-4dc7-afa0-ac823e70060a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:40:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7877cfa7-36b5-496b-aadb-12baa2f12f11 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lock "f22d4c05-720a-4dc7-afa0-ac823e70060a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:40:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7877cfa7-36b5-496b-aadb-12baa2f12f11 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Acquiring lock "f22d4c05-720a-4dc7-afa0-ac823e70060a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:40:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7877cfa7-36b5-496b-aadb-12baa2f12f11 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lock "f22d4c05-720a-4dc7-afa0-ac823e70060a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:40:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7877cfa7-36b5-496b-aadb-12baa2f12f11 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lock "f22d4c05-720a-4dc7-afa0-ac823e70060a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:40:30 user nova-compute[73104]: INFO nova.compute.manager [None req-7877cfa7-36b5-496b-aadb-12baa2f12f11 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Terminating instance
Aug 26 08:40:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-7877cfa7-36b5-496b-aadb-12baa2f12f11 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 08:40:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:30 user nova-compute[73104]: DEBUG nova.compute.manager [req-cd2840be-773e-4ee1-8d99-837af69a299a req-21299a76-f624-4a10-a52a-dfe89fb6e9eb service nova] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Received event network-vif-unplugged-efd472f1-aab1-4878-bed5-14054ce12ebd {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:40:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-cd2840be-773e-4ee1-8d99-837af69a299a req-21299a76-f624-4a10-a52a-dfe89fb6e9eb service nova] Acquiring lock "f22d4c05-720a-4dc7-afa0-ac823e70060a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:40:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-cd2840be-773e-4ee1-8d99-837af69a299a req-21299a76-f624-4a10-a52a-dfe89fb6e9eb service nova] Lock "f22d4c05-720a-4dc7-afa0-ac823e70060a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:40:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-cd2840be-773e-4ee1-8d99-837af69a299a req-21299a76-f624-4a10-a52a-dfe89fb6e9eb service nova] Lock "f22d4c05-720a-4dc7-afa0-ac823e70060a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:40:30 user nova-compute[73104]: DEBUG nova.compute.manager [req-cd2840be-773e-4ee1-8d99-837af69a299a req-21299a76-f624-4a10-a52a-dfe89fb6e9eb service nova] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] No waiting events found dispatching network-vif-unplugged-efd472f1-aab1-4878-bed5-14054ce12ebd {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:40:30 user nova-compute[73104]: DEBUG nova.compute.manager [req-cd2840be-773e-4ee1-8d99-837af69a299a req-21299a76-f624-4a10-a52a-dfe89fb6e9eb service nova] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Received event network-vif-unplugged-efd472f1-aab1-4878-bed5-14054ce12ebd for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:40:31 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Instance destroyed successfully.
Aug 26 08:40:31 user nova-compute[73104]: DEBUG nova.objects.instance [None req-7877cfa7-36b5-496b-aadb-12baa2f12f11 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lazy-loading 'resources' on Instance uuid f22d4c05-720a-4dc7-afa0-ac823e70060a {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:40:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-7877cfa7-36b5-496b-aadb-12baa2f12f11 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:38:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-948443756',display_name='tempest-ServersNegativeTestJSON-server-948443756',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-948443756',id=12,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:38:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35a0141c91ef45e4bf23a4b1cc4eb029',ramdisk_id='',reservation_id='r-bzrbt9r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1313163796',owner_user_name='tempest-ServersNegativeTestJSON-1313163796-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:38:47Z,user_data=None,user_id='d7ceab3a9cd7496fae6a08b9ea8cc513',uuid=f22d4c05-720a-4dc7-afa0-ac823e70060a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "efd472f1-aab1-4878-bed5-14054ce12ebd", "address": "fa:16:3e:c0:6c:81", "network": {"id": "c6ce9852-f528-4ac1-aa7a-be833ed25137", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2003310403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a0141c91ef45e4bf23a4b1cc4eb029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd472f1-aa", "ovs_interfaceid": "efd472f1-aab1-4878-bed5-14054ce12ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:40:31 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-7877cfa7-36b5-496b-aadb-12baa2f12f11 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Converting VIF {"id": "efd472f1-aab1-4878-bed5-14054ce12ebd", "address": "fa:16:3e:c0:6c:81", "network": {"id": "c6ce9852-f528-4ac1-aa7a-be833ed25137", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2003310403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a0141c91ef45e4bf23a4b1cc4eb029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd472f1-aa", "ovs_interfaceid": "efd472f1-aab1-4878-bed5-14054ce12ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:40:31 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-7877cfa7-36b5-496b-aadb-12baa2f12f11 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:6c:81,bridge_name='br-int',has_traffic_filtering=True,id=efd472f1-aab1-4878-bed5-14054ce12ebd,network=Network(c6ce9852-f528-4ac1-aa7a-be833ed25137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefd472f1-aa') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:40:31 user nova-compute[73104]: DEBUG os_vif [None req-7877cfa7-36b5-496b-aadb-12baa2f12f11 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:6c:81,bridge_name='br-int',has_traffic_filtering=True,id=efd472f1-aab1-4878-bed5-14054ce12ebd,network=Network(c6ce9852-f528-4ac1-aa7a-be833ed25137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefd472f1-aa') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:40:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapefd472f1-aa, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:40:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:40:31 user nova-compute[73104]: INFO os_vif [None req-7877cfa7-36b5-496b-aadb-12baa2f12f11 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:6c:81,bridge_name='br-int',has_traffic_filtering=True,id=efd472f1-aab1-4878-bed5-14054ce12ebd,network=Network(c6ce9852-f528-4ac1-aa7a-be833ed25137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefd472f1-aa')
Aug 26 08:40:31 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-7877cfa7-36b5-496b-aadb-12baa2f12f11 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Deleting instance files /opt/stack/data/nova/instances/f22d4c05-720a-4dc7-afa0-ac823e70060a_del
Aug 26 08:40:31 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-7877cfa7-36b5-496b-aadb-12baa2f12f11 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Deletion of /opt/stack/data/nova/instances/f22d4c05-720a-4dc7-afa0-ac823e70060a_del complete
Aug 26 08:40:31 user nova-compute[73104]: INFO nova.compute.manager [None req-7877cfa7-36b5-496b-aadb-12baa2f12f11 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Took 0.72 seconds to destroy the instance on the hypervisor.
Aug 26 08:40:31 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-7877cfa7-36b5-496b-aadb-12baa2f12f11 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 08:40:31 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 08:40:31 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 08:40:31 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:40:31 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Took 0.66 seconds to deallocate network for instance.
Aug 26 08:40:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7877cfa7-36b5-496b-aadb-12baa2f12f11 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:40:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7877cfa7-36b5-496b-aadb-12baa2f12f11 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:40:32 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-7877cfa7-36b5-496b-aadb-12baa2f12f11 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:40:32 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-7877cfa7-36b5-496b-aadb-12baa2f12f11 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:40:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7877cfa7-36b5-496b-aadb-12baa2f12f11 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:40:32 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-7877cfa7-36b5-496b-aadb-12baa2f12f11 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Deleted allocations for instance f22d4c05-720a-4dc7-afa0-ac823e70060a
Aug 26 08:40:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7877cfa7-36b5-496b-aadb-12baa2f12f11 tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lock "f22d4c05-720a-4dc7-afa0-ac823e70060a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.901s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:40:32 user nova-compute[73104]: DEBUG nova.compute.manager [req-e70b37dd-1f69-4242-a843-2f60541f9dc0 req-fd2f130d-4698-4fd3-bf09-fc0b0f9d225d service nova] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Received event network-vif-plugged-efd472f1-aab1-4878-bed5-14054ce12ebd {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:40:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e70b37dd-1f69-4242-a843-2f60541f9dc0 req-fd2f130d-4698-4fd3-bf09-fc0b0f9d225d service nova] Acquiring lock "f22d4c05-720a-4dc7-afa0-ac823e70060a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:40:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e70b37dd-1f69-4242-a843-2f60541f9dc0 req-fd2f130d-4698-4fd3-bf09-fc0b0f9d225d service nova] Lock "f22d4c05-720a-4dc7-afa0-ac823e70060a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:40:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e70b37dd-1f69-4242-a843-2f60541f9dc0 req-fd2f130d-4698-4fd3-bf09-fc0b0f9d225d service nova] Lock "f22d4c05-720a-4dc7-afa0-ac823e70060a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:40:32 user nova-compute[73104]: DEBUG nova.compute.manager [req-e70b37dd-1f69-4242-a843-2f60541f9dc0 req-fd2f130d-4698-4fd3-bf09-fc0b0f9d225d service nova] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] No waiting events found dispatching network-vif-plugged-efd472f1-aab1-4878-bed5-14054ce12ebd {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:40:32 user nova-compute[73104]: WARNING nova.compute.manager [req-e70b37dd-1f69-4242-a843-2f60541f9dc0 req-fd2f130d-4698-4fd3-bf09-fc0b0f9d225d service nova] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Received unexpected event network-vif-plugged-efd472f1-aab1-4878-bed5-14054ce12ebd for instance with vm_state deleted and task_state None.
Aug 26 08:40:32 user nova-compute[73104]: DEBUG nova.compute.manager [req-e70b37dd-1f69-4242-a843-2f60541f9dc0 req-fd2f130d-4698-4fd3-bf09-fc0b0f9d225d service nova] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Received event network-vif-deleted-efd472f1-aab1-4878-bed5-14054ce12ebd {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:40:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Acquiring lock "7095c1e6-3825-47d2-8b63-5755fab42b49" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:40:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lock "7095c1e6-3825-47d2-8b63-5755fab42b49" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:40:33 user nova-compute[73104]: DEBUG nova.compute.manager [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:40:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:40:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:40:33 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:40:33 user nova-compute[73104]: INFO nova.compute.claims [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Claim successful on node user
Aug 26 08:40:34 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:40:34 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:40:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.406s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:40:34 user nova-compute[73104]: DEBUG nova.compute.manager [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:40:34 user nova-compute[73104]: DEBUG nova.compute.manager [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:40:34 user nova-compute[73104]: DEBUG nova.network.neutron [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:40:34 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:40:34 user nova-compute[73104]: DEBUG nova.compute.manager [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:40:34 user nova-compute[73104]: INFO nova.virt.block_device [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Booting with volume b1752f0e-7e98-4f66-8c11-e5bb3410c207 at /dev/vda
Aug 26 08:40:34 user nova-compute[73104]: DEBUG nova.policy [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc49fb86f3ad4cc0930f0048701225d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0807a5c94bea4801bd80bbcdef223a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:40:34 user nova-compute[73104]: DEBUG os_brick.utils [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:40:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:34 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76a3a0f-db76-4a8a-b716-6ac92caf8a63]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:40:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:34 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a63639-a9bb-4a20-98d6-2aa1c98125fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:40:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:34 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef2f522-7613-4f7e-bf97-5e8850e94150]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:40:34 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a893fedf-849d-4164-ad7e-5296d3352e3d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:40:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:40:34 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:40:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:40:34 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:40:34 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee05e7c8-2345-4800-a1df-d08b4fa1a2e2]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:40:34 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:40:34 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:40:34 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:40:34 user nova-compute[73104]: DEBUG os_brick.utils [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:40:34 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Updating existing volume attachment record: 5958cf5e-34fc-4d25-a43e-a6a1c2ee56a2 {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 08:40:35 user nova-compute[73104]: DEBUG nova.network.neutron [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Successfully created port: 85d806c2-eef6-493b-96cc-f04d9580652d {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:40:36 user nova-compute[73104]: DEBUG nova.network.neutron [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Successfully updated port: 85d806c2-eef6-493b-96cc-f04d9580652d {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:40:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Acquiring lock "refresh_cache-7095c1e6-3825-47d2-8b63-5755fab42b49" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:40:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Acquired lock "refresh_cache-7095c1e6-3825-47d2-8b63-5755fab42b49" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:40:36 user nova-compute[73104]: DEBUG nova.network.neutron [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:40:36 user nova-compute[73104]: DEBUG nova.compute.manager [req-0a4db375-27c2-4331-b099-223d4280483e req-59375c93-828b-465c-a20c-a4a8b88f8174 service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Received event network-changed-85d806c2-eef6-493b-96cc-f04d9580652d {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:40:36 user nova-compute[73104]: DEBUG nova.compute.manager [req-0a4db375-27c2-4331-b099-223d4280483e req-59375c93-828b-465c-a20c-a4a8b88f8174 service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Refreshing instance network info cache due to event network-changed-85d806c2-eef6-493b-96cc-f04d9580652d. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:40:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0a4db375-27c2-4331-b099-223d4280483e req-59375c93-828b-465c-a20c-a4a8b88f8174 service nova] Acquiring lock "refresh_cache-7095c1e6-3825-47d2-8b63-5755fab42b49" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:40:36 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:36 user nova-compute[73104]: DEBUG nova.network.neutron [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:40:36 user nova-compute[73104]: DEBUG nova.network.neutron [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Updating instance_info_cache with network_info: [{"id": "85d806c2-eef6-493b-96cc-f04d9580652d", "address": "fa:16:3e:6e:38:0c", "network": {"id": "ef7a15d0-8aa7-47da-948d-c0f35a723f6f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-316051521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0807a5c94bea4801bd80bbcdef223a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d806c2-ee", "ovs_interfaceid": "85d806c2-eef6-493b-96cc-f04d9580652d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:40:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Releasing lock "refresh_cache-7095c1e6-3825-47d2-8b63-5755fab42b49" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:40:36 user nova-compute[73104]: DEBUG nova.compute.manager [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Instance network_info: |[{"id": "85d806c2-eef6-493b-96cc-f04d9580652d", "address": "fa:16:3e:6e:38:0c", "network": {"id": "ef7a15d0-8aa7-47da-948d-c0f35a723f6f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-316051521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0807a5c94bea4801bd80bbcdef223a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d806c2-ee", "ovs_interfaceid": "85d806c2-eef6-493b-96cc-f04d9580652d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:40:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0a4db375-27c2-4331-b099-223d4280483e req-59375c93-828b-465c-a20c-a4a8b88f8174 service nova] Acquired lock "refresh_cache-7095c1e6-3825-47d2-8b63-5755fab42b49" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:40:36 user nova-compute[73104]: DEBUG nova.network.neutron [req-0a4db375-27c2-4331-b099-223d4280483e req-59375c93-828b-465c-a20c-a4a8b88f8174 service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Refreshing network info cache for port 85d806c2-eef6-493b-96cc-f04d9580652d {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:40:36 user nova-compute[73104]: DEBUG nova.network.neutron [req-0a4db375-27c2-4331-b099-223d4280483e req-59375c93-828b-465c-a20c-a4a8b88f8174 service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Updated VIF entry in instance network info cache for port 85d806c2-eef6-493b-96cc-f04d9580652d. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:40:36 user nova-compute[73104]: DEBUG nova.network.neutron [req-0a4db375-27c2-4331-b099-223d4280483e req-59375c93-828b-465c-a20c-a4a8b88f8174 service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Updating instance_info_cache with network_info: [{"id": "85d806c2-eef6-493b-96cc-f04d9580652d", "address": "fa:16:3e:6e:38:0c", "network": {"id": "ef7a15d0-8aa7-47da-948d-c0f35a723f6f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-316051521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0807a5c94bea4801bd80bbcdef223a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d806c2-ee", "ovs_interfaceid": "85d806c2-eef6-493b-96cc-f04d9580652d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:40:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0a4db375-27c2-4331-b099-223d4280483e req-59375c93-828b-465c-a20c-a4a8b88f8174 service nova] Releasing lock "refresh_cache-7095c1e6-3825-47d2-8b63-5755fab42b49" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:40:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:41 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Acquiring lock "7c433050-8e37-4929-aa50-a55a6fedd171" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:40:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "7c433050-8e37-4929-aa50-a55a6fedd171" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:40:42 user nova-compute[73104]: DEBUG nova.compute.manager [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:40:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:40:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:40:42 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:40:42 user nova-compute[73104]: INFO nova.compute.claims [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Claim successful on node user
Aug 26 08:40:42 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:40:42 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:40:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:40:42 user nova-compute[73104]: DEBUG nova.compute.manager [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:40:43 user nova-compute[73104]: DEBUG nova.compute.manager [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:40:43 user nova-compute[73104]: DEBUG nova.network.neutron [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:40:43 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:40:43 user nova-compute[73104]: DEBUG nova.compute.manager [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:40:43 user nova-compute[73104]: DEBUG nova.policy [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5653cc2733b44477957b797143a854f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6f6e226b23400481b2ad063356bc06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:40:43 user nova-compute[73104]: DEBUG nova.compute.manager [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:40:43 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:40:43 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Creating image(s)
Aug 26 08:40:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c433050-8e37-4929-aa50-a55a6fedd171/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:40:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "/opt/stack/data/nova/instances/7c433050-8e37-4929-aa50-a55a6fedd171/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:40:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "/opt/stack/data/nova/instances/7c433050-8e37-4929-aa50-a55a6fedd171/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:40:43 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:43 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:40:43 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 08:40:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-385c6d93-907d-42d7-9b43-479e6caf66f9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:40:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-385c6d93-907d-42d7-9b43-479e6caf66f9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:40:43 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 08:40:43 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.200s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:40:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:40:43 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:43 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.204s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:43 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/7c433050-8e37-4929-aa50-a55a6fedd171/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:43 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/7c433050-8e37-4929-aa50-a55a6fedd171/disk 1073741824" returned: 0 in 0.060s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:40:43 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:43 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.224s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:43 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c433050-8e37-4929-aa50-a55a6fedd171/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 08:40:43 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c433050-8e37-4929-aa50-a55a6fedd171/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:43 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Updating instance_info_cache with network_info: [{"id": "d4692900-c165-487d-9847-383fcf1d2270", "address": "fa:16:3e:b9:37:34", "network": {"id": "9aad8a32-d93f-45ef-be53-f84cebd194b1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2017537149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc8c266ecf8444919a4a2ed73b784b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4692900-c1", "ovs_interfaceid": "d4692900-c165-487d-9847-383fcf1d2270", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:40:43 user nova-compute[73104]: DEBUG nova.network.neutron [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Successfully created port: affefe3c-1cfa-41fd-a361-5d40b56728ab {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:40:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-385c6d93-907d-42d7-9b43-479e6caf66f9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:40:44 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 08:40:44 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:40:44 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:40:44 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 08:40:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c433050-8e37-4929-aa50-a55a6fedd171/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:44 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Cannot resize image /opt/stack/data/nova/instances/7c433050-8e37-4929-aa50-a55a6fedd171/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 08:40:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:40:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Ensure instance console log exists: /opt/stack/data/nova/instances/7c433050-8e37-4929-aa50-a55a6fedd171/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:40:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:40:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:40:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:40:44 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:40:44 user nova-compute[73104]: DEBUG nova.network.neutron [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Successfully updated port: affefe3c-1cfa-41fd-a361-5d40b56728ab {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:40:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Acquiring lock "refresh_cache-7c433050-8e37-4929-aa50-a55a6fedd171" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:40:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Acquired lock "refresh_cache-7c433050-8e37-4929-aa50-a55a6fedd171" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:40:44 user nova-compute[73104]: DEBUG nova.network.neutron [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:40:44 user nova-compute[73104]: DEBUG nova.compute.manager [req-29bafcda-6f7f-45fc-9771-dab5ea12c900 req-ac3c47e2-d3d5-45e2-91cd-7cdd1ba96865 service nova] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Received event network-changed-affefe3c-1cfa-41fd-a361-5d40b56728ab {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:40:44 user nova-compute[73104]: DEBUG nova.compute.manager [req-29bafcda-6f7f-45fc-9771-dab5ea12c900 req-ac3c47e2-d3d5-45e2-91cd-7cdd1ba96865 service nova] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Refreshing instance network info cache due to event network-changed-affefe3c-1cfa-41fd-a361-5d40b56728ab. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:40:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-29bafcda-6f7f-45fc-9771-dab5ea12c900 req-ac3c47e2-d3d5-45e2-91cd-7cdd1ba96865 service nova] Acquiring lock "refresh_cache-7c433050-8e37-4929-aa50-a55a6fedd171" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:40:44 user nova-compute[73104]: DEBUG nova.network.neutron [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.network.neutron [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Updating instance_info_cache with network_info: [{"id": "affefe3c-1cfa-41fd-a361-5d40b56728ab", "address": "fa:16:3e:f4:4f:ea", "network": {"id": "58299b40-db54-4ba9-b4aa-8a40f0c2c2d4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-295087397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef6f6e226b23400481b2ad063356bc06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffefe3c-1c", "ovs_interfaceid": "affefe3c-1cfa-41fd-a361-5d40b56728ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Releasing lock "refresh_cache-7c433050-8e37-4929-aa50-a55a6fedd171" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.compute.manager [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Instance network_info: |[{"id": "affefe3c-1cfa-41fd-a361-5d40b56728ab", "address": "fa:16:3e:f4:4f:ea", "network": {"id": "58299b40-db54-4ba9-b4aa-8a40f0c2c2d4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-295087397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef6f6e226b23400481b2ad063356bc06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffefe3c-1c", "ovs_interfaceid": "affefe3c-1cfa-41fd-a361-5d40b56728ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-29bafcda-6f7f-45fc-9771-dab5ea12c900 req-ac3c47e2-d3d5-45e2-91cd-7cdd1ba96865 service nova] Acquired lock "refresh_cache-7c433050-8e37-4929-aa50-a55a6fedd171" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.network.neutron [req-29bafcda-6f7f-45fc-9771-dab5ea12c900 req-ac3c47e2-d3d5-45e2-91cd-7cdd1ba96865 service nova] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Refreshing network info cache for port affefe3c-1cfa-41fd-a361-5d40b56728ab {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Start _get_guest_xml network_info=[{"id": "affefe3c-1cfa-41fd-a361-5d40b56728ab", "address": "fa:16:3e:f4:4f:ea", "network": {"id": "58299b40-db54-4ba9-b4aa-8a40f0c2c2d4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-295087397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef6f6e226b23400481b2ad063356bc06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffefe3c-1c", "ovs_interfaceid": "affefe3c-1cfa-41fd-a361-5d40b56728ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:40:45 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:40:45 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:40:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-382989856',display_name='tempest-VolumesAdminNegativeTest-server-382989856',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-382989856',id=15,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef6f6e226b23400481b2ad063356bc06',ramdisk_id='',reservation_id='r-sm7tt7xo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-933148822',owner_user_name='tempest-VolumesAdminNegativeTest-933148822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:40:43Z,user_data=None,user_id='5653cc2733b44477957b797143a854f6',uuid=7c433050-8e37-4929-aa50-a55a6fedd171,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "affefe3c-1cfa-41fd-a361-5d40b56728ab", "address": "fa:16:3e:f4:4f:ea", "network": {"id": "58299b40-db54-4ba9-b4aa-8a40f0c2c2d4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-295087397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef6f6e226b23400481b2ad063356bc06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffefe3c-1c", "ovs_interfaceid": "affefe3c-1cfa-41fd-a361-5d40b56728ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Converting VIF {"id": "affefe3c-1cfa-41fd-a361-5d40b56728ab", "address": "fa:16:3e:f4:4f:ea", "network": {"id": "58299b40-db54-4ba9-b4aa-8a40f0c2c2d4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-295087397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef6f6e226b23400481b2ad063356bc06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffefe3c-1c", "ovs_interfaceid": "affefe3c-1cfa-41fd-a361-5d40b56728ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:4f:ea,bridge_name='br-int',has_traffic_filtering=True,id=affefe3c-1cfa-41fd-a361-5d40b56728ab,network=Network(58299b40-db54-4ba9-b4aa-8a40f0c2c2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaffefe3c-1c') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.objects.instance [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c433050-8e37-4929-aa50-a55a6fedd171 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:40:45 user nova-compute[73104]:   <uuid>7c433050-8e37-4929-aa50-a55a6fedd171</uuid>
Aug 26 08:40:45 user nova-compute[73104]:   <name>instance-0000000f</name>
Aug 26 08:40:45 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:40:45 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:40:45 user nova-compute[73104]:   <metadata>
Aug 26 08:40:45 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:40:45 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:40:45 user nova-compute[73104]:       <nova:name>tempest-VolumesAdminNegativeTest-server-382989856</nova:name>
Aug 26 08:40:45 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:40:45</nova:creationTime>
Aug 26 08:40:45 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:40:45 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:40:45 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:40:45 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:40:45 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:40:45 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:40:45 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:40:45 user nova-compute[73104]:       <nova:owner>
Aug 26 08:40:45 user nova-compute[73104]:         <nova:user uuid="5653cc2733b44477957b797143a854f6">tempest-VolumesAdminNegativeTest-933148822-project-member</nova:user>
Aug 26 08:40:45 user nova-compute[73104]:         <nova:project uuid="ef6f6e226b23400481b2ad063356bc06">tempest-VolumesAdminNegativeTest-933148822</nova:project>
Aug 26 08:40:45 user nova-compute[73104]:       </nova:owner>
Aug 26 08:40:45 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:40:45 user nova-compute[73104]:       <nova:ports>
Aug 26 08:40:45 user nova-compute[73104]:         <nova:port uuid="affefe3c-1cfa-41fd-a361-5d40b56728ab">
Aug 26 08:40:45 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 08:40:45 user nova-compute[73104]:         </nova:port>
Aug 26 08:40:45 user nova-compute[73104]:       </nova:ports>
Aug 26 08:40:45 user nova-compute[73104]:     </nova:instance>
Aug 26 08:40:45 user nova-compute[73104]:   </metadata>
Aug 26 08:40:45 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:40:45 user nova-compute[73104]:     <system>
Aug 26 08:40:45 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:40:45 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:40:45 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:40:45 user nova-compute[73104]:       <entry name="serial">7c433050-8e37-4929-aa50-a55a6fedd171</entry>
Aug 26 08:40:45 user nova-compute[73104]:       <entry name="uuid">7c433050-8e37-4929-aa50-a55a6fedd171</entry>
Aug 26 08:40:45 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:40:45 user nova-compute[73104]:     </system>
Aug 26 08:40:45 user nova-compute[73104]:   </sysinfo>
Aug 26 08:40:45 user nova-compute[73104]:   <os>
Aug 26 08:40:45 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:40:45 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:40:45 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:40:45 user nova-compute[73104]:   </os>
Aug 26 08:40:45 user nova-compute[73104]:   <features>
Aug 26 08:40:45 user nova-compute[73104]:     <acpi/>
Aug 26 08:40:45 user nova-compute[73104]:     <apic/>
Aug 26 08:40:45 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:40:45 user nova-compute[73104]:   </features>
Aug 26 08:40:45 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:40:45 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:40:45 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:40:45 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:40:45 user nova-compute[73104]:   </clock>
Aug 26 08:40:45 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:40:45 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:40:45 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:40:45 user nova-compute[73104]:   </cpu>
Aug 26 08:40:45 user nova-compute[73104]:   <devices>
Aug 26 08:40:45 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:40:45 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:40:45 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/7c433050-8e37-4929-aa50-a55a6fedd171/disk"/>
Aug 26 08:40:45 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:40:45 user nova-compute[73104]:     </disk>
Aug 26 08:40:45 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:40:45 user nova-compute[73104]:       <mac address="fa:16:3e:f4:4f:ea"/>
Aug 26 08:40:45 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:40:45 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:40:45 user nova-compute[73104]:       <target dev="tapaffefe3c-1c"/>
Aug 26 08:40:45 user nova-compute[73104]:     </interface>
Aug 26 08:40:45 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:40:45 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/7c433050-8e37-4929-aa50-a55a6fedd171/console.log" append="off"/>
Aug 26 08:40:45 user nova-compute[73104]:     </serial>
Aug 26 08:40:45 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:40:45 user nova-compute[73104]:     <video>
Aug 26 08:40:45 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:40:45 user nova-compute[73104]:     </video>
Aug 26 08:40:45 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:40:45 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:40:45 user nova-compute[73104]:     </rng>
Aug 26 08:40:45 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:40:45 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:40:45 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:40:45 user nova-compute[73104]:     </memballoon>
Aug 26 08:40:45 user nova-compute[73104]:   </devices>
Aug 26 08:40:45 user nova-compute[73104]: </domain>
Aug 26 08:40:45 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:40:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-382989856',display_name='tempest-VolumesAdminNegativeTest-server-382989856',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-382989856',id=15,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef6f6e226b23400481b2ad063356bc06',ramdisk_id='',reservation_id='r-sm7tt7xo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-933148822',owner_user_name='tempest-VolumesAdminNegativeTest-933148822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:40:43Z,user_data=None,user_id='5653cc2733b44477957b797143a854f6',uuid=7c433050-8e37-4929-aa50-a55a6fedd171,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "affefe3c-1cfa-41fd-a361-5d40b56728ab", "address": "fa:16:3e:f4:4f:ea", "network": {"id": "58299b40-db54-4ba9-b4aa-8a40f0c2c2d4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-295087397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef6f6e226b23400481b2ad063356bc06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffefe3c-1c", "ovs_interfaceid": "affefe3c-1cfa-41fd-a361-5d40b56728ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Converting VIF {"id": "affefe3c-1cfa-41fd-a361-5d40b56728ab", "address": "fa:16:3e:f4:4f:ea", "network": {"id": "58299b40-db54-4ba9-b4aa-8a40f0c2c2d4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-295087397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef6f6e226b23400481b2ad063356bc06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffefe3c-1c", "ovs_interfaceid": "affefe3c-1cfa-41fd-a361-5d40b56728ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:4f:ea,bridge_name='br-int',has_traffic_filtering=True,id=affefe3c-1cfa-41fd-a361-5d40b56728ab,network=Network(58299b40-db54-4ba9-b4aa-8a40f0c2c2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaffefe3c-1c') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG os_vif [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:4f:ea,bridge_name='br-int',has_traffic_filtering=True,id=affefe3c-1cfa-41fd-a361-5d40b56728ab,network=Network(58299b40-db54-4ba9-b4aa-8a40f0c2c2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaffefe3c-1c') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaffefe3c-1c, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaffefe3c-1c, col_values=(('external_ids', {'iface-id': 'affefe3c-1cfa-41fd-a361-5d40b56728ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:4f:ea', 'vm-uuid': '7c433050-8e37-4929-aa50-a55a6fedd171'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:45 user nova-compute[73104]: INFO os_vif [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:4f:ea,bridge_name='br-int',has_traffic_filtering=True,id=affefe3c-1cfa-41fd-a361-5d40b56728ab,network=Network(58299b40-db54-4ba9-b4aa-8a40f0c2c2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaffefe3c-1c')
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] No VIF found with MAC fa:16:3e:f4:4f:ea, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.network.neutron [req-29bafcda-6f7f-45fc-9771-dab5ea12c900 req-ac3c47e2-d3d5-45e2-91cd-7cdd1ba96865 service nova] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Updated VIF entry in instance network info cache for port affefe3c-1cfa-41fd-a361-5d40b56728ab. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG nova.network.neutron [req-29bafcda-6f7f-45fc-9771-dab5ea12c900 req-ac3c47e2-d3d5-45e2-91cd-7cdd1ba96865 service nova] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Updating instance_info_cache with network_info: [{"id": "affefe3c-1cfa-41fd-a361-5d40b56728ab", "address": "fa:16:3e:f4:4f:ea", "network": {"id": "58299b40-db54-4ba9-b4aa-8a40f0c2c2d4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-295087397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef6f6e226b23400481b2ad063356bc06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffefe3c-1c", "ovs_interfaceid": "affefe3c-1cfa-41fd-a361-5d40b56728ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-29bafcda-6f7f-45fc-9771-dab5ea12c900 req-ac3c47e2-d3d5-45e2-91cd-7cdd1ba96865 service nova] Releasing lock "refresh_cache-7c433050-8e37-4929-aa50-a55a6fedd171" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:40:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:46 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693039231.0479636, f22d4c05-720a-4dc7-afa0-ac823e70060a => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:40:46 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] VM Stopped (Lifecycle Event)
Aug 26 08:40:46 user nova-compute[73104]: DEBUG nova.compute.manager [None req-1354a281-05fe-4880-9f01-1c21cc05c409 None None] [instance: f22d4c05-720a-4dc7-afa0-ac823e70060a] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:40:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:47 user nova-compute[73104]: DEBUG nova.compute.manager [req-b1a2bf48-193c-4664-8ffd-b9901cc77837 req-26f8c785-8f9f-4e4b-aee6-51cc95d8c99c service nova] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Received event network-vif-plugged-affefe3c-1cfa-41fd-a361-5d40b56728ab {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:40:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b1a2bf48-193c-4664-8ffd-b9901cc77837 req-26f8c785-8f9f-4e4b-aee6-51cc95d8c99c service nova] Acquiring lock "7c433050-8e37-4929-aa50-a55a6fedd171-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:40:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b1a2bf48-193c-4664-8ffd-b9901cc77837 req-26f8c785-8f9f-4e4b-aee6-51cc95d8c99c service nova] Lock "7c433050-8e37-4929-aa50-a55a6fedd171-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:40:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b1a2bf48-193c-4664-8ffd-b9901cc77837 req-26f8c785-8f9f-4e4b-aee6-51cc95d8c99c service nova] Lock "7c433050-8e37-4929-aa50-a55a6fedd171-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:40:47 user nova-compute[73104]: DEBUG nova.compute.manager [req-b1a2bf48-193c-4664-8ffd-b9901cc77837 req-26f8c785-8f9f-4e4b-aee6-51cc95d8c99c service nova] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] No waiting events found dispatching network-vif-plugged-affefe3c-1cfa-41fd-a361-5d40b56728ab {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:40:47 user nova-compute[73104]: WARNING nova.compute.manager [req-b1a2bf48-193c-4664-8ffd-b9901cc77837 req-26f8c785-8f9f-4e4b-aee6-51cc95d8c99c service nova] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Received unexpected event network-vif-plugged-affefe3c-1cfa-41fd-a361-5d40b56728ab for instance with vm_state building and task_state spawning.
Aug 26 08:40:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c433050-8e37-4929-aa50-a55a6fedd171/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c433050-8e37-4929-aa50-a55a6fedd171/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c433050-8e37-4929-aa50-a55a6fedd171/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c433050-8e37-4929-aa50-a55a6fedd171/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85eea82a-c221-4661-9525-06a925b57e1c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85eea82a-c221-4661-9525-06a925b57e1c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85eea82a-c221-4661-9525-06a925b57e1c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85eea82a-c221-4661-9525-06a925b57e1c/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:48 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:40:48 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:40:48 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:40:48 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:40:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:48 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:40:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04e96c7-f098-4612-b0b8-92cf6fd58865/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04e96c7-f098-4612-b0b8-92cf6fd58865/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04e96c7-f098-4612-b0b8-92cf6fd58865/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04e96c7-f098-4612-b0b8-92cf6fd58865/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:49 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039249.3838606, 7c433050-8e37-4929-aa50-a55a6fedd171 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:40:49 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] VM Resumed (Lifecycle Event)
Aug 26 08:40:49 user nova-compute[73104]: DEBUG nova.compute.manager [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:40:49 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:40:49 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Instance spawned successfully.
Aug 26 08:40:49 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:40:49 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:40:49 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:40:49 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:40:49 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:40:49 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:40:49 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:40:49 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:40:49 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:40:49 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:40:49 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039249.3873587, 7c433050-8e37-4929-aa50-a55a6fedd171 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:40:49 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] VM Started (Lifecycle Event)
Aug 26 08:40:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-90a90f88-d32c-42a2-93bc-0bfe6be355e2 req-ecee8189-14f5-4773-92e0-63deef42838d service nova] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Received event network-vif-plugged-affefe3c-1cfa-41fd-a361-5d40b56728ab {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:40:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-90a90f88-d32c-42a2-93bc-0bfe6be355e2 req-ecee8189-14f5-4773-92e0-63deef42838d service nova] Acquiring lock "7c433050-8e37-4929-aa50-a55a6fedd171-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:40:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-90a90f88-d32c-42a2-93bc-0bfe6be355e2 req-ecee8189-14f5-4773-92e0-63deef42838d service nova] Lock "7c433050-8e37-4929-aa50-a55a6fedd171-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:40:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-90a90f88-d32c-42a2-93bc-0bfe6be355e2 req-ecee8189-14f5-4773-92e0-63deef42838d service nova] Lock "7c433050-8e37-4929-aa50-a55a6fedd171-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:40:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-90a90f88-d32c-42a2-93bc-0bfe6be355e2 req-ecee8189-14f5-4773-92e0-63deef42838d service nova] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] No waiting events found dispatching network-vif-plugged-affefe3c-1cfa-41fd-a361-5d40b56728ab {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:40:49 user nova-compute[73104]: WARNING nova.compute.manager [req-90a90f88-d32c-42a2-93bc-0bfe6be355e2 req-ecee8189-14f5-4773-92e0-63deef42838d service nova] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Received unexpected event network-vif-plugged-affefe3c-1cfa-41fd-a361-5d40b56728ab for instance with vm_state building and task_state spawning.
Aug 26 08:40:49 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:40:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:49 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:40:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:49 user nova-compute[73104]: INFO nova.compute.manager [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Took 6.43 seconds to spawn the instance on the hypervisor.
Aug 26 08:40:49 user nova-compute[73104]: DEBUG nova.compute.manager [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:40:49 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:40:49 user nova-compute[73104]: INFO nova.compute.manager [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Took 7.29 seconds to build instance.
Aug 26 08:40:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ab7362bf-a149-4b20-bf87-3c2909fb8331 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "7c433050-8e37-4929-aa50-a55a6fedd171" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.403s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:40:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:50 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9adacbad-90f7-4f46-8340-9c1ea0e2df7a tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Acquiring lock "b04e96c7-f098-4612-b0b8-92cf6fd58865" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:40:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9adacbad-90f7-4f46-8340-9c1ea0e2df7a tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Lock "b04e96c7-f098-4612-b0b8-92cf6fd58865" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:40:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9adacbad-90f7-4f46-8340-9c1ea0e2df7a tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Acquiring lock "b04e96c7-f098-4612-b0b8-92cf6fd58865-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:40:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9adacbad-90f7-4f46-8340-9c1ea0e2df7a tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Lock "b04e96c7-f098-4612-b0b8-92cf6fd58865-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:40:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9adacbad-90f7-4f46-8340-9c1ea0e2df7a tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Lock "b04e96c7-f098-4612-b0b8-92cf6fd58865-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:40:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da850cb3-3d57-4243-8af8-13c7f3251787/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:50 user nova-compute[73104]: INFO nova.compute.manager [None req-9adacbad-90f7-4f46-8340-9c1ea0e2df7a tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Terminating instance
Aug 26 08:40:50 user nova-compute[73104]: DEBUG nova.compute.manager [None req-9adacbad-90f7-4f46-8340-9c1ea0e2df7a tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 08:40:50 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:50 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da850cb3-3d57-4243-8af8-13c7f3251787/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da850cb3-3d57-4243-8af8-13c7f3251787/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:50 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:50 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:50 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da850cb3-3d57-4243-8af8-13c7f3251787/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:50 user nova-compute[73104]: DEBUG nova.compute.manager [req-57814771-091c-49b3-808e-33a0403bb3de req-ed1393fd-22b2-4fe2-8efc-2a404ad2aa32 service nova] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Received event network-vif-unplugged-e589161d-f15a-4143-8dcc-445bb29fbdff {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:40:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-57814771-091c-49b3-808e-33a0403bb3de req-ed1393fd-22b2-4fe2-8efc-2a404ad2aa32 service nova] Acquiring lock "b04e96c7-f098-4612-b0b8-92cf6fd58865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:40:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-57814771-091c-49b3-808e-33a0403bb3de req-ed1393fd-22b2-4fe2-8efc-2a404ad2aa32 service nova] Lock "b04e96c7-f098-4612-b0b8-92cf6fd58865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:40:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-57814771-091c-49b3-808e-33a0403bb3de req-ed1393fd-22b2-4fe2-8efc-2a404ad2aa32 service nova] Lock "b04e96c7-f098-4612-b0b8-92cf6fd58865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:40:50 user nova-compute[73104]: DEBUG nova.compute.manager [req-57814771-091c-49b3-808e-33a0403bb3de req-ed1393fd-22b2-4fe2-8efc-2a404ad2aa32 service nova] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] No waiting events found dispatching network-vif-unplugged-e589161d-f15a-4143-8dcc-445bb29fbdff {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:40:50 user nova-compute[73104]: DEBUG nova.compute.manager [req-57814771-091c-49b3-808e-33a0403bb3de req-ed1393fd-22b2-4fe2-8efc-2a404ad2aa32 service nova] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Received event network-vif-unplugged-e589161d-f15a-4143-8dcc-445bb29fbdff for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:40:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquiring lock "385c6d93-907d-42d7-9b43-479e6caf66f9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:40:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:40:51 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:40:51 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:40:51 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=7350MB free_disk=24.598468780517578GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 08:40:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:40:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:40:51 user nova-compute[73104]: DEBUG nova.objects.instance [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lazy-loading 'flavor' on Instance uuid 385c6d93-907d-42d7-9b43-479e6caf66f9 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:40:51 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Instance destroyed successfully.
Aug 26 08:40:51 user nova-compute[73104]: DEBUG nova.objects.instance [None req-9adacbad-90f7-4f46-8340-9c1ea0e2df7a tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Lazy-loading 'resources' on Instance uuid b04e96c7-f098-4612-b0b8-92cf6fd58865 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:40:51 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-9adacbad-90f7-4f46-8340-9c1ea0e2df7a tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:37:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1761440256',display_name='tempest-VolumesAssistedSnapshotsTest-server-1761440256',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1761440256',id=8,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOunchFb13bRhOM3jQW2UQnMPxvfTmt5AvnDaDPkitb77PHOy9GVGHdVESbzkwrvoMDNaPR1YdSZ+Aj2rN6g9lO4zYI9yIxcZlnqQNgPQKSjM6qdJJMLpbn/Q09h/CCCdA==',key_name='tempest-keypair-1246782866',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:37:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='251199a8e75247e897551cb5bc1aec00',ramdisk_id='',reservation_id='r-gpwmnq8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-215182459',owner_user_name='tempest-VolumesAssistedSnapshotsTest-215182459-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:37:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df5ec3ef2c5e45698ed648547430fa29',uuid=b04e96c7-f098-4612-b0b8-92cf6fd58865,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e589161d-f15a-4143-8dcc-445bb29fbdff", "address": "fa:16:3e:23:5b:3a", "network": {"id": "6e5e1144-fa42-42e5-83e5-82d1825ede71", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-135318777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "251199a8e75247e897551cb5bc1aec00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape589161d-f1", "ovs_interfaceid": "e589161d-f15a-4143-8dcc-445bb29fbdff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:40:51 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-9adacbad-90f7-4f46-8340-9c1ea0e2df7a tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Converting VIF {"id": "e589161d-f15a-4143-8dcc-445bb29fbdff", "address": "fa:16:3e:23:5b:3a", "network": {"id": "6e5e1144-fa42-42e5-83e5-82d1825ede71", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-135318777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "251199a8e75247e897551cb5bc1aec00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape589161d-f1", "ovs_interfaceid": "e589161d-f15a-4143-8dcc-445bb29fbdff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:40:51 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-9adacbad-90f7-4f46-8340-9c1ea0e2df7a tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:5b:3a,bridge_name='br-int',has_traffic_filtering=True,id=e589161d-f15a-4143-8dcc-445bb29fbdff,network=Network(6e5e1144-fa42-42e5-83e5-82d1825ede71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape589161d-f1') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:40:51 user nova-compute[73104]: DEBUG os_vif [None req-9adacbad-90f7-4f46-8340-9c1ea0e2df7a tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:5b:3a,bridge_name='br-int',has_traffic_filtering=True,id=e589161d-f15a-4143-8dcc-445bb29fbdff,network=Network(6e5e1144-fa42-42e5-83e5-82d1825ede71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape589161d-f1') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:40:51 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:51 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape589161d-f1, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:40:51 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:51 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:51 user nova-compute[73104]: INFO os_vif [None req-9adacbad-90f7-4f46-8340-9c1ea0e2df7a tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:5b:3a,bridge_name='br-int',has_traffic_filtering=True,id=e589161d-f15a-4143-8dcc-445bb29fbdff,network=Network(6e5e1144-fa42-42e5-83e5-82d1825ede71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape589161d-f1')
Aug 26 08:40:51 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-9adacbad-90f7-4f46-8340-9c1ea0e2df7a tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Deleting instance files /opt/stack/data/nova/instances/b04e96c7-f098-4612-b0b8-92cf6fd58865_del
Aug 26 08:40:51 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-9adacbad-90f7-4f46-8340-9c1ea0e2df7a tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Deletion of /opt/stack/data/nova/instances/b04e96c7-f098-4612-b0b8-92cf6fd58865_del complete
Aug 26 08:40:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.120s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:40:51 user nova-compute[73104]: INFO nova.compute.manager [None req-9adacbad-90f7-4f46-8340-9c1ea0e2df7a tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Took 1.35 seconds to destroy the instance on the hypervisor.
Aug 26 08:40:51 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-9adacbad-90f7-4f46-8340-9c1ea0e2df7a tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 08:40:51 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 08:40:51 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 08:40:51 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance dcec7631-b94f-4dbf-b85d-e8ad9c6396b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:40:51 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 13200b79-17a6-4c18-87da-653311946a04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:40:51 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 385c6d93-907d-42d7-9b43-479e6caf66f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:40:51 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 93244bcd-34be-46f3-85e6-87bb5e69888d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:40:51 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance b04e96c7-f098-4612-b0b8-92cf6fd58865 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:40:51 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 85eea82a-c221-4661-9525-06a925b57e1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:40:51 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance e2ec2788-98c7-48a7-933a-433dc215d7ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:40:51 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 7170b5a8-12a7-4ddf-8089-fde172570fd1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:40:51 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance da850cb3-3d57-4243-8af8-13c7f3251787 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:40:51 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 7095c1e6-3825-47d2-8b63-5755fab42b49 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:40:51 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 7c433050-8e37-4929-aa50-a55a6fedd171 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:40:51 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 08:40:51 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 08:40:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquiring lock "385c6d93-907d-42d7-9b43-479e6caf66f9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:40:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:40:52 user nova-compute[73104]: INFO nova.compute.manager [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Attaching volume c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 to /dev/vdb
Aug 26 08:40:52 user nova-compute[73104]: DEBUG os_brick.utils [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:40:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:52 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[37538944-f44a-4e29-9b64-01e383d2d074]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:40:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.061s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:52 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[042116e0-67f6-461d-9677-88943d8af47f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:40:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:52 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d7fbc7-9469-41d4-974a-5de96030f435]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:40:52 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5208c9-0d97-4706-ad92-67b2bc9ff227]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:40:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:40:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:40:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:40:52 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:40:52 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a811166c-3769-466e-9cfc-e85ff22bcc14]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:40:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:40:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:40:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:40:52 user nova-compute[73104]: DEBUG os_brick.utils [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] <== get_connector_properties: return (203ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:40:52 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Updating existing volume attachment record: 8793491f-9530-4b19-b13f-a241209dba8b {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 08:40:52 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:40:52 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:40:52 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 08:40:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.877s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:40:53 user nova-compute[73104]: DEBUG nova.compute.manager [req-c93761a5-8309-4f7e-acf3-787c7c4527c7 req-07b75e4a-e698-4b31-84c3-1f7b1149f137 service nova] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Received event network-vif-plugged-e589161d-f15a-4143-8dcc-445bb29fbdff {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:40:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c93761a5-8309-4f7e-acf3-787c7c4527c7 req-07b75e4a-e698-4b31-84c3-1f7b1149f137 service nova] Acquiring lock "b04e96c7-f098-4612-b0b8-92cf6fd58865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:40:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c93761a5-8309-4f7e-acf3-787c7c4527c7 req-07b75e4a-e698-4b31-84c3-1f7b1149f137 service nova] Lock "b04e96c7-f098-4612-b0b8-92cf6fd58865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:40:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c93761a5-8309-4f7e-acf3-787c7c4527c7 req-07b75e4a-e698-4b31-84c3-1f7b1149f137 service nova] Lock "b04e96c7-f098-4612-b0b8-92cf6fd58865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:40:53 user nova-compute[73104]: DEBUG nova.compute.manager [req-c93761a5-8309-4f7e-acf3-787c7c4527c7 req-07b75e4a-e698-4b31-84c3-1f7b1149f137 service nova] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] No waiting events found dispatching network-vif-plugged-e589161d-f15a-4143-8dcc-445bb29fbdff {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:40:53 user nova-compute[73104]: WARNING nova.compute.manager [req-c93761a5-8309-4f7e-acf3-787c7c4527c7 req-07b75e4a-e698-4b31-84c3-1f7b1149f137 service nova] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Received unexpected event network-vif-plugged-e589161d-f15a-4143-8dcc-445bb29fbdff for instance with vm_state active and task_state deleting.
Aug 26 08:40:53 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:40:53 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Took 1.30 seconds to deallocate network for instance.
Aug 26 08:40:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9adacbad-90f7-4f46-8340-9c1ea0e2df7a tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:40:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9adacbad-90f7-4f46-8340-9c1ea0e2df7a tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:40:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:53 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-9adacbad-90f7-4f46-8340-9c1ea0e2df7a tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:40:53 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-9adacbad-90f7-4f46-8340-9c1ea0e2df7a tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:40:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9adacbad-90f7-4f46-8340-9c1ea0e2df7a tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.527s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:40:53 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-9adacbad-90f7-4f46-8340-9c1ea0e2df7a tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Deleted allocations for instance b04e96c7-f098-4612-b0b8-92cf6fd58865
Aug 26 08:40:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9adacbad-90f7-4f46-8340-9c1ea0e2df7a tempest-VolumesAssistedSnapshotsTest-215182459 tempest-VolumesAssistedSnapshotsTest-215182459-project-member] Lock "b04e96c7-f098-4612-b0b8-92cf6fd58865" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.510s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:40:54 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:40:54 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:40:54 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:40:54 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:40:54 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:40:55 user nova-compute[73104]: DEBUG nova.compute.manager [req-204b16c4-181a-4502-92fc-62f8119d2c80 req-662906b9-9aaa-4037-aff3-64ed06a8fcec service nova] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Received event network-vif-deleted-e589161d-f15a-4143-8dcc-445bb29fbdff {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:40:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:40:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "94de2062-7017-44fe-8df0-0a3cd63d5498" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:40:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:40:57 user nova-compute[73104]: INFO nova.compute.manager [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Unshelving
Aug 26 08:40:57 user nova-compute[73104]: INFO nova.virt.block_device [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Booting with volume 5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 at /dev/vdc
Aug 26 08:40:57 user nova-compute[73104]: DEBUG os_brick.utils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:40:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d27a47-836a-4082-a91f-d7c3ee8df814]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:40:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5f7178-37b8-43f7-9d2e-1d5ef0c9bd65]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:40:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:40:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9aa95f-f0ce-4080-8f6a-58359142dd5e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:40:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c43a244-1511-4b64-894b-7795cadce4d0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:40:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:40:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:40:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:40:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:40:57 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:40:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c982e01f-a517-4aab-86ef-f21263097b12]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:40:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:40:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:40:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:40:57 user nova-compute[73104]: DEBUG os_brick.utils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:40:57 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Updating existing volume attachment record: fc233ecc-221c-4a86-9d48-396cc9dcef74 {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 08:41:01 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:41:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG nova.compute.manager [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:41:03 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Creating image(s)
Aug 26 08:41:03 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Did not create local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Ensure instance console log exists: /opt/stack/data/nova/instances/7095c1e6-3825-47d2-8b63-5755fab42b49/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Start _get_guest_xml network_info=[{"id": "85d806c2-eef6-493b-96cc-f04d9580652d", "address": "fa:16:3e:6e:38:0c", "network": {"id": "ef7a15d0-8aa7-47da-948d-c0f35a723f6f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-316051521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0807a5c94bea4801bd80bbcdef223a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d806c2-ee", "ovs_interfaceid": "85d806c2-eef6-493b-96cc-f04d9580652d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '5958cf5e-34fc-4d25-a43e-a6a1c2ee56a2', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'weZcSxGo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7095c1e6-3825-47d2-8b63-5755fab42b49', 'attached_at': '', 'detached_at': '', 'volume_id': 'b1752f0e-7e98-4f66-8c11-e5bb3410c207', 'serial': 'b1752f0e-7e98-4f66-8c11-e5bb3410c207'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:41:03 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:41:03 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:41:03 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'weZcSxGo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:41:03 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:41:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:41:03 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:41:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:41:03 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:41:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30f2481-65a4-4b68-a76e-5a1c1a490e78]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:41:03 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c64786f-09de-4486-9053-cc26e47317bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207] added
Aug 26 08:41:03 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[705d53bc-1209-4db6-82be-d98bcaeb663c]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbfaee6-daf8-4563-85bd-0b350ad9f326]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v weZcSxGo {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v weZcSxGo" returned: 0 in 0.036s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba852e91-71aa-4cc1-8c83-8807ccbb6ba3]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'weZcSxGo'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68b7d0b-817d-4a04-aac5-bd639ff84237]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c99eb5-2b14-4372-9d0c-d2c4b1c86014]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:41:04 user nova-compute[73104]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)
Aug 26 08:41:04 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:41:04 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:41:04 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:41:04 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:41:04 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:41:04 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:41:04 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:41:04 user nova-compute[73104]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)
Aug 26 08:41:04 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:41:04 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:41:04 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:41:04 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:41:04 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:41:04 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:41:04 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --login" returned: 0 in 0.114s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c68167-8916-4652-bc42-59ceb873ea62]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207, portal: 172.16.0.220,3260]
Aug 26 08:41:04 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207, portal: 172.16.0.220,3260] successful.
Aug 26 08:41:04 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[98794499-49ca-47bc-ab13-c32b939a2142]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55ca5b0-0b32-4f8b-a806-dbad4b3783f5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:41:04 user nova-compute[73104]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)
Aug 26 08:41:04 user nova-compute[73104]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:41:04 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:41:04 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:41:04 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:41:04 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:41:04 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:41:04 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:41:04 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:41:04 user nova-compute[73104]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)
Aug 26 08:41:04 user nova-compute[73104]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:41:04 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:41:04 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:41:04 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:41:04 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:41:04 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:41:04 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:41:04 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.441s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] HCTL ('41', '-', '-', 0) found on session 14 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.030s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[abccb509-162e-43f4-9d9a-e0eea291adf7]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Searching for a device in session 14 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:41:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'weZcSxGo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:41:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:05 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.502s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:41:05 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] <== connect_volume: return (1504ms) {'type': 'block', 'scsi_wwn': '26239623866353131', 'path': '/dev/sdj'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:41:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239623866353131', 'path': '/dev/sdj'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:41:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:40:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-485571378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-485571378',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQRWVfsHBZ4hwdnYVLV5KlTz2Udh43BAhKR/jPOsxlxB/zEqEPc/lSYHzxwVfxX1lYbHxyjeV2oVVw1oFmsH/PJOpMAeQtZFJzj3QYTjDVApGkX3vb+qjI9Jl0kVdHhdQ==',key_name='tempest-keypair-247954255',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0807a5c94bea4801bd80bbcdef223a57',ramdisk_id='',reservation_id='r-0gki1p05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1626526271',owner_user_name='tempest-ServerActionsV293TestJSON-1626526271-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:40:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc49fb86f3ad4cc0930f0048701225d5',uuid=7095c1e6-3825-47d2-8b63-5755fab42b49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85d806c2-eef6-493b-96cc-f04d9580652d", "address": "fa:16:3e:6e:38:0c", "network": {"id": "ef7a15d0-8aa7-47da-948d-c0f35a723f6f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-316051521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0807a5c94bea4801bd80bbcdef223a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d806c2-ee", "ovs_interfaceid": "85d806c2-eef6-493b-96cc-f04d9580652d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:41:05 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Converting VIF {"id": "85d806c2-eef6-493b-96cc-f04d9580652d", "address": "fa:16:3e:6e:38:0c", "network": {"id": "ef7a15d0-8aa7-47da-948d-c0f35a723f6f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-316051521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0807a5c94bea4801bd80bbcdef223a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d806c2-ee", "ovs_interfaceid": "85d806c2-eef6-493b-96cc-f04d9580652d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:41:05 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:38:0c,bridge_name='br-int',has_traffic_filtering=True,id=85d806c2-eef6-493b-96cc-f04d9580652d,network=Network(ef7a15d0-8aa7-47da-948d-c0f35a723f6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85d806c2-ee') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:41:05 user nova-compute[73104]: DEBUG nova.objects.instance [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lazy-loading 'pci_devices' on Instance uuid 7095c1e6-3825-47d2-8b63-5755fab42b49 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:41:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:41:05 user nova-compute[73104]:   <uuid>7095c1e6-3825-47d2-8b63-5755fab42b49</uuid>
Aug 26 08:41:05 user nova-compute[73104]:   <name>instance-0000000e</name>
Aug 26 08:41:05 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:41:05 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:41:05 user nova-compute[73104]:   <metadata>
Aug 26 08:41:05 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:41:05 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:41:05 user nova-compute[73104]:       <nova:name>tempest-ServerActionsV293TestJSON-server-485571378</nova:name>
Aug 26 08:41:05 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:41:03</nova:creationTime>
Aug 26 08:41:05 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:41:05 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:41:05 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:41:05 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:41:05 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:41:05 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:41:05 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:41:05 user nova-compute[73104]:       <nova:owner>
Aug 26 08:41:05 user nova-compute[73104]:         <nova:user uuid="cc49fb86f3ad4cc0930f0048701225d5">tempest-ServerActionsV293TestJSON-1626526271-project-member</nova:user>
Aug 26 08:41:05 user nova-compute[73104]:         <nova:project uuid="0807a5c94bea4801bd80bbcdef223a57">tempest-ServerActionsV293TestJSON-1626526271</nova:project>
Aug 26 08:41:05 user nova-compute[73104]:       </nova:owner>
Aug 26 08:41:05 user nova-compute[73104]:       <nova:ports>
Aug 26 08:41:05 user nova-compute[73104]:         <nova:port uuid="85d806c2-eef6-493b-96cc-f04d9580652d">
Aug 26 08:41:05 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 08:41:05 user nova-compute[73104]:         </nova:port>
Aug 26 08:41:05 user nova-compute[73104]:       </nova:ports>
Aug 26 08:41:05 user nova-compute[73104]:     </nova:instance>
Aug 26 08:41:05 user nova-compute[73104]:   </metadata>
Aug 26 08:41:05 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:41:05 user nova-compute[73104]:     <system>
Aug 26 08:41:05 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:41:05 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:41:05 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:41:05 user nova-compute[73104]:       <entry name="serial">7095c1e6-3825-47d2-8b63-5755fab42b49</entry>
Aug 26 08:41:05 user nova-compute[73104]:       <entry name="uuid">7095c1e6-3825-47d2-8b63-5755fab42b49</entry>
Aug 26 08:41:05 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:41:05 user nova-compute[73104]:     </system>
Aug 26 08:41:05 user nova-compute[73104]:   </sysinfo>
Aug 26 08:41:05 user nova-compute[73104]:   <os>
Aug 26 08:41:05 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:41:05 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:41:05 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:41:05 user nova-compute[73104]:   </os>
Aug 26 08:41:05 user nova-compute[73104]:   <features>
Aug 26 08:41:05 user nova-compute[73104]:     <acpi/>
Aug 26 08:41:05 user nova-compute[73104]:     <apic/>
Aug 26 08:41:05 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:41:05 user nova-compute[73104]:   </features>
Aug 26 08:41:05 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:41:05 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:41:05 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:41:05 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:41:05 user nova-compute[73104]:   </clock>
Aug 26 08:41:05 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:41:05 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:41:05 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:41:05 user nova-compute[73104]:   </cpu>
Aug 26 08:41:05 user nova-compute[73104]:   <devices>
Aug 26 08:41:05 user nova-compute[73104]:     <disk type="block" device="disk">
Aug 26 08:41:05 user nova-compute[73104]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:41:05 user nova-compute[73104]:       <source dev="/dev/sdj"/>
Aug 26 08:41:05 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:41:05 user nova-compute[73104]:       <serial>b1752f0e-7e98-4f66-8c11-e5bb3410c207</serial>
Aug 26 08:41:05 user nova-compute[73104]:     </disk>
Aug 26 08:41:05 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:41:05 user nova-compute[73104]:       <mac address="fa:16:3e:6e:38:0c"/>
Aug 26 08:41:05 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:41:05 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:41:05 user nova-compute[73104]:       <target dev="tap85d806c2-ee"/>
Aug 26 08:41:05 user nova-compute[73104]:     </interface>
Aug 26 08:41:05 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:41:05 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/7095c1e6-3825-47d2-8b63-5755fab42b49/console.log" append="off"/>
Aug 26 08:41:05 user nova-compute[73104]:     </serial>
Aug 26 08:41:05 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:41:05 user nova-compute[73104]:     <video>
Aug 26 08:41:05 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:41:05 user nova-compute[73104]:     </video>
Aug 26 08:41:05 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:41:05 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:41:05 user nova-compute[73104]:     </rng>
Aug 26 08:41:05 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:41:05 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:41:05 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:41:05 user nova-compute[73104]:     </memballoon>
Aug 26 08:41:05 user nova-compute[73104]:   </devices>
Aug 26 08:41:05 user nova-compute[73104]: </domain>
Aug 26 08:41:05 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:41:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:40:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-485571378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-485571378',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQRWVfsHBZ4hwdnYVLV5KlTz2Udh43BAhKR/jPOsxlxB/zEqEPc/lSYHzxwVfxX1lYbHxyjeV2oVVw1oFmsH/PJOpMAeQtZFJzj3QYTjDVApGkX3vb+qjI9Jl0kVdHhdQ==',key_name='tempest-keypair-247954255',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0807a5c94bea4801bd80bbcdef223a57',ramdisk_id='',reservation_id='r-0gki1p05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1626526271',owner_user_name='tempest-ServerActionsV293TestJSON-1626526271-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:40:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc49fb86f3ad4cc0930f0048701225d5',uuid=7095c1e6-3825-47d2-8b63-5755fab42b49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85d806c2-eef6-493b-96cc-f04d9580652d", "address": "fa:16:3e:6e:38:0c", "network": {"id": "ef7a15d0-8aa7-47da-948d-c0f35a723f6f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-316051521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0807a5c94bea4801bd80bbcdef223a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d806c2-ee", "ovs_interfaceid": "85d806c2-eef6-493b-96cc-f04d9580652d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:41:05 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Converting VIF {"id": "85d806c2-eef6-493b-96cc-f04d9580652d", "address": "fa:16:3e:6e:38:0c", "network": {"id": "ef7a15d0-8aa7-47da-948d-c0f35a723f6f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-316051521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0807a5c94bea4801bd80bbcdef223a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d806c2-ee", "ovs_interfaceid": "85d806c2-eef6-493b-96cc-f04d9580652d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:41:05 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:38:0c,bridge_name='br-int',has_traffic_filtering=True,id=85d806c2-eef6-493b-96cc-f04d9580652d,network=Network(ef7a15d0-8aa7-47da-948d-c0f35a723f6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85d806c2-ee') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:41:05 user nova-compute[73104]: DEBUG os_vif [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:38:0c,bridge_name='br-int',has_traffic_filtering=True,id=85d806c2-eef6-493b-96cc-f04d9580652d,network=Network(ef7a15d0-8aa7-47da-948d-c0f35a723f6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85d806c2-ee') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:41:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:41:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:41:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85d806c2-ee, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:41:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap85d806c2-ee, col_values=(('external_ids', {'iface-id': '85d806c2-eef6-493b-96cc-f04d9580652d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:38:0c', 'vm-uuid': '7095c1e6-3825-47d2-8b63-5755fab42b49'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:41:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:41:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:05 user nova-compute[73104]: INFO os_vif [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:38:0c,bridge_name='br-int',has_traffic_filtering=True,id=85d806c2-eef6-493b-96cc-f04d9580652d,network=Network(ef7a15d0-8aa7-47da-948d-c0f35a723f6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85d806c2-ee')
Aug 26 08:41:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:41:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] No VIF found with MAC fa:16:3e:6e:38:0c, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:41:06 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693039251.4081924, b04e96c7-f098-4612-b0b8-92cf6fd58865 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:41:06 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] VM Stopped (Lifecycle Event)
Aug 26 08:41:06 user nova-compute[73104]: DEBUG nova.compute.manager [None req-f13e45b6-ad28-4b3c-92b0-d51a06ef88a9 None None] [instance: b04e96c7-f098-4612-b0b8-92cf6fd58865] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:41:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG nova.compute.manager [req-0d2f7644-7e72-4781-8203-77ffefdcf432 req-082e843d-df18-4982-9b45-a594bb23d1e5 service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Received event network-vif-plugged-85d806c2-eef6-493b-96cc-f04d9580652d {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0d2f7644-7e72-4781-8203-77ffefdcf432 req-082e843d-df18-4982-9b45-a594bb23d1e5 service nova] Acquiring lock "7095c1e6-3825-47d2-8b63-5755fab42b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0d2f7644-7e72-4781-8203-77ffefdcf432 req-082e843d-df18-4982-9b45-a594bb23d1e5 service nova] Lock "7095c1e6-3825-47d2-8b63-5755fab42b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0d2f7644-7e72-4781-8203-77ffefdcf432 req-082e843d-df18-4982-9b45-a594bb23d1e5 service nova] Lock "7095c1e6-3825-47d2-8b63-5755fab42b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG nova.compute.manager [req-0d2f7644-7e72-4781-8203-77ffefdcf432 req-082e843d-df18-4982-9b45-a594bb23d1e5 service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] No waiting events found dispatching network-vif-plugged-85d806c2-eef6-493b-96cc-f04d9580652d {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:07 user nova-compute[73104]: WARNING nova.compute.manager [req-0d2f7644-7e72-4781-8203-77ffefdcf432 req-082e843d-df18-4982-9b45-a594bb23d1e5 service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Received unexpected event network-vif-plugged-85d806c2-eef6-493b-96cc-f04d9580652d for instance with vm_state building and task_state spawning.
Aug 26 08:41:07 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEOqgAiB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:41:07 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:41:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:41:07 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:41:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:41:07 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:41:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8cd414-9e2f-4431-8da7-986f9f244683]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:41:07 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[783d0712-4619-49fa-917d-0cb314c04682]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44] added
Aug 26 08:41:07 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba673af5-afd7-4fb0-bcaf-d12dc3afe610]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[152139f4-12fc-4dcd-ad1f-23ac24f93b5d]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rEOqgAiB {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rEOqgAiB" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe268b9-88b3-4df8-8730-09700734fae2]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rEOqgAiB'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72c573a-0fa0-4e75-bd58-5a8d5acc4b01]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50123ac-7ce9-4db1-8f2c-80974a0323c4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:41:07 user nova-compute[73104]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)
Aug 26 08:41:07 user nova-compute[73104]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:41:07 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:41:07 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:41:07 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:41:07 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:41:07 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:41:07 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:41:07 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:41:07 user nova-compute[73104]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)
Aug 26 08:41:07 user nova-compute[73104]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:41:07 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:41:07 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:41:07 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:41:07 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:41:07 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:41:07 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:41:07 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --login" returned: 0 in 0.103s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f77c5a-bf7f-41c6-96a9-a05097d5063d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44, portal: 172.16.0.220,3260]
Aug 26 08:41:07 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44, portal: 172.16.0.220,3260] successful.
Aug 26 08:41:07 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[815ff6eb-c216-411e-82bd-4cbc65fa43fd]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b1d056-2211-4f27-a941-8b7b1a3800bc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:41:08 user nova-compute[73104]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)
Aug 26 08:41:08 user nova-compute[73104]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:41:08 user nova-compute[73104]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:41:08 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:41:08 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:41:08 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:41:08 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:41:08 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:41:08 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:41:08 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:41:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:41:08 user nova-compute[73104]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)
Aug 26 08:41:08 user nova-compute[73104]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:41:08 user nova-compute[73104]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:41:08 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:41:08 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:41:08 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:41:08 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:41:08 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:41:08 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:41:08 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:41:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.410s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:41:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:41:08 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] HCTL ('42', '-', '-', 0) found on session 15 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:41:08 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:41:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[65404195-b344-47de-9118-83806361ced4]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:08 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Searching for a device in session 15 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:41:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEOqgAiB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:41:08 user nova-compute[73104]: DEBUG nova.compute.manager [req-f5bb69ff-5858-46a9-886c-37082e82d1ad req-9c6bfff9-0868-477b-9508-0ff37b36b752 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-changed-949f6e6c-727e-440c-b767-caf76f3f037e {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:08 user nova-compute[73104]: DEBUG nova.compute.manager [req-f5bb69ff-5858-46a9-886c-37082e82d1ad req-9c6bfff9-0868-477b-9508-0ff37b36b752 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Refreshing instance network info cache due to event network-changed-949f6e6c-727e-440c-b767-caf76f3f037e. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:41:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f5bb69ff-5858-46a9-886c-37082e82d1ad req-9c6bfff9-0868-477b-9508-0ff37b36b752 service nova] Acquiring lock "refresh_cache-e2ec2788-98c7-48a7-933a-433dc215d7ec" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:41:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f5bb69ff-5858-46a9-886c-37082e82d1ad req-9c6bfff9-0868-477b-9508-0ff37b36b752 service nova] Acquired lock "refresh_cache-e2ec2788-98c7-48a7-933a-433dc215d7ec" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:41:08 user nova-compute[73104]: DEBUG nova.network.neutron [req-f5bb69ff-5858-46a9-886c-37082e82d1ad req-9c6bfff9-0868-477b-9508-0ff37b36b752 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Refreshing network info cache for port 949f6e6c-727e-440c-b767-caf76f3f037e {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:41:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.465s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:41:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] <== connect_volume: return (1468ms) {'type': 'block', 'scsi_wwn': '23736613164313738', 'path': '/dev/sdk'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:41:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736613164313738', 'path': '/dev/sdk'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:41:09 user nova-compute[73104]: DEBUG nova.objects.instance [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lazy-loading 'flavor' on Instance uuid 385c6d93-907d-42d7-9b43-479e6caf66f9 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:41:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 08:41:09 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:41:09 user nova-compute[73104]:   <source dev="/dev/sdk"/>
Aug 26 08:41:09 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:41:09 user nova-compute[73104]:   <serial>c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44</serial>
Aug 26 08:41:09 user nova-compute[73104]: </disk>
Aug 26 08:41:09 user nova-compute[73104]:  {{(pid=73104) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 08:41:09 user nova-compute[73104]: DEBUG nova.compute.manager [req-881f4db4-ccce-43c6-8be9-8af2bc0b4ac3 req-ffed7862-c786-4456-8100-407e632ecdda service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Received event network-vif-plugged-85d806c2-eef6-493b-96cc-f04d9580652d {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-881f4db4-ccce-43c6-8be9-8af2bc0b4ac3 req-ffed7862-c786-4456-8100-407e632ecdda service nova] Acquiring lock "7095c1e6-3825-47d2-8b63-5755fab42b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-881f4db4-ccce-43c6-8be9-8af2bc0b4ac3 req-ffed7862-c786-4456-8100-407e632ecdda service nova] Lock "7095c1e6-3825-47d2-8b63-5755fab42b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-881f4db4-ccce-43c6-8be9-8af2bc0b4ac3 req-ffed7862-c786-4456-8100-407e632ecdda service nova] Lock "7095c1e6-3825-47d2-8b63-5755fab42b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:09 user nova-compute[73104]: DEBUG nova.compute.manager [req-881f4db4-ccce-43c6-8be9-8af2bc0b4ac3 req-ffed7862-c786-4456-8100-407e632ecdda service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] No waiting events found dispatching network-vif-plugged-85d806c2-eef6-493b-96cc-f04d9580652d {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:09 user nova-compute[73104]: WARNING nova.compute.manager [req-881f4db4-ccce-43c6-8be9-8af2bc0b4ac3 req-ffed7862-c786-4456-8100-407e632ecdda service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Received unexpected event network-vif-plugged-85d806c2-eef6-493b-96cc-f04d9580652d for instance with vm_state building and task_state spawning.
Aug 26 08:41:09 user nova-compute[73104]: DEBUG nova.compute.manager [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:41:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:41:09 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039269.5771954, 7095c1e6-3825-47d2-8b63-5755fab42b49 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:41:09 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] VM Resumed (Lifecycle Event)
Aug 26 08:41:09 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Instance spawned successfully.
Aug 26 08:41:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:41:09 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:41:09 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:41:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:41:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:41:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:41:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:41:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:41:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:41:09 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:41:09 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039269.5783165, 7095c1e6-3825-47d2-8b63-5755fab42b49 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:41:09 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] VM Started (Lifecycle Event)
Aug 26 08:41:09 user nova-compute[73104]: DEBUG nova.network.neutron [req-f5bb69ff-5858-46a9-886c-37082e82d1ad req-9c6bfff9-0868-477b-9508-0ff37b36b752 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Updated VIF entry in instance network info cache for port 949f6e6c-727e-440c-b767-caf76f3f037e. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:41:09 user nova-compute[73104]: DEBUG nova.network.neutron [req-f5bb69ff-5858-46a9-886c-37082e82d1ad req-9c6bfff9-0868-477b-9508-0ff37b36b752 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Updating instance_info_cache with network_info: [{"id": "949f6e6c-727e-440c-b767-caf76f3f037e", "address": "fa:16:3e:a4:00:26", "network": {"id": "0941b2d8-176a-403b-a9bf-4a4d0de5bcc0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-890813398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap949f6e6c-72", "ovs_interfaceid": "949f6e6c-727e-440c-b767-caf76f3f037e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d7cb8b02-8579-43e0-b058-2cbe69bf0edf", "address": "fa:16:3e:72:2b:2a", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cb8b02-85", "ovs_interfaceid": "d7cb8b02-8579-43e0-b058-2cbe69bf0edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "55fb8a61-3cfe-422c-af91-ca5199362cc7", "address": "fa:16:3e:04:77:77", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fb8a61-3c", "ovs_interfaceid": "55fb8a61-3cfe-422c-af91-ca5199362cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2bb400c7-1a44-427c-a38e-860f71f92d31", "address": "fa:16:3e:33:83:63", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb400c7-1a", "ovs_interfaceid": "2bb400c7-1a44-427c-a38e-860f71f92d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0cf8f75c-539b-44d0-bc4a-a52f86a24d9c", "address": "fa:16:3e:50:f5:ca", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf8f75c-53", "ovs_interfaceid": "0cf8f75c-539b-44d0-bc4a-a52f86a24d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "971207c4-aee3-47f6-8fb4-ad7d7fc2827e", "address": "fa:16:3e:13:5e:a9", "network": {"id": "b98d43ff-51d0-4328-be34-b7c110358c95", "bridge": "br-int", "label": "tempest-device-tagging-net2-545564459", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap971207c4-ae", "ovs_interfaceid": "971207c4-aee3-47f6-8fb4-ad7d7fc2827e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1de67e88-3745-4d54-9b30-17d82513265f", "address": "fa:16:3e:b3:77:f4", "network": {"id": "b98d43ff-51d0-4328-be34-b7c110358c95", "bridge": "br-int", "label": "tempest-device-tagging-net2-545564459", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de67e88-37", "ovs_interfaceid": "1de67e88-3745-4d54-9b30-17d82513265f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:41:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:41:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:41:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] No VIF found with MAC fa:16:3e:b9:37:34, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:41:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f5bb69ff-5858-46a9-886c-37082e82d1ad req-9c6bfff9-0868-477b-9508-0ff37b36b752 service nova] Releasing lock "refresh_cache-e2ec2788-98c7-48a7-933a-433dc215d7ec" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:41:09 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:41:09 user nova-compute[73104]: INFO nova.compute.manager [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Took 5.95 seconds to spawn the instance on the hypervisor.
Aug 26 08:41:09 user nova-compute[73104]: DEBUG nova.compute.manager [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:41:09 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:41:09 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:41:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a448cb4f-6e40-4e61-8c5b-5bc053d401f2 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.775s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:09 user nova-compute[73104]: INFO nova.compute.manager [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Took 36.08 seconds to build instance.
Aug 26 08:41:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b853e2ad-3423-4e35-bc93-b4cadd905133 tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lock "7095c1e6-3825-47d2-8b63-5755fab42b49" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.201s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Acquiring lock "e2ec2788-98c7-48a7-933a-433dc215d7ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Acquiring lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:11 user nova-compute[73104]: INFO nova.compute.manager [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Terminating instance
Aug 26 08:41:11 user nova-compute[73104]: DEBUG nova.compute.manager [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 08:41:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:12 user nova-compute[73104]: DEBUG nova.compute.manager [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Stashing vm_state: active {{(pid=73104) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 26 08:41:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:12 user nova-compute[73104]: DEBUG nova.compute.manager [req-e49e66c7-7fe2-4816-81a6-e6859a5600ca req-c2f7f2ac-c29c-4c06-8a62-24343f6591f7 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-unplugged-d7cb8b02-8579-43e0-b058-2cbe69bf0edf {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e49e66c7-7fe2-4816-81a6-e6859a5600ca req-c2f7f2ac-c29c-4c06-8a62-24343f6591f7 service nova] Acquiring lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e49e66c7-7fe2-4816-81a6-e6859a5600ca req-c2f7f2ac-c29c-4c06-8a62-24343f6591f7 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e49e66c7-7fe2-4816-81a6-e6859a5600ca req-c2f7f2ac-c29c-4c06-8a62-24343f6591f7 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:12 user nova-compute[73104]: DEBUG nova.compute.manager [req-e49e66c7-7fe2-4816-81a6-e6859a5600ca req-c2f7f2ac-c29c-4c06-8a62-24343f6591f7 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] No waiting events found dispatching network-vif-unplugged-d7cb8b02-8579-43e0-b058-2cbe69bf0edf {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:12 user nova-compute[73104]: DEBUG nova.compute.manager [req-e49e66c7-7fe2-4816-81a6-e6859a5600ca req-c2f7f2ac-c29c-4c06-8a62-24343f6591f7 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-unplugged-d7cb8b02-8579-43e0-b058-2cbe69bf0edf for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:41:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:12 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:41:12 user nova-compute[73104]: INFO nova.compute.claims [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Claim successful on node user
Aug 26 08:41:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:12 user nova-compute[73104]: INFO nova.compute.resource_tracker [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Updating resource usage from migration 34377794-1383-41db-ab9f-219dc1867bba
Aug 26 08:41:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG nova.compute.manager [req-cbe5e168-0514-47f6-875e-af75e4e8517a req-9f473633-e844-4a25-adb3-b824259eb764 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-unplugged-949f6e6c-727e-440c-b767-caf76f3f037e {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-cbe5e168-0514-47f6-875e-af75e4e8517a req-9f473633-e844-4a25-adb3-b824259eb764 service nova] Acquiring lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-cbe5e168-0514-47f6-875e-af75e4e8517a req-9f473633-e844-4a25-adb3-b824259eb764 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-cbe5e168-0514-47f6-875e-af75e4e8517a req-9f473633-e844-4a25-adb3-b824259eb764 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG nova.compute.manager [req-cbe5e168-0514-47f6-875e-af75e4e8517a req-9f473633-e844-4a25-adb3-b824259eb764 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] No waiting events found dispatching network-vif-unplugged-949f6e6c-727e-440c-b767-caf76f3f037e {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG nova.compute.manager [req-cbe5e168-0514-47f6-875e-af75e4e8517a req-9f473633-e844-4a25-adb3-b824259eb764 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-unplugged-949f6e6c-727e-440c-b767-caf76f3f037e for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 1.012s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:13 user nova-compute[73104]: INFO nova.compute.manager [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Migrating
Aug 26 08:41:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:41:13 user nova-compute[73104]: INFO nova.compute.rpcapi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 26 08:41:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:41:13 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Instance destroyed successfully.
Aug 26 08:41:13 user nova-compute[73104]: DEBUG nova.objects.instance [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Lazy-loading 'resources' on Instance uuid e2ec2788-98c7-48a7-933a-433dc215d7ec {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-147720369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-147720369',id=10,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE7N2igt88eWl9+0O3rw7Gr2O3Pf0Clh8aTrKtwxprjLw0oRrQ/YFniZCOny/ulFQwuklyMiP7yX5Gvlz/Qexsg2T/RwJg01QU3Il1Vw2dkTm55TZbc2b3skf3PilOX5A==',key_name='tempest-keypair-1800903172',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:39:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac7989e8c5da415a9ccf66845b0d831c',ramdisk_id='',reservation_id='r-bjzqt5n9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2021222373',owner_user_name='tempest-TaggedBootDevicesTest-2021222373-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a68183c66ce484aa46ec2a4d897dac8',uuid=e2ec2788-98c7-48a7-933a-433dc215d7ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "949f6e6c-727e-440c-b767-caf76f3f037e", "address": "fa:16:3e:a4:00:26", "network": {"id": "0941b2d8-176a-403b-a9bf-4a4d0de5bcc0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-890813398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap949f6e6c-72", "ovs_interfaceid": "949f6e6c-727e-440c-b767-caf76f3f037e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converting VIF {"id": "949f6e6c-727e-440c-b767-caf76f3f037e", "address": "fa:16:3e:a4:00:26", "network": {"id": "0941b2d8-176a-403b-a9bf-4a4d0de5bcc0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-890813398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap949f6e6c-72", "ovs_interfaceid": "949f6e6c-727e-440c-b767-caf76f3f037e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:00:26,bridge_name='br-int',has_traffic_filtering=True,id=949f6e6c-727e-440c-b767-caf76f3f037e,network=Network(0941b2d8-176a-403b-a9bf-4a4d0de5bcc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap949f6e6c-72') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG os_vif [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:00:26,bridge_name='br-int',has_traffic_filtering=True,id=949f6e6c-727e-440c-b767-caf76f3f037e,network=Network(0941b2d8-176a-403b-a9bf-4a4d0de5bcc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap949f6e6c-72') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap949f6e6c-72, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquiring lock "refresh_cache-385c6d93-907d-42d7-9b43-479e6caf66f9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquired lock "refresh_cache-385c6d93-907d-42d7-9b43-479e6caf66f9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG nova.network.neutron [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:13 user nova-compute[73104]: INFO os_vif [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:00:26,bridge_name='br-int',has_traffic_filtering=True,id=949f6e6c-727e-440c-b767-caf76f3f037e,network=Network(0941b2d8-176a-403b-a9bf-4a4d0de5bcc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap949f6e6c-72')
Aug 26 08:41:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-147720369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-147720369',id=10,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE7N2igt88eWl9+0O3rw7Gr2O3Pf0Clh8aTrKtwxprjLw0oRrQ/YFniZCOny/ulFQwuklyMiP7yX5Gvlz/Qexsg2T/RwJg01QU3Il1Vw2dkTm55TZbc2b3skf3PilOX5A==',key_name='tempest-keypair-1800903172',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:39:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac7989e8c5da415a9ccf66845b0d831c',ramdisk_id='',reservation_id='r-bjzqt5n9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2021222373',owner_user_name='tempest-TaggedBootDevicesTest-2021222373-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a68183c66ce484aa46ec2a4d897dac8',uuid=e2ec2788-98c7-48a7-933a-433dc215d7ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7cb8b02-8579-43e0-b058-2cbe69bf0edf", "address": "fa:16:3e:72:2b:2a", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cb8b02-85", "ovs_interfaceid": "d7cb8b02-8579-43e0-b058-2cbe69bf0edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converting VIF {"id": "d7cb8b02-8579-43e0-b058-2cbe69bf0edf", "address": "fa:16:3e:72:2b:2a", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cb8b02-85", "ovs_interfaceid": "d7cb8b02-8579-43e0-b058-2cbe69bf0edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:2b:2a,bridge_name='br-int',has_traffic_filtering=True,id=d7cb8b02-8579-43e0-b058-2cbe69bf0edf,network=Network(8af7a9e2-545f-4a40-9479-22ad7dabf51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd7cb8b02-85') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG os_vif [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:2b:2a,bridge_name='br-int',has_traffic_filtering=True,id=d7cb8b02-8579-43e0-b058-2cbe69bf0edf,network=Network(8af7a9e2-545f-4a40-9479-22ad7dabf51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd7cb8b02-85') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7cb8b02-85, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:13 user nova-compute[73104]: INFO os_vif [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:2b:2a,bridge_name='br-int',has_traffic_filtering=True,id=d7cb8b02-8579-43e0-b058-2cbe69bf0edf,network=Network(8af7a9e2-545f-4a40-9479-22ad7dabf51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd7cb8b02-85')
Aug 26 08:41:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-147720369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-147720369',id=10,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE7N2igt88eWl9+0O3rw7Gr2O3Pf0Clh8aTrKtwxprjLw0oRrQ/YFniZCOny/ulFQwuklyMiP7yX5Gvlz/Qexsg2T/RwJg01QU3Il1Vw2dkTm55TZbc2b3skf3PilOX5A==',key_name='tempest-keypair-1800903172',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:39:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac7989e8c5da415a9ccf66845b0d831c',ramdisk_id='',reservation_id='r-bjzqt5n9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2021222373',owner_user_name='tempest-TaggedBootDevicesTest-2021222373-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a68183c66ce484aa46ec2a4d897dac8',uuid=e2ec2788-98c7-48a7-933a-433dc215d7ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55fb8a61-3cfe-422c-af91-ca5199362cc7", "address": "fa:16:3e:04:77:77", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fb8a61-3c", "ovs_interfaceid": "55fb8a61-3cfe-422c-af91-ca5199362cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converting VIF {"id": "55fb8a61-3cfe-422c-af91-ca5199362cc7", "address": "fa:16:3e:04:77:77", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fb8a61-3c", "ovs_interfaceid": "55fb8a61-3cfe-422c-af91-ca5199362cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:77:77,bridge_name='br-int',has_traffic_filtering=True,id=55fb8a61-3cfe-422c-af91-ca5199362cc7,network=Network(8af7a9e2-545f-4a40-9479-22ad7dabf51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap55fb8a61-3c') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG os_vif [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:77:77,bridge_name='br-int',has_traffic_filtering=True,id=55fb8a61-3cfe-422c-af91-ca5199362cc7,network=Network(8af7a9e2-545f-4a40-9479-22ad7dabf51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap55fb8a61-3c') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55fb8a61-3c, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:13 user nova-compute[73104]: INFO os_vif [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:77:77,bridge_name='br-int',has_traffic_filtering=True,id=55fb8a61-3cfe-422c-af91-ca5199362cc7,network=Network(8af7a9e2-545f-4a40-9479-22ad7dabf51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap55fb8a61-3c')
Aug 26 08:41:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-147720369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-147720369',id=10,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE7N2igt88eWl9+0O3rw7Gr2O3Pf0Clh8aTrKtwxprjLw0oRrQ/YFniZCOny/ulFQwuklyMiP7yX5Gvlz/Qexsg2T/RwJg01QU3Il1Vw2dkTm55TZbc2b3skf3PilOX5A==',key_name='tempest-keypair-1800903172',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:39:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac7989e8c5da415a9ccf66845b0d831c',ramdisk_id='',reservation_id='r-bjzqt5n9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2021222373',owner_user_name='tempest-TaggedBootDevicesTest-2021222373-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a68183c66ce484aa46ec2a4d897dac8',uuid=e2ec2788-98c7-48a7-933a-433dc215d7ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2bb400c7-1a44-427c-a38e-860f71f92d31", "address": "fa:16:3e:33:83:63", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb400c7-1a", "ovs_interfaceid": "2bb400c7-1a44-427c-a38e-860f71f92d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converting VIF {"id": "2bb400c7-1a44-427c-a38e-860f71f92d31", "address": "fa:16:3e:33:83:63", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb400c7-1a", "ovs_interfaceid": "2bb400c7-1a44-427c-a38e-860f71f92d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:83:63,bridge_name='br-int',has_traffic_filtering=True,id=2bb400c7-1a44-427c-a38e-860f71f92d31,network=Network(8af7a9e2-545f-4a40-9479-22ad7dabf51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb400c7-1a') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG os_vif [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:83:63,bridge_name='br-int',has_traffic_filtering=True,id=2bb400c7-1a44-427c-a38e-860f71f92d31,network=Network(8af7a9e2-545f-4a40-9479-22ad7dabf51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb400c7-1a') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2bb400c7-1a, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:14 user nova-compute[73104]: INFO os_vif [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:83:63,bridge_name='br-int',has_traffic_filtering=True,id=2bb400c7-1a44-427c-a38e-860f71f92d31,network=Network(8af7a9e2-545f-4a40-9479-22ad7dabf51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb400c7-1a')
Aug 26 08:41:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-147720369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-147720369',id=10,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE7N2igt88eWl9+0O3rw7Gr2O3Pf0Clh8aTrKtwxprjLw0oRrQ/YFniZCOny/ulFQwuklyMiP7yX5Gvlz/Qexsg2T/RwJg01QU3Il1Vw2dkTm55TZbc2b3skf3PilOX5A==',key_name='tempest-keypair-1800903172',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:39:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac7989e8c5da415a9ccf66845b0d831c',ramdisk_id='',reservation_id='r-bjzqt5n9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2021222373',owner_user_name='tempest-TaggedBootDevicesTest-2021222373-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a68183c66ce484aa46ec2a4d897dac8',uuid=e2ec2788-98c7-48a7-933a-433dc215d7ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0cf8f75c-539b-44d0-bc4a-a52f86a24d9c", "address": "fa:16:3e:50:f5:ca", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf8f75c-53", "ovs_interfaceid": "0cf8f75c-539b-44d0-bc4a-a52f86a24d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converting VIF {"id": "0cf8f75c-539b-44d0-bc4a-a52f86a24d9c", "address": "fa:16:3e:50:f5:ca", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf8f75c-53", "ovs_interfaceid": "0cf8f75c-539b-44d0-bc4a-a52f86a24d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:f5:ca,bridge_name='br-int',has_traffic_filtering=True,id=0cf8f75c-539b-44d0-bc4a-a52f86a24d9c,network=Network(8af7a9e2-545f-4a40-9479-22ad7dabf51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cf8f75c-53') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_vif [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:f5:ca,bridge_name='br-int',has_traffic_filtering=True,id=0cf8f75c-539b-44d0-bc4a-a52f86a24d9c,network=Network(8af7a9e2-545f-4a40-9479-22ad7dabf51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cf8f75c-53') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0cf8f75c-53, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:14 user nova-compute[73104]: INFO os_vif [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:f5:ca,bridge_name='br-int',has_traffic_filtering=True,id=0cf8f75c-539b-44d0-bc4a-a52f86a24d9c,network=Network(8af7a9e2-545f-4a40-9479-22ad7dabf51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cf8f75c-53')
Aug 26 08:41:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-147720369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-147720369',id=10,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE7N2igt88eWl9+0O3rw7Gr2O3Pf0Clh8aTrKtwxprjLw0oRrQ/YFniZCOny/ulFQwuklyMiP7yX5Gvlz/Qexsg2T/RwJg01QU3Il1Vw2dkTm55TZbc2b3skf3PilOX5A==',key_name='tempest-keypair-1800903172',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:39:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac7989e8c5da415a9ccf66845b0d831c',ramdisk_id='',reservation_id='r-bjzqt5n9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2021222373',owner_user_name='tempest-TaggedBootDevicesTest-2021222373-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a68183c66ce484aa46ec2a4d897dac8',uuid=e2ec2788-98c7-48a7-933a-433dc215d7ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "971207c4-aee3-47f6-8fb4-ad7d7fc2827e", "address": "fa:16:3e:13:5e:a9", "network": {"id": "b98d43ff-51d0-4328-be34-b7c110358c95", "bridge": "br-int", "label": "tempest-device-tagging-net2-545564459", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap971207c4-ae", "ovs_interfaceid": "971207c4-aee3-47f6-8fb4-ad7d7fc2827e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converting VIF {"id": "971207c4-aee3-47f6-8fb4-ad7d7fc2827e", "address": "fa:16:3e:13:5e:a9", "network": {"id": "b98d43ff-51d0-4328-be34-b7c110358c95", "bridge": "br-int", "label": "tempest-device-tagging-net2-545564459", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap971207c4-ae", "ovs_interfaceid": "971207c4-aee3-47f6-8fb4-ad7d7fc2827e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:5e:a9,bridge_name='br-int',has_traffic_filtering=True,id=971207c4-aee3-47f6-8fb4-ad7d7fc2827e,network=Network(b98d43ff-51d0-4328-be34-b7c110358c95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap971207c4-ae') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_vif [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:5e:a9,bridge_name='br-int',has_traffic_filtering=True,id=971207c4-aee3-47f6-8fb4-ad7d7fc2827e,network=Network(b98d43ff-51d0-4328-be34-b7c110358c95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap971207c4-ae') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap971207c4-ae, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:14 user nova-compute[73104]: INFO os_vif [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:5e:a9,bridge_name='br-int',has_traffic_filtering=True,id=971207c4-aee3-47f6-8fb4-ad7d7fc2827e,network=Network(b98d43ff-51d0-4328-be34-b7c110358c95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap971207c4-ae')
Aug 26 08:41:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-147720369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-147720369',id=10,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE7N2igt88eWl9+0O3rw7Gr2O3Pf0Clh8aTrKtwxprjLw0oRrQ/YFniZCOny/ulFQwuklyMiP7yX5Gvlz/Qexsg2T/RwJg01QU3Il1Vw2dkTm55TZbc2b3skf3PilOX5A==',key_name='tempest-keypair-1800903172',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:39:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac7989e8c5da415a9ccf66845b0d831c',ramdisk_id='',reservation_id='r-bjzqt5n9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2021222373',owner_user_name='tempest-TaggedBootDevicesTest-2021222373-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a68183c66ce484aa46ec2a4d897dac8',uuid=e2ec2788-98c7-48a7-933a-433dc215d7ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1de67e88-3745-4d54-9b30-17d82513265f", "address": "fa:16:3e:b3:77:f4", "network": {"id": "b98d43ff-51d0-4328-be34-b7c110358c95", "bridge": "br-int", "label": "tempest-device-tagging-net2-545564459", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de67e88-37", "ovs_interfaceid": "1de67e88-3745-4d54-9b30-17d82513265f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converting VIF {"id": "1de67e88-3745-4d54-9b30-17d82513265f", "address": "fa:16:3e:b3:77:f4", "network": {"id": "b98d43ff-51d0-4328-be34-b7c110358c95", "bridge": "br-int", "label": "tempest-device-tagging-net2-545564459", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de67e88-37", "ovs_interfaceid": "1de67e88-3745-4d54-9b30-17d82513265f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:77:f4,bridge_name='br-int',has_traffic_filtering=True,id=1de67e88-3745-4d54-9b30-17d82513265f,network=Network(b98d43ff-51d0-4328-be34-b7c110358c95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1de67e88-37') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_vif [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:77:f4,bridge_name='br-int',has_traffic_filtering=True,id=1de67e88-3745-4d54-9b30-17d82513265f,network=Network(b98d43ff-51d0-4328-be34-b7c110358c95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1de67e88-37') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1de67e88-37, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:41:14 user nova-compute[73104]: INFO os_vif [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:77:f4,bridge_name='br-int',has_traffic_filtering=True,id=1de67e88-3745-4d54-9b30-17d82513265f,network=Network(b98d43ff-51d0-4328-be34-b7c110358c95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1de67e88-37')
Aug 26 08:41:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WiUVGChN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:41:14 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aff529b-892b-4d89-b2cf-b5eff822e327]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61062be-30e5-4356-a8e2-796f9d208250]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:41:14 user nova-compute[73104]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)
Aug 26 08:41:14 user nova-compute[73104]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:41:14 user nova-compute[73104]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:41:14 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:41:14 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:41:14 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:41:14 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:41:14 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:41:14 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:41:14 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:41:14 user nova-compute[73104]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)
Aug 26 08:41:14 user nova-compute[73104]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:41:14 user nova-compute[73104]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:41:14 user nova-compute[73104]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 (non-flash)
Aug 26 08:41:14 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:41:14 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:41:14 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:41:14 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:41:14 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:41:14 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0c418f880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646'): ({'sdc'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Removing single pathed devices sdc {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfd3f93-1c01-4f8b-841a-b6a06d8fa1a7]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ee9478-5b9a-40ea-b3c5-4de0301bb22e]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Flushing IO for device /dev/sdc {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e376004-631d-4158-b4e1-3c564b6988b0]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG nova.objects.instance [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lazy-loading 'pci_requests' on Instance uuid 94de2062-7017-44fe-8df0-0a3cd63d5498 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG nova.objects.instance [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lazy-loading 'numa_topology' on Instance uuid 94de2062-7017-44fe-8df0-0a3cd63d5498 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[43131cfb-3d82-4101-9915-128579ae3bf2]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] SCSI volumes sdc have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:41:14 user nova-compute[73104]: INFO nova.compute.claims [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Claim successful on node user
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07c6b4c-3f28-493a-ac1f-f1226d335317]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG nova.compute.manager [req-952d1b18-4635-41af-ac89-93ad0b127c58 req-bfbf311e-4789-4bdb-9d17-a5cf8d6fd693 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-plugged-d7cb8b02-8579-43e0-b058-2cbe69bf0edf {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-952d1b18-4635-41af-ac89-93ad0b127c58 req-bfbf311e-4789-4bdb-9d17-a5cf8d6fd693 service nova] Acquiring lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-952d1b18-4635-41af-ac89-93ad0b127c58 req-bfbf311e-4789-4bdb-9d17-a5cf8d6fd693 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-952d1b18-4635-41af-ac89-93ad0b127c58 req-bfbf311e-4789-4bdb-9d17-a5cf8d6fd693 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG nova.compute.manager [req-952d1b18-4635-41af-ac89-93ad0b127c58 req-bfbf311e-4789-4bdb-9d17-a5cf8d6fd693 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] No waiting events found dispatching network-vif-plugged-d7cb8b02-8579-43e0-b058-2cbe69bf0edf {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:14 user nova-compute[73104]: WARNING nova.compute.manager [req-952d1b18-4635-41af-ac89-93ad0b127c58 req-bfbf311e-4789-4bdb-9d17-a5cf8d6fd693 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received unexpected event network-vif-plugged-d7cb8b02-8579-43e0-b058-2cbe69bf0edf for instance with vm_state active and task_state deleting.
Aug 26 08:41:14 user nova-compute[73104]: DEBUG nova.compute.manager [req-952d1b18-4635-41af-ac89-93ad0b127c58 req-bfbf311e-4789-4bdb-9d17-a5cf8d6fd693 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-unplugged-2bb400c7-1a44-427c-a38e-860f71f92d31 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-952d1b18-4635-41af-ac89-93ad0b127c58 req-bfbf311e-4789-4bdb-9d17-a5cf8d6fd693 service nova] Acquiring lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-952d1b18-4635-41af-ac89-93ad0b127c58 req-bfbf311e-4789-4bdb-9d17-a5cf8d6fd693 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-952d1b18-4635-41af-ac89-93ad0b127c58 req-bfbf311e-4789-4bdb-9d17-a5cf8d6fd693 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG nova.compute.manager [req-952d1b18-4635-41af-ac89-93ad0b127c58 req-bfbf311e-4789-4bdb-9d17-a5cf8d6fd693 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] No waiting events found dispatching network-vif-unplugged-2bb400c7-1a44-427c-a38e-860f71f92d31 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG nova.compute.manager [req-952d1b18-4635-41af-ac89-93ad0b127c58 req-bfbf311e-4789-4bdb-9d17-a5cf8d6fd693 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-unplugged-2bb400c7-1a44-427c-a38e-860f71f92d31 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 -p 172.16.0.220:3260 --logout" returned: 0 in 0.101s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bee50ee-5b6a-4cda-9091-26ba8d3475aa]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646, portal: 172.16.0.220,3260]
Aug 26 08:41:14 user nova-compute[73104]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646, portal: 172.16.0.220,3260] successful.
Aug 26 08:41:14 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99dfa21b-e82b-4526-ac24-50a4e0b66646 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d8a882-41bd-4e0c-a3af-45f8d86e14d4]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.530s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] <== disconnect_volume: return (531ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcFEzOiw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:41:14 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14565d0-74ef-4c00-b075-d491d0a4ac49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[849c3bf4-c86e-4264-8e05-1827ac2445d0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:41:14 user nova-compute[73104]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)
Aug 26 08:41:14 user nova-compute[73104]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:41:14 user nova-compute[73104]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:41:14 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:41:14 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:41:14 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:41:14 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:41:14 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:41:14 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:41:14 user nova-compute[73104]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)
Aug 26 08:41:14 user nova-compute[73104]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:41:14 user nova-compute[73104]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:41:14 user nova-compute[73104]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc (non-flash)
Aug 26 08:41:14 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:41:14 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:41:14 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:41:14 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:41:14 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0c4180c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc'): ({'sdd'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Removing single pathed devices sdd {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc29bb34-0989-437e-8026-f65125a1d6e6]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd58b137-a2df-407a-8a85-7c8d21fb7307]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Flushing IO for device /dev/sdd {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d87519-efed-416e-b8b0-8fe052a98df6]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.059s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ec623a-f670-4851-8b7d-c72a95d057dd]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] SCSI volumes sdd have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4882e0f2-7ea8-42f6-8d14-3943897ea724]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62452ef-f747-43f5-99e6-ffb1265c5606]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc, portal: 172.16.0.220,3260]
Aug 26 08:41:15 user nova-compute[73104]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc, portal: 172.16.0.220,3260] successful.
Aug 26 08:41:15 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:311fdf7a-f6f3-413d-9f9b-a21e89f340dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.054s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e38470-e46f-40af-95ae-b4651b77525f]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.425s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] <== disconnect_volume: return (426ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sFRtjoUh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:41:15 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:41:15 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8d1256-1aef-40fe-aca1-66f2481486d4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd16592-be98-4c5d-8ccf-5f59e29c9e1f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:41:15 user nova-compute[73104]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)
Aug 26 08:41:15 user nova-compute[73104]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:41:15 user nova-compute[73104]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:41:15 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:41:15 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:41:15 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:41:15 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:41:15 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:41:15 user nova-compute[73104]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)
Aug 26 08:41:15 user nova-compute[73104]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:41:15 user nova-compute[73104]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:41:15 user nova-compute[73104]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f (non-flash)
Aug 26 08:41:15 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:41:15 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:41:15 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:41:15 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0c41a0550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f'): ({'sdb'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Removing single pathed devices sdb {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.786s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[910bf181-c0b9-4aba-8643-9e4619bc4ed6]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f26b73-0e84-48d4-9e9c-6b60ec62e48b]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Flushing IO for device /dev/sdb {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c70d37e-5a30-41f4-af3b-0025734d54b3]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG nova.compute.manager [req-210a0a47-f95f-453e-a3ff-61385b2dfefe req-a0a14182-9c24-40fb-b08b-cb96ecb317c4 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-plugged-949f6e6c-727e-440c-b767-caf76f3f037e {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-210a0a47-f95f-453e-a3ff-61385b2dfefe req-a0a14182-9c24-40fb-b08b-cb96ecb317c4 service nova] Acquiring lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-210a0a47-f95f-453e-a3ff-61385b2dfefe req-a0a14182-9c24-40fb-b08b-cb96ecb317c4 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-210a0a47-f95f-453e-a3ff-61385b2dfefe req-a0a14182-9c24-40fb-b08b-cb96ecb317c4 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG nova.compute.manager [req-210a0a47-f95f-453e-a3ff-61385b2dfefe req-a0a14182-9c24-40fb-b08b-cb96ecb317c4 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] No waiting events found dispatching network-vif-plugged-949f6e6c-727e-440c-b767-caf76f3f037e {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:15 user nova-compute[73104]: WARNING nova.compute.manager [req-210a0a47-f95f-453e-a3ff-61385b2dfefe req-a0a14182-9c24-40fb-b08b-cb96ecb317c4 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received unexpected event network-vif-plugged-949f6e6c-727e-440c-b767-caf76f3f037e for instance with vm_state active and task_state deleting.
Aug 26 08:41:15 user nova-compute[73104]: DEBUG nova.compute.manager [req-210a0a47-f95f-453e-a3ff-61385b2dfefe req-a0a14182-9c24-40fb-b08b-cb96ecb317c4 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-unplugged-55fb8a61-3cfe-422c-af91-ca5199362cc7 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-210a0a47-f95f-453e-a3ff-61385b2dfefe req-a0a14182-9c24-40fb-b08b-cb96ecb317c4 service nova] Acquiring lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-210a0a47-f95f-453e-a3ff-61385b2dfefe req-a0a14182-9c24-40fb-b08b-cb96ecb317c4 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-210a0a47-f95f-453e-a3ff-61385b2dfefe req-a0a14182-9c24-40fb-b08b-cb96ecb317c4 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG nova.compute.manager [req-210a0a47-f95f-453e-a3ff-61385b2dfefe req-a0a14182-9c24-40fb-b08b-cb96ecb317c4 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] No waiting events found dispatching network-vif-unplugged-55fb8a61-3cfe-422c-af91-ca5199362cc7 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG nova.compute.manager [req-210a0a47-f95f-453e-a3ff-61385b2dfefe req-a0a14182-9c24-40fb-b08b-cb96ecb317c4 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-unplugged-55fb8a61-3cfe-422c-af91-ca5199362cc7 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG nova.compute.manager [req-210a0a47-f95f-453e-a3ff-61385b2dfefe req-a0a14182-9c24-40fb-b08b-cb96ecb317c4 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-plugged-55fb8a61-3cfe-422c-af91-ca5199362cc7 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-210a0a47-f95f-453e-a3ff-61385b2dfefe req-a0a14182-9c24-40fb-b08b-cb96ecb317c4 service nova] Acquiring lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-210a0a47-f95f-453e-a3ff-61385b2dfefe req-a0a14182-9c24-40fb-b08b-cb96ecb317c4 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-210a0a47-f95f-453e-a3ff-61385b2dfefe req-a0a14182-9c24-40fb-b08b-cb96ecb317c4 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG nova.compute.manager [req-210a0a47-f95f-453e-a3ff-61385b2dfefe req-a0a14182-9c24-40fb-b08b-cb96ecb317c4 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] No waiting events found dispatching network-vif-plugged-55fb8a61-3cfe-422c-af91-ca5199362cc7 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:15 user nova-compute[73104]: WARNING nova.compute.manager [req-210a0a47-f95f-453e-a3ff-61385b2dfefe req-a0a14182-9c24-40fb-b08b-cb96ecb317c4 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received unexpected event network-vif-plugged-55fb8a61-3cfe-422c-af91-ca5199362cc7 for instance with vm_state active and task_state deleting.
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba6a887-8b61-4780-8891-48e5ea23cf45]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[085f13a2-2ce6-4474-b1ce-81455bb06238]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:15 user nova-compute[73104]: INFO nova.network.neutron [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Updating port 4a3e387d-f638-43fc-bdef-4c0b608d29d4 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[423e7281-813d-41ab-bf48-612fb31b2b58]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f, portal: 172.16.0.220,3260]
Aug 26 08:41:15 user nova-compute[73104]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f, portal: 172.16.0.220,3260] successful.
Aug 26 08:41:15 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8a725f-797a-49df-a71e-4672e30f9d6f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG nova.network.neutron [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Updating instance_info_cache with network_info: [{"id": "d4692900-c165-487d-9847-383fcf1d2270", "address": "fa:16:3e:b9:37:34", "network": {"id": "9aad8a32-d93f-45ef-be53-f84cebd194b1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2017537149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc8c266ecf8444919a4a2ed73b784b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4692900-c1", "ovs_interfaceid": "d4692900-c165-487d-9847-383fcf1d2270", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0bc6b8-12ff-4675-a151-dd0e7a7632a7]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.432s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] <== disconnect_volume: return (435ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:41:15 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Deleting instance files /opt/stack/data/nova/instances/e2ec2788-98c7-48a7-933a-433dc215d7ec_del
Aug 26 08:41:15 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Deletion of /opt/stack/data/nova/instances/e2ec2788-98c7-48a7-933a-433dc215d7ec_del complete
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Releasing lock "refresh_cache-385c6d93-907d-42d7-9b43-479e6caf66f9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:41:15 user nova-compute[73104]: INFO nova.compute.manager [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Took 4.02 seconds to destroy the instance on the hypervisor.
Aug 26 08:41:15 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Starting migrate_disk_and_power_off {{(pid=73104) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-plugged-2bb400c7-1a44-427c-a38e-860f71f92d31 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] Acquiring lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] No waiting events found dispatching network-vif-plugged-2bb400c7-1a44-427c-a38e-860f71f92d31 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:16 user nova-compute[73104]: WARNING nova.compute.manager [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received unexpected event network-vif-plugged-2bb400c7-1a44-427c-a38e-860f71f92d31 for instance with vm_state active and task_state deleting.
Aug 26 08:41:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-unplugged-0cf8f75c-539b-44d0-bc4a-a52f86a24d9c {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] Acquiring lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] No waiting events found dispatching network-vif-unplugged-0cf8f75c-539b-44d0-bc4a-a52f86a24d9c {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-unplugged-0cf8f75c-539b-44d0-bc4a-a52f86a24d9c for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-plugged-0cf8f75c-539b-44d0-bc4a-a52f86a24d9c {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] Acquiring lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] No waiting events found dispatching network-vif-plugged-0cf8f75c-539b-44d0-bc4a-a52f86a24d9c {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:16 user nova-compute[73104]: WARNING nova.compute.manager [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received unexpected event network-vif-plugged-0cf8f75c-539b-44d0-bc4a-a52f86a24d9c for instance with vm_state active and task_state deleting.
Aug 26 08:41:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-unplugged-971207c4-aee3-47f6-8fb4-ad7d7fc2827e {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] Acquiring lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] No waiting events found dispatching network-vif-unplugged-971207c4-aee3-47f6-8fb4-ad7d7fc2827e {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-unplugged-971207c4-aee3-47f6-8fb4-ad7d7fc2827e for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-plugged-971207c4-aee3-47f6-8fb4-ad7d7fc2827e {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] Acquiring lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] No waiting events found dispatching network-vif-plugged-971207c4-aee3-47f6-8fb4-ad7d7fc2827e {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:16 user nova-compute[73104]: WARNING nova.compute.manager [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received unexpected event network-vif-plugged-971207c4-aee3-47f6-8fb4-ad7d7fc2827e for instance with vm_state active and task_state deleting.
Aug 26 08:41:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-unplugged-1de67e88-3745-4d54-9b30-17d82513265f {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] Acquiring lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] No waiting events found dispatching network-vif-unplugged-1de67e88-3745-4d54-9b30-17d82513265f {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-1a037932-f969-475d-b1cc-e804bd3d2909 req-4b92f56d-d5d1-423d-81e2-03db87443b90 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-unplugged-1de67e88-3745-4d54-9b30-17d82513265f for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:41:16 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Instance destroyed successfully.
Aug 26 08:41:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1752100953',display_name='tempest-ServerActionsTestOtherB-server-1752100953',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1752100953',id=5,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNCl9FBP9XyWyY8/M5Nn5mUzz1vqHS13H5r5WR3mIkiFM7rzl4Rl7e+CWZJ8183D5yYr3nZra0DCol7pvB/KJevg8WITrJ9KzKNvGMc/QWpgMb9Lbrm7qPNUJRloZ083Q==',key_name='tempest-keypair-1221674543',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:37:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bc8c266ecf8444919a4a2ed73b784b53',ramdisk_id='',reservation_id='r-w3k6rkik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-905162429',owner_user_name='tempest-ServerActionsTestOtherB-905162429-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:41:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4e9fc4dcaaf4aa1aaa51245217b4ded',uuid=385c6d93-907d-42d7-9b43-479e6caf66f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4692900-c165-487d-9847-383fcf1d2270", "address": "fa:16:3e:b9:37:34", "network": {"id": "9aad8a32-d93f-45ef-be53-f84cebd194b1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2017537149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2017537149-network", "vif_mac": "fa:16:3e:b9:37:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc8c266ecf8444919a4a2ed73b784b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4692900-c1", "ovs_interfaceid": "d4692900-c165-487d-9847-383fcf1d2270", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Converting VIF {"id": "d4692900-c165-487d-9847-383fcf1d2270", "address": "fa:16:3e:b9:37:34", "network": {"id": "9aad8a32-d93f-45ef-be53-f84cebd194b1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2017537149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2017537149-network", "vif_mac": "fa:16:3e:b9:37:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc8c266ecf8444919a4a2ed73b784b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4692900-c1", "ovs_interfaceid": "d4692900-c165-487d-9847-383fcf1d2270", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:37:34,bridge_name='br-int',has_traffic_filtering=True,id=d4692900-c165-487d-9847-383fcf1d2270,network=Network(9aad8a32-d93f-45ef-be53-f84cebd194b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4692900-c1') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG os_vif [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:37:34,bridge_name='br-int',has_traffic_filtering=True,id=d4692900-c165-487d-9847-383fcf1d2270,network=Network(9aad8a32-d93f-45ef-be53-f84cebd194b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4692900-c1') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4692900-c1, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:41:16 user nova-compute[73104]: INFO os_vif [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:37:34,bridge_name='br-int',has_traffic_filtering=True,id=d4692900-c165-487d-9847-383fcf1d2270,network=Network(9aad8a32-d93f-45ef-be53-f84cebd194b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4692900-c1')
Aug 26 08:41:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEOqgAiB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:41:16 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:41:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b430dd3e-4bca-4a38-9a87-d356852684e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a60b45-c1cd-4e5f-b11a-b80917b6a322]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:41:16 user nova-compute[73104]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)
Aug 26 08:41:16 user nova-compute[73104]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:41:16 user nova-compute[73104]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:41:16 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:41:16 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:41:16 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:41:16 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:41:16 user nova-compute[73104]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)
Aug 26 08:41:16 user nova-compute[73104]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:41:16 user nova-compute[73104]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:41:16 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:41:16 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:41:16 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:41:16 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0c468bac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44'): ({'sdk'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Removing single pathed devices sdk {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "refresh_cache-94de2062-7017-44fe-8df0-0a3cd63d5498" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquired lock "refresh_cache-94de2062-7017-44fe-8df0-0a3cd63d5498" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG nova.network.neutron [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4445dc4a-b692-4221-9d80-5c55a40be945]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.038s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[334a0e28-a0aa-4dcd-94c0-dfac2049e22b]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Flushing IO for device /dev/sdk {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[076fbce5-e0c9-404a-9c76-7b149a88abc9]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-8a3024ff-0cc6-4c90-b59c-d5674582c001 req-05fec474-794b-4d5a-ac6a-bd38655f7962 service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Received event network-vif-unplugged-d4692900-c165-487d-9847-383fcf1d2270 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-8a3024ff-0cc6-4c90-b59c-d5674582c001 req-05fec474-794b-4d5a-ac6a-bd38655f7962 service nova] Acquiring lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-8a3024ff-0cc6-4c90-b59c-d5674582c001 req-05fec474-794b-4d5a-ac6a-bd38655f7962 service nova] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-8a3024ff-0cc6-4c90-b59c-d5674582c001 req-05fec474-794b-4d5a-ac6a-bd38655f7962 service nova] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-8a3024ff-0cc6-4c90-b59c-d5674582c001 req-05fec474-794b-4d5a-ac6a-bd38655f7962 service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] No waiting events found dispatching network-vif-unplugged-d4692900-c165-487d-9847-383fcf1d2270 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:16 user nova-compute[73104]: WARNING nova.compute.manager [req-8a3024ff-0cc6-4c90-b59c-d5674582c001 req-05fec474-794b-4d5a-ac6a-bd38655f7962 service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Received unexpected event network-vif-unplugged-d4692900-c165-487d-9847-383fcf1d2270 for instance with vm_state active and task_state resize_migrating.
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.048s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07ceaa7-a498-4e4d-856b-d633186ed966]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] SCSI volumes sdk have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[606f8c0a-dfb4-4ecc-8f6f-364b3787bc16]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ab2b88-f11a-4d75-9c4d-5cc1bba70aaf]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44, portal: 172.16.0.220,3260]
Aug 26 08:41:17 user nova-compute[73104]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44, portal: 172.16.0.220,3260] successful.
Aug 26 08:41:17 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eeccd26-8035-48fa-8bb7-f2f3736b756b]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:41:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] <== disconnect_volume: return (386ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:41:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:41:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:17 user nova-compute[73104]: DEBUG nova.network.neutron [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Updating instance_info_cache with network_info: [{"id": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "address": "fa:16:3e:65:0d:e0", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a3e387d-f6", "ovs_interfaceid": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:41:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Releasing lock "refresh_cache-94de2062-7017-44fe-8df0-0a3cd63d5498" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:41:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:41:17 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Creating image(s)
Aug 26 08:41:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "/opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "/opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "/opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:17 user nova-compute[73104]: DEBUG nova.objects.instance [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lazy-loading 'trusted_certs' on Instance uuid 94de2062-7017-44fe-8df0-0a3cd63d5498 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:41:17 user nova-compute[73104]: DEBUG nova.compute.manager [req-0038897f-70d5-4e56-8cef-a33838352391 req-35910045-a606-4d63-966e-5a1b544d0972 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Received event network-changed-4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:17 user nova-compute[73104]: DEBUG nova.compute.manager [req-0038897f-70d5-4e56-8cef-a33838352391 req-35910045-a606-4d63-966e-5a1b544d0972 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Refreshing instance network info cache due to event network-changed-4a3e387d-f638-43fc-bdef-4c0b608d29d4. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:41:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0038897f-70d5-4e56-8cef-a33838352391 req-35910045-a606-4d63-966e-5a1b544d0972 service nova] Acquiring lock "refresh_cache-94de2062-7017-44fe-8df0-0a3cd63d5498" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:41:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0038897f-70d5-4e56-8cef-a33838352391 req-35910045-a606-4d63-966e-5a1b544d0972 service nova] Acquired lock "refresh_cache-94de2062-7017-44fe-8df0-0a3cd63d5498" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:41:17 user nova-compute[73104]: DEBUG nova.network.neutron [req-0038897f-70d5-4e56-8cef-a33838352391 req-35910045-a606-4d63-966e-5a1b544d0972 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Refreshing network info cache for port 4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:41:17 user nova-compute[73104]: DEBUG nova.objects.base [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Object Instance<94de2062-7017-44fe-8df0-0a3cd63d5498> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:41:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "16d4df834f1df9b20ea6cd960f458c49daabe537" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "16d4df834f1df9b20ea6cd960f458c49daabe537" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:41:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9_resize/disk /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16d4df834f1df9b20ea6cd960f458c49daabe537.part --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] CMD "cp -r /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9_resize/disk /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk" returned: 0 in 1.204s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:18 user nova-compute[73104]: DEBUG nova.compute.manager [req-e1887c3b-cc1f-46b7-8f0f-f3817b63ae47 req-32dfe3cc-72b8-419a-80af-2f7e0bb2cbe8 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-plugged-1de67e88-3745-4d54-9b30-17d82513265f {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e1887c3b-cc1f-46b7-8f0f-f3817b63ae47 req-32dfe3cc-72b8-419a-80af-2f7e0bb2cbe8 service nova] Acquiring lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e1887c3b-cc1f-46b7-8f0f-f3817b63ae47 req-32dfe3cc-72b8-419a-80af-2f7e0bb2cbe8 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e1887c3b-cc1f-46b7-8f0f-f3817b63ae47 req-32dfe3cc-72b8-419a-80af-2f7e0bb2cbe8 service nova] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:18 user nova-compute[73104]: DEBUG nova.compute.manager [req-e1887c3b-cc1f-46b7-8f0f-f3817b63ae47 req-32dfe3cc-72b8-419a-80af-2f7e0bb2cbe8 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] No waiting events found dispatching network-vif-plugged-1de67e88-3745-4d54-9b30-17d82513265f {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:18 user nova-compute[73104]: WARNING nova.compute.manager [req-e1887c3b-cc1f-46b7-8f0f-f3817b63ae47 req-32dfe3cc-72b8-419a-80af-2f7e0bb2cbe8 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received unexpected event network-vif-plugged-1de67e88-3745-4d54-9b30-17d82513265f for instance with vm_state active and task_state deleting.
Aug 26 08:41:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9_resize/disk.info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk.info {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] CMD "cp -r /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9_resize/disk.info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk.info" returned: 0 in 0.047s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16d4df834f1df9b20ea6cd960f458c49daabe537.part --force-share --output=json" returned: 0 in 0.217s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:18 user nova-compute[73104]: DEBUG nova.virt.images [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] 61716b59-ca97-49ea-b9af-d53731069806 was qcow2, converting to raw {{(pid=73104) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 08:41:18 user nova-compute[73104]: DEBUG nova.privsep.utils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73104) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 08:41:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/16d4df834f1df9b20ea6cd960f458c49daabe537.part /opt/stack/data/nova/instances/_base/16d4df834f1df9b20ea6cd960f458c49daabe537.converted {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:19 user nova-compute[73104]: DEBUG nova.compute.manager [req-b45bb386-70c3-4e94-81b6-7dfb606e7173 req-6e4ee7df-8a1a-482f-a272-b83eb481e7d5 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-changed-4f31240a-f297-42c8-a9f5-65c64322c486 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:19 user nova-compute[73104]: DEBUG nova.compute.manager [req-b45bb386-70c3-4e94-81b6-7dfb606e7173 req-6e4ee7df-8a1a-482f-a272-b83eb481e7d5 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Refreshing instance network info cache due to event network-changed-4f31240a-f297-42c8-a9f5-65c64322c486. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:41:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b45bb386-70c3-4e94-81b6-7dfb606e7173 req-6e4ee7df-8a1a-482f-a272-b83eb481e7d5 service nova] Acquiring lock "refresh_cache-7170b5a8-12a7-4ddf-8089-fde172570fd1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:41:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b45bb386-70c3-4e94-81b6-7dfb606e7173 req-6e4ee7df-8a1a-482f-a272-b83eb481e7d5 service nova] Acquired lock "refresh_cache-7170b5a8-12a7-4ddf-8089-fde172570fd1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:41:19 user nova-compute[73104]: DEBUG nova.network.neutron [req-b45bb386-70c3-4e94-81b6-7dfb606e7173 req-6e4ee7df-8a1a-482f-a272-b83eb481e7d5 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Refreshing network info cache for port 4f31240a-f297-42c8-a9f5-65c64322c486 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:41:19 user nova-compute[73104]: DEBUG nova.network.neutron [req-0038897f-70d5-4e56-8cef-a33838352391 req-35910045-a606-4d63-966e-5a1b544d0972 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Updated VIF entry in instance network info cache for port 4a3e387d-f638-43fc-bdef-4c0b608d29d4. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:41:19 user nova-compute[73104]: DEBUG nova.network.neutron [req-0038897f-70d5-4e56-8cef-a33838352391 req-35910045-a606-4d63-966e-5a1b544d0972 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Updating instance_info_cache with network_info: [{"id": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "address": "fa:16:3e:65:0d:e0", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a3e387d-f6", "ovs_interfaceid": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:41:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0038897f-70d5-4e56-8cef-a33838352391 req-35910045-a606-4d63-966e-5a1b544d0972 service nova] Releasing lock "refresh_cache-94de2062-7017-44fe-8df0-0a3cd63d5498" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:41:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/16d4df834f1df9b20ea6cd960f458c49daabe537.part /opt/stack/data/nova/instances/_base/16d4df834f1df9b20ea6cd960f458c49daabe537.converted" returned: 0 in 0.801s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16d4df834f1df9b20ea6cd960f458c49daabe537.converted --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16d4df834f1df9b20ea6cd960f458c49daabe537.converted --force-share --output=json" returned: 0 in 0.312s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "16d4df834f1df9b20ea6cd960f458c49daabe537" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.586s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16d4df834f1df9b20ea6cd960f458c49daabe537 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:20 user nova-compute[73104]: DEBUG nova.network.neutron [req-b45bb386-70c3-4e94-81b6-7dfb606e7173 req-6e4ee7df-8a1a-482f-a272-b83eb481e7d5 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Updated VIF entry in instance network info cache for port 4f31240a-f297-42c8-a9f5-65c64322c486. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:41:20 user nova-compute[73104]: DEBUG nova.network.neutron [req-b45bb386-70c3-4e94-81b6-7dfb606e7173 req-6e4ee7df-8a1a-482f-a272-b83eb481e7d5 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Updating instance_info_cache with network_info: [{"id": "4f31240a-f297-42c8-a9f5-65c64322c486", "address": "fa:16:3e:e4:82:c2", "network": {"id": "61837c4d-d9ee-4ec5-be90-336082e4264e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-701032687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f31240a-f2", "ovs_interfaceid": "4f31240a-f297-42c8-a9f5-65c64322c486", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8469badb-d912-4a8d-ba41-cf4a04664c73", "address": "fa:16:3e:8c:2c:5b", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8469badb-d9", "ovs_interfaceid": "8469badb-d912-4a8d-ba41-cf4a04664c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b", "address": "fa:16:3e:f8:62:20", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa218cb-82", "ovs_interfaceid": "4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7c7615d3-d6db-4a04-884b-34ad12ed49ab", "address": "fa:16:3e:5b:13:e7", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7615d3-d6", "ovs_interfaceid": "7c7615d3-d6db-4a04-884b-34ad12ed49ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56", "address": "fa:16:3e:11:48:11", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9e4cb8-1b", "ovs_interfaceid": "8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e77e909b-af87-4825-b30b-a7062763e3ea", "address": "fa:16:3e:85:9b:36", "network": {"id": "4138826a-130b-48c0-b315-122e80d369ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680959749", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77e909b-af", "ovs_interfaceid": "e77e909b-af87-4825-b30b-a7062763e3ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7aabcef5-79f9-4f25-b095-ac587d15a460", "address": "fa:16:3e:e6:4e:9b", "network": {"id": "4138826a-130b-48c0-b315-122e80d369ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680959749", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aabcef5-79", "ovs_interfaceid": "7aabcef5-79f9-4f25-b095-ac587d15a460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:41:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b45bb386-70c3-4e94-81b6-7dfb606e7173 req-6e4ee7df-8a1a-482f-a272-b83eb481e7d5 service nova] Releasing lock "refresh_cache-7170b5a8-12a7-4ddf-8089-fde172570fd1" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:41:20 user nova-compute[73104]: DEBUG nova.compute.manager [req-b45bb386-70c3-4e94-81b6-7dfb606e7173 req-6e4ee7df-8a1a-482f-a272-b83eb481e7d5 service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Received event network-vif-plugged-d4692900-c165-487d-9847-383fcf1d2270 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b45bb386-70c3-4e94-81b6-7dfb606e7173 req-6e4ee7df-8a1a-482f-a272-b83eb481e7d5 service nova] Acquiring lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b45bb386-70c3-4e94-81b6-7dfb606e7173 req-6e4ee7df-8a1a-482f-a272-b83eb481e7d5 service nova] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b45bb386-70c3-4e94-81b6-7dfb606e7173 req-6e4ee7df-8a1a-482f-a272-b83eb481e7d5 service nova] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:20 user nova-compute[73104]: DEBUG nova.compute.manager [req-b45bb386-70c3-4e94-81b6-7dfb606e7173 req-6e4ee7df-8a1a-482f-a272-b83eb481e7d5 service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] No waiting events found dispatching network-vif-plugged-d4692900-c165-487d-9847-383fcf1d2270 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:20 user nova-compute[73104]: WARNING nova.compute.manager [req-b45bb386-70c3-4e94-81b6-7dfb606e7173 req-6e4ee7df-8a1a-482f-a272-b83eb481e7d5 service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Received unexpected event network-vif-plugged-d4692900-c165-487d-9847-383fcf1d2270 for instance with vm_state active and task_state resize_migrating.
Aug 26 08:41:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16d4df834f1df9b20ea6cd960f458c49daabe537 --force-share --output=json" returned: 0 in 0.259s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "16d4df834f1df9b20ea6cd960f458c49daabe537" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "16d4df834f1df9b20ea6cd960f458c49daabe537" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16d4df834f1df9b20ea6cd960f458c49daabe537 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:20 user nova-compute[73104]: DEBUG nova.network.neutron [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Port d4692900-c165-487d-9847-383fcf1d2270 binding to destination host user is already ACTIVE {{(pid=73104) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 26 08:41:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16d4df834f1df9b20ea6cd960f458c49daabe537 --force-share --output=json" returned: 0 in 0.202s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16d4df834f1df9b20ea6cd960f458c49daabe537,backing_fmt=raw /opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16d4df834f1df9b20ea6cd960f458c49daabe537,backing_fmt=raw /opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk 1073741824" returned: 0 in 0.081s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "16d4df834f1df9b20ea6cd960f458c49daabe537" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16d4df834f1df9b20ea6cd960f458c49daabe537 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Acquiring lock "7170b5a8-12a7-4ddf-8089-fde172570fd1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Acquiring lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:20 user nova-compute[73104]: INFO nova.compute.manager [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Terminating instance
Aug 26 08:41:20 user nova-compute[73104]: DEBUG nova.compute.manager [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 08:41:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquiring lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16d4df834f1df9b20ea6cd960f458c49daabe537 --force-share --output=json" returned: 0 in 0.214s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:20 user nova-compute[73104]: DEBUG nova.objects.instance [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lazy-loading 'migration_context' on Instance uuid 94de2062-7017-44fe-8df0-0a3cd63d5498 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:41:20 user nova-compute[73104]: DEBUG nova.objects.base [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Object Instance<94de2062-7017-44fe-8df0-0a3cd63d5498> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:41:20 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Rebasing disk image.
Aug 26 08:41:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquiring lock "refresh_cache-385c6d93-907d-42d7-9b43-479e6caf66f9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquired lock "refresh_cache-385c6d93-907d-42d7-9b43-479e6caf66f9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG nova.network.neutron [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.220s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 -F raw /opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG nova.compute.manager [req-c42f4a4c-59aa-4b39-883b-aa2d6e18464d req-a9969fbc-3a12-4200-9caa-955b715d93a3 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-unplugged-4f31240a-f297-42c8-a9f5-65c64322c486 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c42f4a4c-59aa-4b39-883b-aa2d6e18464d req-a9969fbc-3a12-4200-9caa-955b715d93a3 service nova] Acquiring lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c42f4a4c-59aa-4b39-883b-aa2d6e18464d req-a9969fbc-3a12-4200-9caa-955b715d93a3 service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c42f4a4c-59aa-4b39-883b-aa2d6e18464d req-a9969fbc-3a12-4200-9caa-955b715d93a3 service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG nova.compute.manager [req-c42f4a4c-59aa-4b39-883b-aa2d6e18464d req-a9969fbc-3a12-4200-9caa-955b715d93a3 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] No waiting events found dispatching network-vif-unplugged-4f31240a-f297-42c8-a9f5-65c64322c486 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG nova.compute.manager [req-c42f4a4c-59aa-4b39-883b-aa2d6e18464d req-a9969fbc-3a12-4200-9caa-955b715d93a3 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-unplugged-4f31240a-f297-42c8-a9f5-65c64322c486 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG nova.compute.manager [req-4c2824eb-3eb3-45ca-a740-cd65a08f778d req-bda0eb84-d997-477f-99f9-fb177278dd1f service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-deleted-971207c4-aee3-47f6-8fb4-ad7d7fc2827e {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:21 user nova-compute[73104]: INFO nova.compute.manager [req-4c2824eb-3eb3-45ca-a740-cd65a08f778d req-bda0eb84-d997-477f-99f9-fb177278dd1f service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Neutron deleted interface 971207c4-aee3-47f6-8fb4-ad7d7fc2827e; detaching it from the instance and deleting it from the info cache
Aug 26 08:41:21 user nova-compute[73104]: DEBUG nova.network.neutron [req-4c2824eb-3eb3-45ca-a740-cd65a08f778d req-bda0eb84-d997-477f-99f9-fb177278dd1f service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Updating instance_info_cache with network_info: [{"id": "949f6e6c-727e-440c-b767-caf76f3f037e", "address": "fa:16:3e:a4:00:26", "network": {"id": "0941b2d8-176a-403b-a9bf-4a4d0de5bcc0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-890813398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap949f6e6c-72", "ovs_interfaceid": "949f6e6c-727e-440c-b767-caf76f3f037e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d7cb8b02-8579-43e0-b058-2cbe69bf0edf", "address": "fa:16:3e:72:2b:2a", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cb8b02-85", "ovs_interfaceid": "d7cb8b02-8579-43e0-b058-2cbe69bf0edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "55fb8a61-3cfe-422c-af91-ca5199362cc7", "address": "fa:16:3e:04:77:77", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fb8a61-3c", "ovs_interfaceid": "55fb8a61-3cfe-422c-af91-ca5199362cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2bb400c7-1a44-427c-a38e-860f71f92d31", "address": "fa:16:3e:33:83:63", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb400c7-1a", "ovs_interfaceid": "2bb400c7-1a44-427c-a38e-860f71f92d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0cf8f75c-539b-44d0-bc4a-a52f86a24d9c", "address": "fa:16:3e:50:f5:ca", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf8f75c-53", "ovs_interfaceid": "0cf8f75c-539b-44d0-bc4a-a52f86a24d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1de67e88-3745-4d54-9b30-17d82513265f", "address": "fa:16:3e:b3:77:f4", "network": {"id": "b98d43ff-51d0-4328-be34-b7c110358c95", "bridge": "br-int", "label": "tempest-device-tagging-net2-545564459", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de67e88-37", "ovs_interfaceid": "1de67e88-3745-4d54-9b30-17d82513265f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG nova.compute.manager [req-4c2824eb-3eb3-45ca-a740-cd65a08f778d req-bda0eb84-d997-477f-99f9-fb177278dd1f service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Detach interface failed, port_id=971207c4-aee3-47f6-8fb4-ad7d7fc2827e, reason: Instance e2ec2788-98c7-48a7-933a-433dc215d7ec could not be found. {{(pid=73104) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG nova.compute.manager [req-c32662a9-b20b-419d-bd50-3a64234b5036 req-278322ff-af00-4ebf-9393-45802ad4b3b6 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-unplugged-8469badb-d912-4a8d-ba41-cf4a04664c73 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c32662a9-b20b-419d-bd50-3a64234b5036 req-278322ff-af00-4ebf-9393-45802ad4b3b6 service nova] Acquiring lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c32662a9-b20b-419d-bd50-3a64234b5036 req-278322ff-af00-4ebf-9393-45802ad4b3b6 service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c32662a9-b20b-419d-bd50-3a64234b5036 req-278322ff-af00-4ebf-9393-45802ad4b3b6 service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG nova.compute.manager [req-c32662a9-b20b-419d-bd50-3a64234b5036 req-278322ff-af00-4ebf-9393-45802ad4b3b6 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] No waiting events found dispatching network-vif-unplugged-8469badb-d912-4a8d-ba41-cf4a04664c73 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG nova.compute.manager [req-c32662a9-b20b-419d-bd50-3a64234b5036 req-278322ff-af00-4ebf-9393-45802ad4b3b6 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-unplugged-8469badb-d912-4a8d-ba41-cf4a04664c73 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.network.neutron [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Updating instance_info_cache with network_info: [{"id": "d4692900-c165-487d-9847-383fcf1d2270", "address": "fa:16:3e:b9:37:34", "network": {"id": "9aad8a32-d93f-45ef-be53-f84cebd194b1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2017537149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc8c266ecf8444919a4a2ed73b784b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4692900-c1", "ovs_interfaceid": "d4692900-c165-487d-9847-383fcf1d2270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Releasing lock "refresh_cache-385c6d93-907d-42d7-9b43-479e6caf66f9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:41:23 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Instance destroyed successfully.
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.objects.instance [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Lazy-loading 'resources' on Instance uuid 7170b5a8-12a7-4ddf-8089-fde172570fd1 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-923765678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-923765678',id=11,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGYu7jnGjsMQMqrqqsnYZ+Rr2o1t2Pb+ktqLbI/eRVG3arD3uw99tX2o2eiIeA2ClXnduicOGInmHlnfRP03ohy6EG9X7PW2YhVQTFMQ+eJ45e4EFYaspRmSOv26WCnjw==',key_name='tempest-keypair-269369520',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:39:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27c658028a274117a30ecb831e50ddbb',ramdisk_id='',reservation_id='r-45ekea2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-834543942',owner_user_name='tempest-TaggedBootDevicesTest_v242-834543942-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:39:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5592a07f52b84dc9aa87f20bc1b9f0d6',uuid=7170b5a8-12a7-4ddf-8089-fde172570fd1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f31240a-f297-42c8-a9f5-65c64322c486", "address": "fa:16:3e:e4:82:c2", "network": {"id": "61837c4d-d9ee-4ec5-be90-336082e4264e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-701032687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f31240a-f2", "ovs_interfaceid": "4f31240a-f297-42c8-a9f5-65c64322c486", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converting VIF {"id": "4f31240a-f297-42c8-a9f5-65c64322c486", "address": "fa:16:3e:e4:82:c2", "network": {"id": "61837c4d-d9ee-4ec5-be90-336082e4264e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-701032687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f31240a-f2", "ovs_interfaceid": "4f31240a-f297-42c8-a9f5-65c64322c486", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:82:c2,bridge_name='br-int',has_traffic_filtering=True,id=4f31240a-f297-42c8-a9f5-65c64322c486,network=Network(61837c4d-d9ee-4ec5-be90-336082e4264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f31240a-f2') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG os_vif [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:82:c2,bridge_name='br-int',has_traffic_filtering=True,id=4f31240a-f297-42c8-a9f5-65c64322c486,network=Network(61837c4d-d9ee-4ec5-be90-336082e4264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f31240a-f2') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f31240a-f2, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-a08b2efd-6fa5-404f-b9a1-e266d138e449 req-605535ca-278a-4204-92fd-68d1c3e077e4 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-plugged-4f31240a-f297-42c8-a9f5-65c64322c486 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a08b2efd-6fa5-404f-b9a1-e266d138e449 req-605535ca-278a-4204-92fd-68d1c3e077e4 service nova] Acquiring lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a08b2efd-6fa5-404f-b9a1-e266d138e449 req-605535ca-278a-4204-92fd-68d1c3e077e4 service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a08b2efd-6fa5-404f-b9a1-e266d138e449 req-605535ca-278a-4204-92fd-68d1c3e077e4 service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-a08b2efd-6fa5-404f-b9a1-e266d138e449 req-605535ca-278a-4204-92fd-68d1c3e077e4 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] No waiting events found dispatching network-vif-plugged-4f31240a-f297-42c8-a9f5-65c64322c486 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:23 user nova-compute[73104]: WARNING nova.compute.manager [req-a08b2efd-6fa5-404f-b9a1-e266d138e449 req-605535ca-278a-4204-92fd-68d1c3e077e4 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received unexpected event network-vif-plugged-4f31240a-f297-42c8-a9f5-65c64322c486 for instance with vm_state active and task_state deleting.
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-a08b2efd-6fa5-404f-b9a1-e266d138e449 req-605535ca-278a-4204-92fd-68d1c3e077e4 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-unplugged-7c7615d3-d6db-4a04-884b-34ad12ed49ab {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a08b2efd-6fa5-404f-b9a1-e266d138e449 req-605535ca-278a-4204-92fd-68d1c3e077e4 service nova] Acquiring lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a08b2efd-6fa5-404f-b9a1-e266d138e449 req-605535ca-278a-4204-92fd-68d1c3e077e4 service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a08b2efd-6fa5-404f-b9a1-e266d138e449 req-605535ca-278a-4204-92fd-68d1c3e077e4 service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-a08b2efd-6fa5-404f-b9a1-e266d138e449 req-605535ca-278a-4204-92fd-68d1c3e077e4 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] No waiting events found dispatching network-vif-unplugged-7c7615d3-d6db-4a04-884b-34ad12ed49ab {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-a08b2efd-6fa5-404f-b9a1-e266d138e449 req-605535ca-278a-4204-92fd-68d1c3e077e4 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-unplugged-7c7615d3-d6db-4a04-884b-34ad12ed49ab for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-a08b2efd-6fa5-404f-b9a1-e266d138e449 req-605535ca-278a-4204-92fd-68d1c3e077e4 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-plugged-7c7615d3-d6db-4a04-884b-34ad12ed49ab {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a08b2efd-6fa5-404f-b9a1-e266d138e449 req-605535ca-278a-4204-92fd-68d1c3e077e4 service nova] Acquiring lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a08b2efd-6fa5-404f-b9a1-e266d138e449 req-605535ca-278a-4204-92fd-68d1c3e077e4 service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a08b2efd-6fa5-404f-b9a1-e266d138e449 req-605535ca-278a-4204-92fd-68d1c3e077e4 service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-a08b2efd-6fa5-404f-b9a1-e266d138e449 req-605535ca-278a-4204-92fd-68d1c3e077e4 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] No waiting events found dispatching network-vif-plugged-7c7615d3-d6db-4a04-884b-34ad12ed49ab {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:23 user nova-compute[73104]: WARNING nova.compute.manager [req-a08b2efd-6fa5-404f-b9a1-e266d138e449 req-605535ca-278a-4204-92fd-68d1c3e077e4 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received unexpected event network-vif-plugged-7c7615d3-d6db-4a04-884b-34ad12ed49ab for instance with vm_state active and task_state deleting.
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-a08b2efd-6fa5-404f-b9a1-e266d138e449 req-605535ca-278a-4204-92fd-68d1c3e077e4 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-unplugged-e77e909b-af87-4825-b30b-a7062763e3ea {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a08b2efd-6fa5-404f-b9a1-e266d138e449 req-605535ca-278a-4204-92fd-68d1c3e077e4 service nova] Acquiring lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a08b2efd-6fa5-404f-b9a1-e266d138e449 req-605535ca-278a-4204-92fd-68d1c3e077e4 service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a08b2efd-6fa5-404f-b9a1-e266d138e449 req-605535ca-278a-4204-92fd-68d1c3e077e4 service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-a08b2efd-6fa5-404f-b9a1-e266d138e449 req-605535ca-278a-4204-92fd-68d1c3e077e4 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] No waiting events found dispatching network-vif-unplugged-e77e909b-af87-4825-b30b-a7062763e3ea {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-a08b2efd-6fa5-404f-b9a1-e266d138e449 req-605535ca-278a-4204-92fd-68d1c3e077e4 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-unplugged-e77e909b-af87-4825-b30b-a7062763e3ea for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-da3201aa-5211-4707-a902-12d71f8b7b78 req-555a40a1-340b-4434-b35d-a3a6b4a1a760 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-unplugged-8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-da3201aa-5211-4707-a902-12d71f8b7b78 req-555a40a1-340b-4434-b35d-a3a6b4a1a760 service nova] Acquiring lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-da3201aa-5211-4707-a902-12d71f8b7b78 req-555a40a1-340b-4434-b35d-a3a6b4a1a760 service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-da3201aa-5211-4707-a902-12d71f8b7b78 req-555a40a1-340b-4434-b35d-a3a6b4a1a760 service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-da3201aa-5211-4707-a902-12d71f8b7b78 req-555a40a1-340b-4434-b35d-a3a6b4a1a760 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] No waiting events found dispatching network-vif-unplugged-8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-da3201aa-5211-4707-a902-12d71f8b7b78 req-555a40a1-340b-4434-b35d-a3a6b4a1a760 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-unplugged-8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-da3201aa-5211-4707-a902-12d71f8b7b78 req-555a40a1-340b-4434-b35d-a3a6b4a1a760 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-deleted-949f6e6c-727e-440c-b767-caf76f3f037e {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:23 user nova-compute[73104]: INFO nova.compute.manager [req-da3201aa-5211-4707-a902-12d71f8b7b78 req-555a40a1-340b-4434-b35d-a3a6b4a1a760 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Neutron deleted interface 949f6e6c-727e-440c-b767-caf76f3f037e; detaching it from the instance and deleting it from the info cache
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.network.neutron [req-da3201aa-5211-4707-a902-12d71f8b7b78 req-555a40a1-340b-4434-b35d-a3a6b4a1a760 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Updating instance_info_cache with network_info: [{"id": "d7cb8b02-8579-43e0-b058-2cbe69bf0edf", "address": "fa:16:3e:72:2b:2a", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cb8b02-85", "ovs_interfaceid": "d7cb8b02-8579-43e0-b058-2cbe69bf0edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "55fb8a61-3cfe-422c-af91-ca5199362cc7", "address": "fa:16:3e:04:77:77", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fb8a61-3c", "ovs_interfaceid": "55fb8a61-3cfe-422c-af91-ca5199362cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2bb400c7-1a44-427c-a38e-860f71f92d31", "address": "fa:16:3e:33:83:63", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb400c7-1a", "ovs_interfaceid": "2bb400c7-1a44-427c-a38e-860f71f92d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0cf8f75c-539b-44d0-bc4a-a52f86a24d9c", "address": "fa:16:3e:50:f5:ca", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf8f75c-53", "ovs_interfaceid": "0cf8f75c-539b-44d0-bc4a-a52f86a24d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1de67e88-3745-4d54-9b30-17d82513265f", "address": "fa:16:3e:b3:77:f4", "network": {"id": "b98d43ff-51d0-4328-be34-b7c110358c95", "bridge": "br-int", "label": "tempest-device-tagging-net2-545564459", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de67e88-37", "ovs_interfaceid": "1de67e88-3745-4d54-9b30-17d82513265f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:23 user nova-compute[73104]: INFO os_vif [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:82:c2,bridge_name='br-int',has_traffic_filtering=True,id=4f31240a-f297-42c8-a9f5-65c64322c486,network=Network(61837c4d-d9ee-4ec5-be90-336082e4264e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f31240a-f2')
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-923765678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-923765678',id=11,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGYu7jnGjsMQMqrqqsnYZ+Rr2o1t2Pb+ktqLbI/eRVG3arD3uw99tX2o2eiIeA2ClXnduicOGInmHlnfRP03ohy6EG9X7PW2YhVQTFMQ+eJ45e4EFYaspRmSOv26WCnjw==',key_name='tempest-keypair-269369520',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:39:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27c658028a274117a30ecb831e50ddbb',ramdisk_id='',reservation_id='r-45ekea2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-834543942',owner_user_name='tempest-TaggedBootDevicesTest_v242-834543942-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:39:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5592a07f52b84dc9aa87f20bc1b9f0d6',uuid=7170b5a8-12a7-4ddf-8089-fde172570fd1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8469badb-d912-4a8d-ba41-cf4a04664c73", "address": "fa:16:3e:8c:2c:5b", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8469badb-d9", "ovs_interfaceid": "8469badb-d912-4a8d-ba41-cf4a04664c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converting VIF {"id": "8469badb-d912-4a8d-ba41-cf4a04664c73", "address": "fa:16:3e:8c:2c:5b", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8469badb-d9", "ovs_interfaceid": "8469badb-d912-4a8d-ba41-cf4a04664c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:2c:5b,bridge_name='br-int',has_traffic_filtering=True,id=8469badb-d912-4a8d-ba41-cf4a04664c73,network=Network(b7e93d48-5c6e-4585-bc10-800a113733c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8469badb-d9') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG os_vif [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:2c:5b,bridge_name='br-int',has_traffic_filtering=True,id=8469badb-d912-4a8d-ba41-cf4a04664c73,network=Network(b7e93d48-5c6e-4585-bc10-800a113733c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8469badb-d9') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8469badb-d9, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG os_brick.utils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.059s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f47564-b356-4d4c-94bf-822d6a38305e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:23 user nova-compute[73104]: INFO os_vif [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:2c:5b,bridge_name='br-int',has_traffic_filtering=True,id=8469badb-d912-4a8d-ba41-cf4a04664c73,network=Network(b7e93d48-5c6e-4585-bc10-800a113733c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8469badb-d9')
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-923765678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-923765678',id=11,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGYu7jnGjsMQMqrqqsnYZ+Rr2o1t2Pb+ktqLbI/eRVG3arD3uw99tX2o2eiIeA2ClXnduicOGInmHlnfRP03ohy6EG9X7PW2YhVQTFMQ+eJ45e4EFYaspRmSOv26WCnjw==',key_name='tempest-keypair-269369520',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:39:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27c658028a274117a30ecb831e50ddbb',ramdisk_id='',reservation_id='r-45ekea2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-834543942',owner_user_name='tempest-TaggedBootDevicesTest_v242-834543942-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:39:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5592a07f52b84dc9aa87f20bc1b9f0d6',uuid=7170b5a8-12a7-4ddf-8089-fde172570fd1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b", "address": "fa:16:3e:f8:62:20", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa218cb-82", "ovs_interfaceid": "4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converting VIF {"id": "4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b", "address": "fa:16:3e:f8:62:20", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa218cb-82", "ovs_interfaceid": "4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:62:20,bridge_name='br-int',has_traffic_filtering=True,id=4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b,network=Network(b7e93d48-5c6e-4585-bc10-800a113733c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4fa218cb-82') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG os_vif [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:62:20,bridge_name='br-int',has_traffic_filtering=True,id=4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b,network=Network(b7e93d48-5c6e-4585-bc10-800a113733c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4fa218cb-82') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.048s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31241a8-26b1-4181-9715-940c00239460]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4fa218cb-82, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-cace8ce8-8de7-42b2-9137-746f95190e74 req-400693ba-fb12-482f-b7b6-7688453da1c0 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-plugged-8469badb-d912-4a8d-ba41-cf4a04664c73 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-cace8ce8-8de7-42b2-9137-746f95190e74 req-400693ba-fb12-482f-b7b6-7688453da1c0 service nova] Acquiring lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-cace8ce8-8de7-42b2-9137-746f95190e74 req-400693ba-fb12-482f-b7b6-7688453da1c0 service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-cace8ce8-8de7-42b2-9137-746f95190e74 req-400693ba-fb12-482f-b7b6-7688453da1c0 service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-cace8ce8-8de7-42b2-9137-746f95190e74 req-400693ba-fb12-482f-b7b6-7688453da1c0 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] No waiting events found dispatching network-vif-plugged-8469badb-d912-4a8d-ba41-cf4a04664c73 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:23 user nova-compute[73104]: WARNING nova.compute.manager [req-cace8ce8-8de7-42b2-9137-746f95190e74 req-400693ba-fb12-482f-b7b6-7688453da1c0 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received unexpected event network-vif-plugged-8469badb-d912-4a8d-ba41-cf4a04664c73 for instance with vm_state active and task_state deleting.
Aug 26 08:41:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-da3201aa-5211-4707-a902-12d71f8b7b78 req-555a40a1-340b-4434-b35d-a3a6b4a1a760 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Detach interface failed, port_id=949f6e6c-727e-440c-b767-caf76f3f037e, reason: Instance e2ec2788-98c7-48a7-933a-433dc215d7ec could not be found. {{(pid=73104) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-da3201aa-5211-4707-a902-12d71f8b7b78 req-555a40a1-340b-4434-b35d-a3a6b4a1a760 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-plugged-8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-da3201aa-5211-4707-a902-12d71f8b7b78 req-555a40a1-340b-4434-b35d-a3a6b4a1a760 service nova] Acquiring lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-da3201aa-5211-4707-a902-12d71f8b7b78 req-555a40a1-340b-4434-b35d-a3a6b4a1a760 service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-da3201aa-5211-4707-a902-12d71f8b7b78 req-555a40a1-340b-4434-b35d-a3a6b4a1a760 service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-da3201aa-5211-4707-a902-12d71f8b7b78 req-555a40a1-340b-4434-b35d-a3a6b4a1a760 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] No waiting events found dispatching network-vif-plugged-8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:23 user nova-compute[73104]: WARNING nova.compute.manager [req-da3201aa-5211-4707-a902-12d71f8b7b78 req-555a40a1-340b-4434-b35d-a3a6b4a1a760 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received unexpected event network-vif-plugged-8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56 for instance with vm_state active and task_state deleting.
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-da3201aa-5211-4707-a902-12d71f8b7b78 req-555a40a1-340b-4434-b35d-a3a6b4a1a760 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-deleted-2bb400c7-1a44-427c-a38e-860f71f92d31 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:23 user nova-compute[73104]: INFO nova.compute.manager [req-da3201aa-5211-4707-a902-12d71f8b7b78 req-555a40a1-340b-4434-b35d-a3a6b4a1a760 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Neutron deleted interface 2bb400c7-1a44-427c-a38e-860f71f92d31; detaching it from the instance and deleting it from the info cache
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.network.neutron [req-da3201aa-5211-4707-a902-12d71f8b7b78 req-555a40a1-340b-4434-b35d-a3a6b4a1a760 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Updating instance_info_cache with network_info: [{"id": "d7cb8b02-8579-43e0-b058-2cbe69bf0edf", "address": "fa:16:3e:72:2b:2a", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cb8b02-85", "ovs_interfaceid": "d7cb8b02-8579-43e0-b058-2cbe69bf0edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "55fb8a61-3cfe-422c-af91-ca5199362cc7", "address": "fa:16:3e:04:77:77", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fb8a61-3c", "ovs_interfaceid": "55fb8a61-3cfe-422c-af91-ca5199362cc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0cf8f75c-539b-44d0-bc4a-a52f86a24d9c", "address": "fa:16:3e:50:f5:ca", "network": {"id": "8af7a9e2-545f-4a40-9479-22ad7dabf51a", "bridge": "br-int", "label": "tempest-device-tagging-net1-91342658", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf8f75c-53", "ovs_interfaceid": "0cf8f75c-539b-44d0-bc4a-a52f86a24d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1de67e88-3745-4d54-9b30-17d82513265f", "address": "fa:16:3e:b3:77:f4", "network": {"id": "b98d43ff-51d0-4328-be34-b7c110358c95", "bridge": "br-int", "label": "tempest-device-tagging-net2-545564459", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac7989e8c5da415a9ccf66845b0d831c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de67e88-37", "ovs_interfaceid": "1de67e88-3745-4d54-9b30-17d82513265f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.030s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e65eb8-944e-446e-b020-3bd1e82ffdfd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[645ef212-bd3b-44c4-997b-368909d2b53c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:41:23 user nova-compute[73104]: INFO os_vif [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:62:20,bridge_name='br-int',has_traffic_filtering=True,id=4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b,network=Network(b7e93d48-5c6e-4585-bc10-800a113733c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4fa218cb-82')
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-923765678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-923765678',id=11,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGYu7jnGjsMQMqrqqsnYZ+Rr2o1t2Pb+ktqLbI/eRVG3arD3uw99tX2o2eiIeA2ClXnduicOGInmHlnfRP03ohy6EG9X7PW2YhVQTFMQ+eJ45e4EFYaspRmSOv26WCnjw==',key_name='tempest-keypair-269369520',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:39:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27c658028a274117a30ecb831e50ddbb',ramdisk_id='',reservation_id='r-45ekea2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-834543942',owner_user_name='tempest-TaggedBootDevicesTest_v242-834543942-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:39:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5592a07f52b84dc9aa87f20bc1b9f0d6',uuid=7170b5a8-12a7-4ddf-8089-fde172570fd1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c7615d3-d6db-4a04-884b-34ad12ed49ab", "address": "fa:16:3e:5b:13:e7", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7615d3-d6", "ovs_interfaceid": "7c7615d3-d6db-4a04-884b-34ad12ed49ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converting VIF {"id": "7c7615d3-d6db-4a04-884b-34ad12ed49ab", "address": "fa:16:3e:5b:13:e7", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7615d3-d6", "ovs_interfaceid": "7c7615d3-d6db-4a04-884b-34ad12ed49ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:13:e7,bridge_name='br-int',has_traffic_filtering=True,id=7c7615d3-d6db-4a04-884b-34ad12ed49ab,network=Network(b7e93d48-5c6e-4585-bc10-800a113733c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7615d3-d6') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG os_vif [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:13:e7,bridge_name='br-int',has_traffic_filtering=True,id=7c7615d3-d6db-4a04-884b-34ad12ed49ab,network=Network(b7e93d48-5c6e-4585-bc10-800a113733c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7615d3-d6') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c7615d3-d6, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:41:23 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:41:23 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4db025c-096e-411f-bbbc-3a303b2303bd]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:23 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_brick.utils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] <== get_connector_properties: return (385ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.compute.manager [req-da3201aa-5211-4707-a902-12d71f8b7b78 req-555a40a1-340b-4434-b35d-a3a6b4a1a760 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Detach interface failed, port_id=2bb400c7-1a44-427c-a38e-860f71f92d31, reason: Instance e2ec2788-98c7-48a7-933a-433dc215d7ec could not be found. {{(pid=73104) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:24 user nova-compute[73104]: INFO os_vif [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:13:e7,bridge_name='br-int',has_traffic_filtering=True,id=7c7615d3-d6db-4a04-884b-34ad12ed49ab,network=Network(b7e93d48-5c6e-4585-bc10-800a113733c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7615d3-d6')
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-923765678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-923765678',id=11,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGYu7jnGjsMQMqrqqsnYZ+Rr2o1t2Pb+ktqLbI/eRVG3arD3uw99tX2o2eiIeA2ClXnduicOGInmHlnfRP03ohy6EG9X7PW2YhVQTFMQ+eJ45e4EFYaspRmSOv26WCnjw==',key_name='tempest-keypair-269369520',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:39:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27c658028a274117a30ecb831e50ddbb',ramdisk_id='',reservation_id='r-45ekea2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-834543942',owner_user_name='tempest-TaggedBootDevicesTest_v242-834543942-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:39:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5592a07f52b84dc9aa87f20bc1b9f0d6',uuid=7170b5a8-12a7-4ddf-8089-fde172570fd1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56", "address": "fa:16:3e:11:48:11", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9e4cb8-1b", "ovs_interfaceid": "8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converting VIF {"id": "8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56", "address": "fa:16:3e:11:48:11", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9e4cb8-1b", "ovs_interfaceid": "8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:48:11,bridge_name='br-int',has_traffic_filtering=True,id=8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56,network=Network(b7e93d48-5c6e-4585-bc10-800a113733c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9e4cb8-1b') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_vif [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:48:11,bridge_name='br-int',has_traffic_filtering=True,id=8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56,network=Network(b7e93d48-5c6e-4585-bc10-800a113733c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9e4cb8-1b') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b9e4cb8-1b, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:24 user nova-compute[73104]: INFO os_vif [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:48:11,bridge_name='br-int',has_traffic_filtering=True,id=8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56,network=Network(b7e93d48-5c6e-4585-bc10-800a113733c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9e4cb8-1b')
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-923765678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-923765678',id=11,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGYu7jnGjsMQMqrqqsnYZ+Rr2o1t2Pb+ktqLbI/eRVG3arD3uw99tX2o2eiIeA2ClXnduicOGInmHlnfRP03ohy6EG9X7PW2YhVQTFMQ+eJ45e4EFYaspRmSOv26WCnjw==',key_name='tempest-keypair-269369520',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:39:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27c658028a274117a30ecb831e50ddbb',ramdisk_id='',reservation_id='r-45ekea2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-834543942',owner_user_name='tempest-TaggedBootDevicesTest_v242-834543942-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:39:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5592a07f52b84dc9aa87f20bc1b9f0d6',uuid=7170b5a8-12a7-4ddf-8089-fde172570fd1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e77e909b-af87-4825-b30b-a7062763e3ea", "address": "fa:16:3e:85:9b:36", "network": {"id": "4138826a-130b-48c0-b315-122e80d369ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680959749", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77e909b-af", "ovs_interfaceid": "e77e909b-af87-4825-b30b-a7062763e3ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converting VIF {"id": "e77e909b-af87-4825-b30b-a7062763e3ea", "address": "fa:16:3e:85:9b:36", "network": {"id": "4138826a-130b-48c0-b315-122e80d369ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680959749", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77e909b-af", "ovs_interfaceid": "e77e909b-af87-4825-b30b-a7062763e3ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:9b:36,bridge_name='br-int',has_traffic_filtering=True,id=e77e909b-af87-4825-b30b-a7062763e3ea,network=Network(4138826a-130b-48c0-b315-122e80d369ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape77e909b-af') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_vif [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:9b:36,bridge_name='br-int',has_traffic_filtering=True,id=e77e909b-af87-4825-b30b-a7062763e3ea,network=Network(4138826a-130b-48c0-b315-122e80d369ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape77e909b-af') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape77e909b-af, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:24 user nova-compute[73104]: INFO os_vif [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:9b:36,bridge_name='br-int',has_traffic_filtering=True,id=e77e909b-af87-4825-b30b-a7062763e3ea,network=Network(4138826a-130b-48c0-b315-122e80d369ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape77e909b-af')
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:38:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-923765678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-923765678',id=11,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGYu7jnGjsMQMqrqqsnYZ+Rr2o1t2Pb+ktqLbI/eRVG3arD3uw99tX2o2eiIeA2ClXnduicOGInmHlnfRP03ohy6EG9X7PW2YhVQTFMQ+eJ45e4EFYaspRmSOv26WCnjw==',key_name='tempest-keypair-269369520',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:39:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27c658028a274117a30ecb831e50ddbb',ramdisk_id='',reservation_id='r-45ekea2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-834543942',owner_user_name='tempest-TaggedBootDevicesTest_v242-834543942-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:39:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5592a07f52b84dc9aa87f20bc1b9f0d6',uuid=7170b5a8-12a7-4ddf-8089-fde172570fd1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7aabcef5-79f9-4f25-b095-ac587d15a460", "address": "fa:16:3e:e6:4e:9b", "network": {"id": "4138826a-130b-48c0-b315-122e80d369ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680959749", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aabcef5-79", "ovs_interfaceid": "7aabcef5-79f9-4f25-b095-ac587d15a460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converting VIF {"id": "7aabcef5-79f9-4f25-b095-ac587d15a460", "address": "fa:16:3e:e6:4e:9b", "network": {"id": "4138826a-130b-48c0-b315-122e80d369ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680959749", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aabcef5-79", "ovs_interfaceid": "7aabcef5-79f9-4f25-b095-ac587d15a460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:4e:9b,bridge_name='br-int',has_traffic_filtering=True,id=7aabcef5-79f9-4f25-b095-ac587d15a460,network=Network(4138826a-130b-48c0-b315-122e80d369ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aabcef5-79') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_vif [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:4e:9b,bridge_name='br-int',has_traffic_filtering=True,id=7aabcef5-79f9-4f25-b095-ac587d15a460,network=Network(4138826a-130b-48c0-b315-122e80d369ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aabcef5-79') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7aabcef5-79, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:41:24 user nova-compute[73104]: INFO os_vif [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:4e:9b,bridge_name='br-int',has_traffic_filtering=True,id=7aabcef5-79f9-4f25-b095-ac587d15a460,network=Network(4138826a-130b-48c0-b315-122e80d369ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aabcef5-79')
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ODzqpdnV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:41:24 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f206b7b1-2c3b-4bc1-b8ef-5d13a64c1fb2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cf9952-f41d-4d7c-904d-4d1d7ab7fa8e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:41:24 user nova-compute[73104]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)
Aug 26 08:41:24 user nova-compute[73104]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:41:24 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:41:24 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:41:24 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:41:24 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:41:24 user nova-compute[73104]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)
Aug 26 08:41:24 user nova-compute[73104]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:41:24 user nova-compute[73104]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 (non-flash)
Aug 26 08:41:24 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:41:24 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:41:24 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0c41a3760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75'): ({'sde'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Removing single pathed devices sde {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae72025-56a4-4ae9-b6d2-056efe266dbd]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ced85ff-ba9f-4a8c-851d-bc3a6205023a]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Flushing IO for device /dev/sde {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28e7979-3aa3-4c73-9c3c-2f3ab4f0ea3f]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1f2640-822f-48ca-957d-e8ea6128126d]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] SCSI volumes sde have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[756b2f36-cd45-448a-8658-62abf69aa9f5]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 -p 172.16.0.220:3260 --logout" returned: 0 in 0.139s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0399585-d970-4e1b-8eee-20a1e3ceefd6]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75, portal: 172.16.0.220,3260]
Aug 26 08:41:24 user nova-compute[73104]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75, portal: 172.16.0.220,3260] successful.
Aug 26 08:41:24 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6fd7c84-07ca-43be-9dc8-66cecc82ab75 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d7bcaa-3d96-4017-9152-eb45ae23380e]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.480s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] <== disconnect_volume: return (482ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yOTASVcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:41:24 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.129s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c8250e-f864-431e-9e06-0e18fdd9f5e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 -F raw /opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk" returned: 0 in 3.770s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Ensure instance console log exists: /opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Start _get_guest_xml network_info=[{"id": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "address": "fa:16:3e:65:0d:e0", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a3e387d-f6", "ovs_interfaceid": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='cb3f8f0bd148c346af4ba1f598934e8d',container_format='bare',created_at=2023-08-26T08:39:04Z,direct_url=<?>,disk_format='qcow2',id=61716b59-ca97-49ea-b9af-d53731069806,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-123632046-shelved',owner='770daa2e8b274a9b828e489c1573ced4',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T08:39:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'fc233ecc-221c-4a86-9d48-396cc9dcef74', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeTRDnvu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '94de2062-7017-44fe-8df0-0a3cd63d5498', 'attached_at': '', 'detached_at': '', 'volume_id': '5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80', 'serial': '5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[168b1f2a-aaae-49d3-b2f3-315867dec9f2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:41:24 user nova-compute[73104]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)
Aug 26 08:41:24 user nova-compute[73104]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:41:24 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:41:24 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:41:24 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:41:24 user nova-compute[73104]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)
Aug 26 08:41:24 user nova-compute[73104]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:41:24 user nova-compute[73104]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a (non-flash)
Aug 26 08:41:24 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:41:24 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0c41a3760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a'): ({'sdf'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Removing single pathed devices sdf {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:24 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:41:24 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='cb3f8f0bd148c346af4ba1f598934e8d',container_format='bare',created_at=2023-08-26T08:39:04Z,direct_url=<?>,disk_format='qcow2',id=61716b59-ca97-49ea-b9af-d53731069806,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-123632046-shelved',owner='770daa2e8b274a9b828e489c1573ced4',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T08:39:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.objects.instance [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lazy-loading 'vcpu_model' on Instance uuid 94de2062-7017-44fe-8df0-0a3cd63d5498 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.043s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a08325-eaca-4adf-9bc2-318a04adbd8b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.objects.base [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Object Instance<94de2062-7017-44fe-8df0-0a3cd63d5498> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeTRDnvu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:41:24 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9626dc-3532-4788-9f80-f0690d60a693]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Flushing IO for device /dev/sdf {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b516142c-4475-48f1-8cb6-c39e20c114fd]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.069s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[105a8369-831f-4c90-b42c-2ae829379282]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] SCSI volumes sdf have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.076s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a3342e-5923-46c3-8304-05a7b0e69b5b]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad4f7dc-b4f7-4b17-b196-5b4ed240828b]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a, portal: 172.16.0.220,3260]
Aug 26 08:41:25 user nova-compute[73104]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a, portal: 172.16.0.220,3260] successful.
Aug 26 08:41:25 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:213ace90-56d6-43cc-8af2-78f1ffe4b49a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3d85e5-e138-4e14-a2d6-0e38555c1459]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.632s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] <== disconnect_volume: return (634ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.310s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:41:25 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:41:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:41:25 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nzalZsvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:41:25 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:41:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f2063b-a714-4178-aa6d-b6a74258ee6c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:41:25 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:25 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Took 9.68 seconds to deallocate network for instance.
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadbdb33-16dd-4394-8bca-6ebaceb40e27]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80] added
Aug 26 08:41:25 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdea2367-5cea-4159-82a6-ab00054fa916]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16d8723-6990-4004-a9cb-e3f4fcad10af]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JeTRDnvu {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JeTRDnvu" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5da9f68-f060-4b52-adf6-cb831f84f36e]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JeTRDnvu'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.046s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7ec061-1121-4dc6-aa80-f03ae7ef1493]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eaeff47-9571-45ab-84b1-45cbf3d59cc0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:41:25 user nova-compute[73104]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)
Aug 26 08:41:25 user nova-compute[73104]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:41:25 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:41:25 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:41:25 user nova-compute[73104]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)
Aug 26 08:41:25 user nova-compute[73104]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:41:25 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:41:25 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG nova.compute.manager [req-28f50240-4cc9-42fb-9c68-14c20be9ca47 req-9be98650-d66a-4230-97c3-da534bd74cca service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-plugged-e77e909b-af87-4825-b30b-a7062763e3ea {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-28f50240-4cc9-42fb-9c68-14c20be9ca47 req-9be98650-d66a-4230-97c3-da534bd74cca service nova] Acquiring lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-28f50240-4cc9-42fb-9c68-14c20be9ca47 req-9be98650-d66a-4230-97c3-da534bd74cca service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-28f50240-4cc9-42fb-9c68-14c20be9ca47 req-9be98650-d66a-4230-97c3-da534bd74cca service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG nova.compute.manager [req-28f50240-4cc9-42fb-9c68-14c20be9ca47 req-9be98650-d66a-4230-97c3-da534bd74cca service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] No waiting events found dispatching network-vif-plugged-e77e909b-af87-4825-b30b-a7062763e3ea {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:25 user nova-compute[73104]: WARNING nova.compute.manager [req-28f50240-4cc9-42fb-9c68-14c20be9ca47 req-9be98650-d66a-4230-97c3-da534bd74cca service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received unexpected event network-vif-plugged-e77e909b-af87-4825-b30b-a7062763e3ea for instance with vm_state active and task_state deleting.
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 -p 172.16.0.220:3260 --login" returned: 0 in 0.256s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b585db9-b886-43ee-b2ab-a6d1593372b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80, portal: 172.16.0.220,3260]
Aug 26 08:41:25 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80, portal: 172.16.0.220,3260] successful.
Aug 26 08:41:25 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e564f64c-e07e-4bfd-88ef-d44c0275821a]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6086710-9919-4395-af87-b872373940a9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:41:25 user nova-compute[73104]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)
Aug 26 08:41:25 user nova-compute[73104]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:41:25 user nova-compute[73104]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 (non-flash)
Aug 26 08:41:25 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:41:25 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:41:25 user nova-compute[73104]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)
Aug 26 08:41:25 user nova-compute[73104]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:41:25 user nova-compute[73104]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 (non-flash)
Aug 26 08:41:25 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:41:25 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.602s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4ee1a2-42b5-4ff4-bcef-56510f26eee5]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeTRDnvu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG nova.compute.manager [req-239710d8-74ec-4065-9626-5db8dc5f28df req-7ab94a3e-c670-4ae8-ac9e-34791b3baa31 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-unplugged-4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-239710d8-74ec-4065-9626-5db8dc5f28df req-7ab94a3e-c670-4ae8-ac9e-34791b3baa31 service nova] Acquiring lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-239710d8-74ec-4065-9626-5db8dc5f28df req-7ab94a3e-c670-4ae8-ac9e-34791b3baa31 service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-239710d8-74ec-4065-9626-5db8dc5f28df req-7ab94a3e-c670-4ae8-ac9e-34791b3baa31 service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG nova.compute.manager [req-239710d8-74ec-4065-9626-5db8dc5f28df req-7ab94a3e-c670-4ae8-ac9e-34791b3baa31 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] No waiting events found dispatching network-vif-unplugged-4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG nova.compute.manager [req-239710d8-74ec-4065-9626-5db8dc5f28df req-7ab94a3e-c670-4ae8-ac9e-34791b3baa31 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-unplugged-4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG nova.compute.manager [req-239710d8-74ec-4065-9626-5db8dc5f28df req-7ab94a3e-c670-4ae8-ac9e-34791b3baa31 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-plugged-4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-239710d8-74ec-4065-9626-5db8dc5f28df req-7ab94a3e-c670-4ae8-ac9e-34791b3baa31 service nova] Acquiring lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-239710d8-74ec-4065-9626-5db8dc5f28df req-7ab94a3e-c670-4ae8-ac9e-34791b3baa31 service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-239710d8-74ec-4065-9626-5db8dc5f28df req-7ab94a3e-c670-4ae8-ac9e-34791b3baa31 service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG nova.compute.manager [req-239710d8-74ec-4065-9626-5db8dc5f28df req-7ab94a3e-c670-4ae8-ac9e-34791b3baa31 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] No waiting events found dispatching network-vif-plugged-4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:25 user nova-compute[73104]: WARNING nova.compute.manager [req-239710d8-74ec-4065-9626-5db8dc5f28df req-7ab94a3e-c670-4ae8-ac9e-34791b3baa31 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received unexpected event network-vif-plugged-4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b for instance with vm_state active and task_state deleting.
Aug 26 08:41:25 user nova-compute[73104]: DEBUG nova.compute.manager [req-239710d8-74ec-4065-9626-5db8dc5f28df req-7ab94a3e-c670-4ae8-ac9e-34791b3baa31 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-unplugged-7aabcef5-79f9-4f25-b095-ac587d15a460 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-239710d8-74ec-4065-9626-5db8dc5f28df req-7ab94a3e-c670-4ae8-ac9e-34791b3baa31 service nova] Acquiring lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-239710d8-74ec-4065-9626-5db8dc5f28df req-7ab94a3e-c670-4ae8-ac9e-34791b3baa31 service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-239710d8-74ec-4065-9626-5db8dc5f28df req-7ab94a3e-c670-4ae8-ac9e-34791b3baa31 service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG nova.compute.manager [req-239710d8-74ec-4065-9626-5db8dc5f28df req-7ab94a3e-c670-4ae8-ac9e-34791b3baa31 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] No waiting events found dispatching network-vif-unplugged-7aabcef5-79f9-4f25-b095-ac587d15a460 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG nova.compute.manager [req-239710d8-74ec-4065-9626-5db8dc5f28df req-7ab94a3e-c670-4ae8-ac9e-34791b3baa31 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-unplugged-7aabcef5-79f9-4f25-b095-ac587d15a460 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG nova.compute.manager [req-239710d8-74ec-4065-9626-5db8dc5f28df req-7ab94a3e-c670-4ae8-ac9e-34791b3baa31 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-plugged-7aabcef5-79f9-4f25-b095-ac587d15a460 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-239710d8-74ec-4065-9626-5db8dc5f28df req-7ab94a3e-c670-4ae8-ac9e-34791b3baa31 service nova] Acquiring lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-239710d8-74ec-4065-9626-5db8dc5f28df req-7ab94a3e-c670-4ae8-ac9e-34791b3baa31 service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-239710d8-74ec-4065-9626-5db8dc5f28df req-7ab94a3e-c670-4ae8-ac9e-34791b3baa31 service nova] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:25 user nova-compute[73104]: DEBUG nova.compute.manager [req-239710d8-74ec-4065-9626-5db8dc5f28df req-7ab94a3e-c670-4ae8-ac9e-34791b3baa31 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] No waiting events found dispatching network-vif-plugged-7aabcef5-79f9-4f25-b095-ac587d15a460 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:25 user nova-compute[73104]: WARNING nova.compute.manager [req-239710d8-74ec-4065-9626-5db8dc5f28df req-7ab94a3e-c670-4ae8-ac9e-34791b3baa31 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received unexpected event network-vif-plugged-7aabcef5-79f9-4f25-b095-ac587d15a460 for instance with vm_state active and task_state deleting.
Aug 26 08:41:26 user nova-compute[73104]: DEBUG nova.compute.manager [req-6807aca4-d5a4-4ad0-af78-7205fae970bd req-33493d05-a117-42ed-8e07-618edd404442 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-deleted-1de67e88-3745-4d54-9b30-17d82513265f {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:26 user nova-compute[73104]: DEBUG nova.compute.manager [req-6807aca4-d5a4-4ad0-af78-7205fae970bd req-33493d05-a117-42ed-8e07-618edd404442 service nova] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Received event network-vif-deleted-0cf8f75c-539b-44d0-bc4a-a52f86a24d9c {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.653s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:41:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] <== connect_volume: return (1963ms) {'type': 'block', 'scsi_wwn': '26631333335313731', 'path': '/dev/sdb'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:41:26 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631333335313731', 'path': '/dev/sdb'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:41:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.644s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:41:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:41:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49279e6-8015-425a-970a-ba68ad664a2a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:26 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T08:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-123632046',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-123632046',id=3,image_ref='61716b59-ca97-49ea-b9af-d53731069806',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1165821836',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:37:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='770daa2e8b274a9b828e489c1573ced4',ramdisk_id='',reservation_id='r-2y3651sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2062858766',owner_user_name='tempest-AttachVolumeShelveTestJSON-2062858766-project-member',shelved_at='2023-08-26T08:39:08.631315',shelved_host='user',shelved_image_id='61716b59-ca97-49ea-b9af-d53731069806'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:40:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db3ae37701df47a5b35026fe3857bc51',uuid=94de2062-7017-44fe-8df0-0a3cd63d5498,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "address": "fa:16:3e:65:0d:e0", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a3e387d-f6", "ovs_interfaceid": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:41:26 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Converting VIF {"id": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "address": "fa:16:3e:65:0d:e0", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a3e387d-f6", "ovs_interfaceid": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:41:26 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:0d:e0,bridge_name='br-int',has_traffic_filtering=True,id=4a3e387d-f638-43fc-bdef-4c0b608d29d4,network=Network(38f7ec35-12eb-46fe-a425-51ee854d804d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a3e387d-f6') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:41:26 user nova-compute[73104]: DEBUG nova.objects.instance [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lazy-loading 'pci_devices' on Instance uuid 94de2062-7017-44fe-8df0-0a3cd63d5498 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:41:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec1007d-f2c8-4229-92e1-e6467f5542be]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:41:27 user nova-compute[73104]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)
Aug 26 08:41:27 user nova-compute[73104]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:41:27 user nova-compute[73104]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 (non-flash)
Aug 26 08:41:27 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:41:27 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:41:27 user nova-compute[73104]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)
Aug 26 08:41:27 user nova-compute[73104]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:41:27 user nova-compute[73104]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 (non-flash)
Aug 26 08:41:27 user nova-compute[73104]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd (non-flash)
Aug 26 08:41:27 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0c41bd5a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd'): ({'sdg'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Removing single pathed devices sdg {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG nova.objects.base [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Object Instance<94de2062-7017-44fe-8df0-0a3cd63d5498> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:41:27 user nova-compute[73104]:   <uuid>94de2062-7017-44fe-8df0-0a3cd63d5498</uuid>
Aug 26 08:41:27 user nova-compute[73104]:   <name>instance-00000003</name>
Aug 26 08:41:27 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:41:27 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:41:27 user nova-compute[73104]:   <metadata>
Aug 26 08:41:27 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:41:27 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:41:27 user nova-compute[73104]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-123632046</nova:name>
Aug 26 08:41:27 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:41:24</nova:creationTime>
Aug 26 08:41:27 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:41:27 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:41:27 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:41:27 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:41:27 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:41:27 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:41:27 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:41:27 user nova-compute[73104]:       <nova:owner>
Aug 26 08:41:27 user nova-compute[73104]:         <nova:user uuid="db3ae37701df47a5b35026fe3857bc51">tempest-AttachVolumeShelveTestJSON-2062858766-project-member</nova:user>
Aug 26 08:41:27 user nova-compute[73104]:         <nova:project uuid="770daa2e8b274a9b828e489c1573ced4">tempest-AttachVolumeShelveTestJSON-2062858766</nova:project>
Aug 26 08:41:27 user nova-compute[73104]:       </nova:owner>
Aug 26 08:41:27 user nova-compute[73104]:       <nova:root type="image" uuid="61716b59-ca97-49ea-b9af-d53731069806"/>
Aug 26 08:41:27 user nova-compute[73104]:       <nova:ports>
Aug 26 08:41:27 user nova-compute[73104]:         <nova:port uuid="4a3e387d-f638-43fc-bdef-4c0b608d29d4">
Aug 26 08:41:27 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 08:41:27 user nova-compute[73104]:         </nova:port>
Aug 26 08:41:27 user nova-compute[73104]:       </nova:ports>
Aug 26 08:41:27 user nova-compute[73104]:     </nova:instance>
Aug 26 08:41:27 user nova-compute[73104]:   </metadata>
Aug 26 08:41:27 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:41:27 user nova-compute[73104]:     <system>
Aug 26 08:41:27 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:41:27 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:41:27 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:41:27 user nova-compute[73104]:       <entry name="serial">94de2062-7017-44fe-8df0-0a3cd63d5498</entry>
Aug 26 08:41:27 user nova-compute[73104]:       <entry name="uuid">94de2062-7017-44fe-8df0-0a3cd63d5498</entry>
Aug 26 08:41:27 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:41:27 user nova-compute[73104]:     </system>
Aug 26 08:41:27 user nova-compute[73104]:   </sysinfo>
Aug 26 08:41:27 user nova-compute[73104]:   <os>
Aug 26 08:41:27 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:41:27 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:41:27 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:41:27 user nova-compute[73104]:   </os>
Aug 26 08:41:27 user nova-compute[73104]:   <features>
Aug 26 08:41:27 user nova-compute[73104]:     <acpi/>
Aug 26 08:41:27 user nova-compute[73104]:     <apic/>
Aug 26 08:41:27 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:41:27 user nova-compute[73104]:   </features>
Aug 26 08:41:27 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:41:27 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:41:27 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:41:27 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:41:27 user nova-compute[73104]:   </clock>
Aug 26 08:41:27 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:41:27 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:41:27 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:41:27 user nova-compute[73104]:   </cpu>
Aug 26 08:41:27 user nova-compute[73104]:   <devices>
Aug 26 08:41:27 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:41:27 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:41:27 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk"/>
Aug 26 08:41:27 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:41:27 user nova-compute[73104]:     </disk>
Aug 26 08:41:27 user nova-compute[73104]:     <disk type="block" device="disk">
Aug 26 08:41:27 user nova-compute[73104]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:41:27 user nova-compute[73104]:       <source dev="/dev/sdb"/>
Aug 26 08:41:27 user nova-compute[73104]:       <target dev="vdc" bus="virtio"/>
Aug 26 08:41:27 user nova-compute[73104]:       <serial>5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80</serial>
Aug 26 08:41:27 user nova-compute[73104]:     </disk>
Aug 26 08:41:27 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:41:27 user nova-compute[73104]:       <mac address="fa:16:3e:65:0d:e0"/>
Aug 26 08:41:27 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:41:27 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:41:27 user nova-compute[73104]:       <target dev="tap4a3e387d-f6"/>
Aug 26 08:41:27 user nova-compute[73104]:     </interface>
Aug 26 08:41:27 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:41:27 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/console.log" append="off"/>
Aug 26 08:41:27 user nova-compute[73104]:     </serial>
Aug 26 08:41:27 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:41:27 user nova-compute[73104]:     <video>
Aug 26 08:41:27 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:41:27 user nova-compute[73104]:     </video>
Aug 26 08:41:27 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:41:27 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:41:27 user nova-compute[73104]:     </rng>
Aug 26 08:41:27 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:41:27 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:41:27 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:41:27 user nova-compute[73104]:     </memballoon>
Aug 26 08:41:27 user nova-compute[73104]:   </devices>
Aug 26 08:41:27 user nova-compute[73104]: </domain>
Aug 26 08:41:27 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T08:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-123632046',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-123632046',id=3,image_ref='61716b59-ca97-49ea-b9af-d53731069806',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1165821836',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:37:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='770daa2e8b274a9b828e489c1573ced4',ramdisk_id='',reservation_id='r-2y3651sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2062858766',owner_user_name='tempest-AttachVolumeShelveTestJSON-2062858766-project-member',shelved_at='2023-08-26T08:39:08.631315',shelved_host='user',shelved_image_id='61716b59-ca97-49ea-b9af-d53731069806'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:40:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db3ae37701df47a5b35026fe3857bc51',uuid=94de2062-7017-44fe-8df0-0a3cd63d5498,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "address": "fa:16:3e:65:0d:e0", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a3e387d-f6", "ovs_interfaceid": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Converting VIF {"id": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "address": "fa:16:3e:65:0d:e0", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a3e387d-f6", "ovs_interfaceid": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:0d:e0,bridge_name='br-int',has_traffic_filtering=True,id=4a3e387d-f638-43fc-bdef-4c0b608d29d4,network=Network(38f7ec35-12eb-46fe-a425-51ee854d804d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a3e387d-f6') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG os_vif [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:0d:e0,bridge_name='br-int',has_traffic_filtering=True,id=4a3e387d-f638-43fc-bdef-4c0b608d29d4,network=Network(38f7ec35-12eb-46fe-a425-51ee854d804d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a3e387d-f6') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a3e387d-f6, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4a3e387d-f6, col_values=(('external_ids', {'iface-id': '4a3e387d-f638-43fc-bdef-4c0b608d29d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:0d:e0', 'vm-uuid': '94de2062-7017-44fe-8df0-0a3cd63d5498'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74ececb-a58a-4fc3-a7f3-c49f5bf0048b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:27 user nova-compute[73104]: INFO os_vif [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:0d:e0,bridge_name='br-int',has_traffic_filtering=True,id=4a3e387d-f638-43fc-bdef-4c0b608d29d4,network=Network(38f7ec35-12eb-46fe-a425-51ee854d804d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a3e387d-f6')
Aug 26 08:41:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.029s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd5e36f-1696-4ff4-9ba7-c56831f2f6bb]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Flushing IO for device /dev/sdg {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8db80d-1996-4325-b3b7-e057540e7a43]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] No VIF found with MAC fa:16:3e:65:0d:e0, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-15adb5b0-21d8-4178-99b6-90c5d33ea274 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Acquiring lock "85eea82a-c221-4661-9525-06a925b57e1c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-15adb5b0-21d8-4178-99b6-90c5d33ea274 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "85eea82a-c221-4661-9525-06a925b57e1c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.059s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fe8f91-002b-4b13-855e-f9a152e0f66e]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] SCSI volumes sdg have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:27 user nova-compute[73104]: INFO nova.compute.manager [None req-15adb5b0-21d8-4178-99b6-90c5d33ea274 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Detaching volume df5d05f1-af9b-4ce1-b7fa-447815c826c5
Aug 26 08:41:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[17630a31-7aaa-41dd-b2d3-8cf4e9361696]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:27 user nova-compute[73104]: INFO nova.virt.block_device [None req-15adb5b0-21d8-4178-99b6-90c5d33ea274 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Attempting to driver detach volume df5d05f1-af9b-4ce1-b7fa-447815c826c5 from mountpoint /dev/vdb
Aug 26 08:41:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-15adb5b0-21d8-4178-99b6-90c5d33ea274 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Attempting to detach device vdb from instance 85eea82a-c221-4661-9525-06a925b57e1c from the persistent domain config. {{(pid=73104) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-15adb5b0-21d8-4178-99b6-90c5d33ea274 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:41:27 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:41:27 user nova-compute[73104]:   <source dev="/dev/sdh"/>
Aug 26 08:41:27 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:41:27 user nova-compute[73104]:   <serial>df5d05f1-af9b-4ce1-b7fa-447815c826c5</serial>
Aug 26 08:41:27 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 08:41:27 user nova-compute[73104]: </disk>
Aug 26 08:41:27 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a53cfa9-6b6f-42cc-9fb7-6af9fe2abdad]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd, portal: 172.16.0.220,3260]
Aug 26 08:41:27 user nova-compute[73104]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd, portal: 172.16.0.220,3260] successful.
Aug 26 08:41:27 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:27 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-15adb5b0-21d8-4178-99b6-90c5d33ea274 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Successfully detached device vdb from instance 85eea82a-c221-4661-9525-06a925b57e1c from the persistent domain config.
Aug 26 08:41:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-15adb5b0-21d8-4178-99b6-90c5d33ea274 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 85eea82a-c221-4661-9525-06a925b57e1c from the live domain config. {{(pid=73104) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-15adb5b0-21d8-4178-99b6-90c5d33ea274 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:41:27 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:41:27 user nova-compute[73104]:   <source dev="/dev/sdh"/>
Aug 26 08:41:27 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:41:27 user nova-compute[73104]:   <serial>df5d05f1-af9b-4ce1-b7fa-447815c826c5</serial>
Aug 26 08:41:27 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 08:41:27 user nova-compute[73104]: </disk>
Aug 26 08:41:27 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6d15a6a-b090-4ef2-bfbf-968454ababbd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3526488-9e88-4548-ba48-538c485de21f]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] <== disconnect_volume: return (2048ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:41:27 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Deleting instance files /opt/stack/data/nova/instances/7170b5a8-12a7-4ddf-8089-fde172570fd1_del
Aug 26 08:41:27 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Deletion of /opt/stack/data/nova/instances/7170b5a8-12a7-4ddf-8089-fde172570fd1_del complete
Aug 26 08:41:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Acquiring lock "85eea82a-c221-4661-9525-06a925b57e1c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:27 user nova-compute[73104]: INFO nova.compute.manager [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Took 6.74 seconds to destroy the instance on the hypervisor.
Aug 26 08:41:27 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Received event <DeviceRemovedEvent: 1693039287.9407642, 85eea82a-c221-4661-9525-06a925b57e1c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73104) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-15adb5b0-21d8-4178-99b6-90c5d33ea274 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 85eea82a-c221-4661-9525-06a925b57e1c {{(pid=73104) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 08:41:27 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-15adb5b0-21d8-4178-99b6-90c5d33ea274 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Successfully detached device vdb from instance 85eea82a-c221-4661-9525-06a925b57e1c from the live domain config.
Aug 26 08:41:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15adb5b0-21d8-4178-99b6-90c5d33ea274 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-15adb5b0-21d8-4178-99b6-90c5d33ea274 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aDcPxbdJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:41:27 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-15adb5b0-21d8-4178-99b6-90c5d33ea274 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:41:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-15adb5b0-21d8-4178-99b6-90c5d33ea274 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-15adb5b0-21d8-4178-99b6-90c5d33ea274 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-15adb5b0-21d8-4178-99b6-90c5d33ea274 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ae4405-2a2f-4c60-a312-ff3fcbd81145]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c3b1a5-c099-4eec-9e2b-d59d9d1355b3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-15adb5b0-21d8-4178-99b6-90c5d33ea274 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:41:28 user nova-compute[73104]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)
Aug 26 08:41:28 user nova-compute[73104]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:41:28 user nova-compute[73104]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 (non-flash)
Aug 26 08:41:28 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-15adb5b0-21d8-4178-99b6-90c5d33ea274 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:41:28 user nova-compute[73104]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 (non-flash)
Aug 26 08:41:28 user nova-compute[73104]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:41:28 user nova-compute[73104]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 (non-flash)
Aug 26 08:41:28 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-15adb5b0-21d8-4178-99b6-90c5d33ea274 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0cc1eb370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5'): ({'sdh'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-15adb5b0-21d8-4178-99b6-90c5d33ea274 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Removing single pathed devices sdh {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26786fe-7d38-48dd-972c-c35888ac3d29]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6c073d-3b51-4b96-9377-5e529db84d75]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-15adb5b0-21d8-4178-99b6-90c5d33ea274 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Flushing IO for device /dev/sdh {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b4f354-c26a-46a3-8410-2fd8b67590d0]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-15adb5b0-21d8-4178-99b6-90c5d33ea274 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.050s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[33895cf8-6f96-4b86-a672-c442de2ad030]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-15adb5b0-21d8-4178-99b6-90c5d33ea274 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-15adb5b0-21d8-4178-99b6-90c5d33ea274 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] SCSI volumes sdh have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-15adb5b0-21d8-4178-99b6-90c5d33ea274 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f38889f-0c47-4dd0-8e62-eb5f91b88d87]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-15adb5b0-21d8-4178-99b6-90c5d33ea274 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[13987f71-c00d-4dc6-8603-fab78860aa2a]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-15adb5b0-21d8-4178-99b6-90c5d33ea274 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5, portal: 172.16.0.220,3260]
Aug 26 08:41:28 user nova-compute[73104]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5, portal: 172.16.0.220,3260] successful.
Aug 26 08:41:28 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf154cf-2816-4cb7-85d5-265b5a6d96c3]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-15adb5b0-21d8-4178-99b6-90c5d33ea274 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-15adb5b0-21d8-4178-99b6-90c5d33ea274 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-15adb5b0-21d8-4178-99b6-90c5d33ea274 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] <== disconnect_volume: return (336ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15adb5b0-21d8-4178-99b6-90c5d33ea274 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:41:28 user nova-compute[73104]: INFO nova.compute.manager [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Took 2.97 seconds to detach 3 volumes for instance.
Aug 26 08:41:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693039273.5956066, e2ec2788-98c7-48a7-933a-433dc215d7ec => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:41:28 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] VM Stopped (Lifecycle Event)
Aug 26 08:41:28 user nova-compute[73104]: DEBUG nova.compute.manager [None req-1b878bdb-90de-4748-981e-c8f4b2d3b1ac None None] [instance: e2ec2788-98c7-48a7-933a-433dc215d7ec] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.559s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:29 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Deleted allocations for instance e2ec2788-98c7-48a7-933a-433dc215d7ec
Aug 26 08:41:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-246da80b-ac57-496e-a2e9-bb9f770c1229 tempest-TaggedBootDevicesTest-2021222373 tempest-TaggedBootDevicesTest-2021222373-project-member] Lock "e2ec2788-98c7-48a7-933a-433dc215d7ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 17.540s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:29 user nova-compute[73104]: DEBUG nova.objects.instance [None req-15adb5b0-21d8-4178-99b6-90c5d33ea274 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lazy-loading 'flavor' on Instance uuid 85eea82a-c221-4661-9525-06a925b57e1c {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:41:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-15adb5b0-21d8-4178-99b6-90c5d33ea274 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "85eea82a-c221-4661-9525-06a925b57e1c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.170s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "85eea82a-c221-4661-9525-06a925b57e1c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.965s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Acquiring lock "85eea82a-c221-4661-9525-06a925b57e1c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "85eea82a-c221-4661-9525-06a925b57e1c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "85eea82a-c221-4661-9525-06a925b57e1c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:29 user nova-compute[73104]: DEBUG nova.compute.manager [req-dbd20fe9-674c-42e5-ad99-2fab3c67a798 req-c1462405-e6dd-4fe3-b5c6-e52cdc1b03df service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Received event network-vif-plugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-dbd20fe9-674c-42e5-ad99-2fab3c67a798 req-c1462405-e6dd-4fe3-b5c6-e52cdc1b03df service nova] Acquiring lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-dbd20fe9-674c-42e5-ad99-2fab3c67a798 req-c1462405-e6dd-4fe3-b5c6-e52cdc1b03df service nova] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-dbd20fe9-674c-42e5-ad99-2fab3c67a798 req-c1462405-e6dd-4fe3-b5c6-e52cdc1b03df service nova] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:29 user nova-compute[73104]: DEBUG nova.compute.manager [req-dbd20fe9-674c-42e5-ad99-2fab3c67a798 req-c1462405-e6dd-4fe3-b5c6-e52cdc1b03df service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] No waiting events found dispatching network-vif-plugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:29 user nova-compute[73104]: WARNING nova.compute.manager [req-dbd20fe9-674c-42e5-ad99-2fab3c67a798 req-c1462405-e6dd-4fe3-b5c6-e52cdc1b03df service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Received unexpected event network-vif-plugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 08:41:29 user nova-compute[73104]: INFO nova.compute.manager [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Terminating instance
Aug 26 08:41:29 user nova-compute[73104]: DEBUG nova.compute.manager [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 08:41:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:29 user nova-compute[73104]: DEBUG nova.compute.manager [req-730108fe-72dc-4bc4-a153-87be7fc65cdf req-d1f132ae-fa86-4433-85c5-aabb7a7ca960 service nova] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Received event network-vif-unplugged-5ca70232-e7ad-4989-b581-3c9c5b983db8 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-730108fe-72dc-4bc4-a153-87be7fc65cdf req-d1f132ae-fa86-4433-85c5-aabb7a7ca960 service nova] Acquiring lock "85eea82a-c221-4661-9525-06a925b57e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-730108fe-72dc-4bc4-a153-87be7fc65cdf req-d1f132ae-fa86-4433-85c5-aabb7a7ca960 service nova] Lock "85eea82a-c221-4661-9525-06a925b57e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-730108fe-72dc-4bc4-a153-87be7fc65cdf req-d1f132ae-fa86-4433-85c5-aabb7a7ca960 service nova] Lock "85eea82a-c221-4661-9525-06a925b57e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:29 user nova-compute[73104]: DEBUG nova.compute.manager [req-730108fe-72dc-4bc4-a153-87be7fc65cdf req-d1f132ae-fa86-4433-85c5-aabb7a7ca960 service nova] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] No waiting events found dispatching network-vif-unplugged-5ca70232-e7ad-4989-b581-3c9c5b983db8 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:29 user nova-compute[73104]: DEBUG nova.compute.manager [req-730108fe-72dc-4bc4-a153-87be7fc65cdf req-d1f132ae-fa86-4433-85c5-aabb7a7ca960 service nova] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Received event network-vif-unplugged-5ca70232-e7ad-4989-b581-3c9c5b983db8 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:41:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:30 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Instance destroyed successfully.
Aug 26 08:41:30 user nova-compute[73104]: DEBUG nova.objects.instance [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lazy-loading 'resources' on Instance uuid 85eea82a-c221-4661-9525-06a925b57e1c {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:41:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:38:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2011165384',display_name='tempest-VolumesSnapshotTestJSON-instance-2011165384',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2011165384',id=9,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEnU6VxJrXTSCGsE4Tn2eKSkFawT9wsdxtiluvxLWQQolI+fGKFx0tNUohwrn59cwCUhjxQn8d4nrcJweioomRFLj00XWBPnp/gNEUHw7M/5Kn5aJi8rfV5m7f6C5GF6w==',key_name='tempest-keypair-740543947',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:38:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6cbb61cb896e4b3cbbdc04d82df1cea9',ramdisk_id='',reservation_id='r-491urjj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1828823155',owner_user_name='tempest-VolumesSnapshotTestJSON-1828823155-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:38:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aca885fd82294677abf751087bcfc5e1',uuid=85eea82a-c221-4661-9525-06a925b57e1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ca70232-e7ad-4989-b581-3c9c5b983db8", "address": "fa:16:3e:8b:1d:d1", "network": {"id": "84dc5f73-5b46-4788-8e58-69d57f2f089f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-856831086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbb61cb896e4b3cbbdc04d82df1cea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ca70232-e7", "ovs_interfaceid": "5ca70232-e7ad-4989-b581-3c9c5b983db8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:41:30 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Converting VIF {"id": "5ca70232-e7ad-4989-b581-3c9c5b983db8", "address": "fa:16:3e:8b:1d:d1", "network": {"id": "84dc5f73-5b46-4788-8e58-69d57f2f089f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-856831086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbb61cb896e4b3cbbdc04d82df1cea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ca70232-e7", "ovs_interfaceid": "5ca70232-e7ad-4989-b581-3c9c5b983db8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:41:30 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:1d:d1,bridge_name='br-int',has_traffic_filtering=True,id=5ca70232-e7ad-4989-b581-3c9c5b983db8,network=Network(84dc5f73-5b46-4788-8e58-69d57f2f089f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ca70232-e7') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:41:30 user nova-compute[73104]: DEBUG os_vif [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:1d:d1,bridge_name='br-int',has_traffic_filtering=True,id=5ca70232-e7ad-4989-b581-3c9c5b983db8,network=Network(84dc5f73-5b46-4788-8e58-69d57f2f089f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ca70232-e7') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:41:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ca70232-e7, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:41:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:41:30 user nova-compute[73104]: INFO os_vif [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:1d:d1,bridge_name='br-int',has_traffic_filtering=True,id=5ca70232-e7ad-4989-b581-3c9c5b983db8,network=Network(84dc5f73-5b46-4788-8e58-69d57f2f089f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ca70232-e7')
Aug 26 08:41:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:41:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aDcPxbdJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:41:30 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:41:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:41:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:41:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df5d05f1-af9b-4ce1-b7fa-447815c826c5', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:41:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:30 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b164ac8-0f34-42f9-ba2d-9138da2c7d1e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:30 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0e5600-87ea-4515-83d9-f89976749c6d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:41:30 user nova-compute[73104]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:41:30 user nova-compute[73104]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 (non-flash)
Aug 26 08:41:30 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:41:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:41:30 user nova-compute[73104]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:41:30 user nova-compute[73104]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 (non-flash)
Aug 26 08:41:30 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:41:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0c46a96c0>, {}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:41:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Disconnecting from: [] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:41:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.067s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:41:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] <== disconnect_volume: return (70ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:41:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:41:30 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Deleting instance files /opt/stack/data/nova/instances/85eea82a-c221-4661-9525-06a925b57e1c_del
Aug 26 08:41:30 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Deletion of /opt/stack/data/nova/instances/85eea82a-c221-4661-9525-06a925b57e1c_del complete
Aug 26 08:41:30 user nova-compute[73104]: INFO nova.compute.manager [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Took 1.03 seconds to destroy the instance on the hypervisor.
Aug 26 08:41:30 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 08:41:30 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 08:41:30 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 08:41:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Acquiring lock "3963cffc-9397-45ca-bf80-198b219beb4f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Lock "3963cffc-9397-45ca-bf80-198b219beb4f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:41:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:30 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:41:30 user nova-compute[73104]: INFO nova.compute.claims [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Claim successful on node user
Aug 26 08:41:31 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:41:31 user nova-compute[73104]: DEBUG nova.compute.manager [req-4b20e3f9-3978-4646-9b6f-2e2f8442e8c4 req-4a4d563a-7872-486f-a2af-937a149f0f29 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Received event network-vif-plugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4b20e3f9-3978-4646-9b6f-2e2f8442e8c4 req-4a4d563a-7872-486f-a2af-937a149f0f29 service nova] Acquiring lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4b20e3f9-3978-4646-9b6f-2e2f8442e8c4 req-4a4d563a-7872-486f-a2af-937a149f0f29 service nova] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4b20e3f9-3978-4646-9b6f-2e2f8442e8c4 req-4a4d563a-7872-486f-a2af-937a149f0f29 service nova] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:31 user nova-compute[73104]: DEBUG nova.compute.manager [req-4b20e3f9-3978-4646-9b6f-2e2f8442e8c4 req-4a4d563a-7872-486f-a2af-937a149f0f29 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] No waiting events found dispatching network-vif-plugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:31 user nova-compute[73104]: WARNING nova.compute.manager [req-4b20e3f9-3978-4646-9b6f-2e2f8442e8c4 req-4a4d563a-7872-486f-a2af-937a149f0f29 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Received unexpected event network-vif-plugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 08:41:31 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:41:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:31 user nova-compute[73104]: DEBUG nova.compute.manager [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:41:31 user nova-compute[73104]: DEBUG nova.compute.manager [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:41:31 user nova-compute[73104]: DEBUG nova.network.neutron [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:41:31 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:41:31 user nova-compute[73104]: DEBUG nova.compute.manager [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:41:31 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039291.5985255, 94de2062-7017-44fe-8df0-0a3cd63d5498 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:41:31 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] VM Resumed (Lifecycle Event)
Aug 26 08:41:31 user nova-compute[73104]: DEBUG nova.compute.manager [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:41:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:41:31 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Instance spawned successfully.
Aug 26 08:41:31 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693039276.625649, 385c6d93-907d-42d7-9b43-479e6caf66f9 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:41:31 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] VM Stopped (Lifecycle Event)
Aug 26 08:41:31 user nova-compute[73104]: DEBUG nova.compute.manager [None req-d5368a3a-255c-47c7-ac89-636750ab6a8a None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:41:31 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:41:31 user nova-compute[73104]: DEBUG nova.compute.manager [None req-d5368a3a-255c-47c7-ac89-636750ab6a8a None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:41:31 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:41:31 user nova-compute[73104]: DEBUG nova.policy [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ee750f3b67042aba0b417a77ac2b0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c9c6d04e234fe5a9665af6a8b63aea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:41:31 user nova-compute[73104]: INFO nova.compute.manager [None req-d5368a3a-255c-47c7-ac89-636750ab6a8a None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 08:41:31 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:41:31 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039291.6027658, 94de2062-7017-44fe-8df0-0a3cd63d5498 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:41:31 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] VM Started (Lifecycle Event)
Aug 26 08:41:31 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:41:31 user nova-compute[73104]: DEBUG nova.compute.manager [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:41:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:41:31 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Creating image(s)
Aug 26 08:41:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Acquiring lock "/opt/stack/data/nova/instances/3963cffc-9397-45ca-bf80-198b219beb4f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Lock "/opt/stack/data/nova/instances/3963cffc-9397-45ca-bf80-198b219beb4f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Lock "/opt/stack/data/nova/instances/3963cffc-9397-45ca-bf80-198b219beb4f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:31 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:31 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:41:31 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:41:31 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Took 1.49 seconds to deallocate network for instance.
Aug 26 08:41:31 user nova-compute[73104]: DEBUG nova.compute.manager [req-2f4c2493-0ddc-4c6f-aaa3-b61eb6ee03d6 req-03c6e858-62fd-424e-898a-50531e5882f1 service nova] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Received event network-vif-deleted-5ca70232-e7ad-4989-b581-3c9c5b983db8 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:31 user nova-compute[73104]: INFO nova.compute.manager [req-2f4c2493-0ddc-4c6f-aaa3-b61eb6ee03d6 req-03c6e858-62fd-424e-898a-50531e5882f1 service nova] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Neutron deleted interface 5ca70232-e7ad-4989-b581-3c9c5b983db8; detaching it from the instance and deleting it from the info cache
Aug 26 08:41:31 user nova-compute[73104]: DEBUG nova.network.neutron [req-2f4c2493-0ddc-4c6f-aaa3-b61eb6ee03d6 req-03c6e858-62fd-424e-898a-50531e5882f1 service nova] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:41:31 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:41:31 user nova-compute[73104]: DEBUG nova.compute.manager [req-2f4c2493-0ddc-4c6f-aaa3-b61eb6ee03d6 req-03c6e858-62fd-424e-898a-50531e5882f1 service nova] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Detach interface failed, port_id=5ca70232-e7ad-4989-b581-3c9c5b983db8, reason: Instance 85eea82a-c221-4661-9525-06a925b57e1c could not be found. {{(pid=73104) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 08:41:31 user nova-compute[73104]: WARNING nova.volume.cinder [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Attachment 2a270291-0941-451d-8d80-48f8f4a4b38f does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 2a270291-0941-451d-8d80-48f8f4a4b38f. (HTTP 404) (Request-ID: req-f2502d38-a30b-46cb-be30-bce1995b001d)
Aug 26 08:41:31 user nova-compute[73104]: INFO nova.compute.manager [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Took 0.05 seconds to detach 1 volumes for instance.
Aug 26 08:41:31 user nova-compute[73104]: DEBUG nova.compute.manager [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:41:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.242s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:32 user nova-compute[73104]: DEBUG nova.compute.manager [req-6926a425-4b47-4445-856e-0ee4cebd6717 req-e03376b8-8b20-4c93-a003-ef7dc83aae58 service nova] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Received event network-vif-plugged-5ca70232-e7ad-4989-b581-3c9c5b983db8 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6926a425-4b47-4445-856e-0ee4cebd6717 req-e03376b8-8b20-4c93-a003-ef7dc83aae58 service nova] Acquiring lock "85eea82a-c221-4661-9525-06a925b57e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6926a425-4b47-4445-856e-0ee4cebd6717 req-e03376b8-8b20-4c93-a003-ef7dc83aae58 service nova] Lock "85eea82a-c221-4661-9525-06a925b57e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6926a425-4b47-4445-856e-0ee4cebd6717 req-e03376b8-8b20-4c93-a003-ef7dc83aae58 service nova] Lock "85eea82a-c221-4661-9525-06a925b57e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:32 user nova-compute[73104]: DEBUG nova.compute.manager [req-6926a425-4b47-4445-856e-0ee4cebd6717 req-e03376b8-8b20-4c93-a003-ef7dc83aae58 service nova] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] No waiting events found dispatching network-vif-plugged-5ca70232-e7ad-4989-b581-3c9c5b983db8 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:32 user nova-compute[73104]: WARNING nova.compute.manager [req-6926a425-4b47-4445-856e-0ee4cebd6717 req-e03376b8-8b20-4c93-a003-ef7dc83aae58 service nova] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Received unexpected event network-vif-plugged-5ca70232-e7ad-4989-b581-3c9c5b983db8 for instance with vm_state deleted and task_state None.
Aug 26 08:41:32 user nova-compute[73104]: DEBUG nova.compute.manager [req-6926a425-4b47-4445-856e-0ee4cebd6717 req-e03376b8-8b20-4c93-a003-ef7dc83aae58 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-deleted-4f31240a-f297-42c8-a9f5-65c64322c486 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:32 user nova-compute[73104]: INFO nova.compute.manager [req-6926a425-4b47-4445-856e-0ee4cebd6717 req-e03376b8-8b20-4c93-a003-ef7dc83aae58 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Neutron deleted interface 4f31240a-f297-42c8-a9f5-65c64322c486; detaching it from the instance and deleting it from the info cache
Aug 26 08:41:32 user nova-compute[73104]: DEBUG nova.network.neutron [req-6926a425-4b47-4445-856e-0ee4cebd6717 req-e03376b8-8b20-4c93-a003-ef7dc83aae58 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Updating instance_info_cache with network_info: [{"id": "8469badb-d912-4a8d-ba41-cf4a04664c73", "address": "fa:16:3e:8c:2c:5b", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8469badb-d9", "ovs_interfaceid": "8469badb-d912-4a8d-ba41-cf4a04664c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b", "address": "fa:16:3e:f8:62:20", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa218cb-82", "ovs_interfaceid": "4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7c7615d3-d6db-4a04-884b-34ad12ed49ab", "address": "fa:16:3e:5b:13:e7", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7615d3-d6", "ovs_interfaceid": "7c7615d3-d6db-4a04-884b-34ad12ed49ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56", "address": "fa:16:3e:11:48:11", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9e4cb8-1b", "ovs_interfaceid": "8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e77e909b-af87-4825-b30b-a7062763e3ea", "address": "fa:16:3e:85:9b:36", "network": {"id": "4138826a-130b-48c0-b315-122e80d369ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680959749", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77e909b-af", "ovs_interfaceid": "e77e909b-af87-4825-b30b-a7062763e3ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7aabcef5-79f9-4f25-b095-ac587d15a460", "address": "fa:16:3e:e6:4e:9b", "network": {"id": "4138826a-130b-48c0-b315-122e80d369ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680959749", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aabcef5-79", "ovs_interfaceid": "7aabcef5-79f9-4f25-b095-ac587d15a460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:41:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c42b876f-eae0-41b1-82ba-20c32ba96d44 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 34.775s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:32 user nova-compute[73104]: DEBUG nova.compute.manager [req-6926a425-4b47-4445-856e-0ee4cebd6717 req-e03376b8-8b20-4c93-a003-ef7dc83aae58 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Detach interface failed, port_id=4f31240a-f297-42c8-a9f5-65c64322c486, reason: Instance 7170b5a8-12a7-4ddf-8089-fde172570fd1 could not be found. {{(pid=73104) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 08:41:32 user nova-compute[73104]: DEBUG nova.compute.manager [req-6926a425-4b47-4445-856e-0ee4cebd6717 req-e03376b8-8b20-4c93-a003-ef7dc83aae58 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-deleted-7c7615d3-d6db-4a04-884b-34ad12ed49ab {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:32 user nova-compute[73104]: INFO nova.compute.manager [req-6926a425-4b47-4445-856e-0ee4cebd6717 req-e03376b8-8b20-4c93-a003-ef7dc83aae58 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Neutron deleted interface 7c7615d3-d6db-4a04-884b-34ad12ed49ab; detaching it from the instance and deleting it from the info cache
Aug 26 08:41:32 user nova-compute[73104]: DEBUG nova.network.neutron [req-6926a425-4b47-4445-856e-0ee4cebd6717 req-e03376b8-8b20-4c93-a003-ef7dc83aae58 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Updating instance_info_cache with network_info: [{"id": "8469badb-d912-4a8d-ba41-cf4a04664c73", "address": "fa:16:3e:8c:2c:5b", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8469badb-d9", "ovs_interfaceid": "8469badb-d912-4a8d-ba41-cf4a04664c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b", "address": "fa:16:3e:f8:62:20", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa218cb-82", "ovs_interfaceid": "4fa218cb-82fa-4f5d-ba49-3ca5bd0de94b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56", "address": "fa:16:3e:11:48:11", "network": {"id": "b7e93d48-5c6e-4585-bc10-800a113733c6", "bridge": "br-int", "label": "tempest-device-tagging-net1-786175088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9e4cb8-1b", "ovs_interfaceid": "8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e77e909b-af87-4825-b30b-a7062763e3ea", "address": "fa:16:3e:85:9b:36", "network": {"id": "4138826a-130b-48c0-b315-122e80d369ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680959749", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77e909b-af", "ovs_interfaceid": "e77e909b-af87-4825-b30b-a7062763e3ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7aabcef5-79f9-4f25-b095-ac587d15a460", "address": "fa:16:3e:e6:4e:9b", "network": {"id": "4138826a-130b-48c0-b315-122e80d369ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1680959749", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27c658028a274117a30ecb831e50ddbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aabcef5-79", "ovs_interfaceid": "7aabcef5-79f9-4f25-b095-ac587d15a460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:41:32 user nova-compute[73104]: DEBUG nova.compute.manager [req-6926a425-4b47-4445-856e-0ee4cebd6717 req-e03376b8-8b20-4c93-a003-ef7dc83aae58 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Detach interface failed, port_id=7c7615d3-d6db-4a04-884b-34ad12ed49ab, reason: Instance 7170b5a8-12a7-4ddf-8089-fde172570fd1 could not be found. {{(pid=73104) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 08:41:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.219s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/3963cffc-9397-45ca-bf80-198b219beb4f/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/3963cffc-9397-45ca-bf80-198b219beb4f/disk 1073741824" returned: 0 in 0.064s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.202s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:32 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3963cffc-9397-45ca-bf80-198b219beb4f/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 08:41:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3963cffc-9397-45ca-bf80-198b219beb4f/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:32 user nova-compute[73104]: DEBUG nova.network.neutron [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Successfully created port: bdecf202-93ef-451c-af71-4683fe993589 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:41:32 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:41:32 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:41:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3963cffc-9397-45ca-bf80-198b219beb4f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:32 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Cannot resize image /opt/stack/data/nova/instances/3963cffc-9397-45ca-bf80-198b219beb4f/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 08:41:32 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:41:32 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Ensure instance console log exists: /opt/stack/data/nova/instances/3963cffc-9397-45ca-bf80-198b219beb4f/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:41:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.732s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:32 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Deleted allocations for instance 85eea82a-c221-4661-9525-06a925b57e1c
Aug 26 08:41:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2c1bf437-71d3-469b-8e58-e68650c8010f tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "85eea82a-c221-4661-9525-06a925b57e1c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.537s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:33 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:41:33 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Took 5.78 seconds to deallocate network for instance.
Aug 26 08:41:33 user nova-compute[73104]: DEBUG nova.network.neutron [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Successfully updated port: bdecf202-93ef-451c-af71-4683fe993589 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:41:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Acquiring lock "refresh_cache-3963cffc-9397-45ca-bf80-198b219beb4f" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:41:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Acquired lock "refresh_cache-3963cffc-9397-45ca-bf80-198b219beb4f" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:41:33 user nova-compute[73104]: DEBUG nova.network.neutron [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:41:33 user nova-compute[73104]: DEBUG nova.compute.manager [req-f2bdcb9f-e13e-4735-8353-96287d810a0a req-3a79f892-a8ee-43c6-abcb-e218c9b22b8d service nova] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Received event network-changed-bdecf202-93ef-451c-af71-4683fe993589 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:33 user nova-compute[73104]: DEBUG nova.compute.manager [req-f2bdcb9f-e13e-4735-8353-96287d810a0a req-3a79f892-a8ee-43c6-abcb-e218c9b22b8d service nova] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Refreshing instance network info cache due to event network-changed-bdecf202-93ef-451c-af71-4683fe993589. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:41:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f2bdcb9f-e13e-4735-8353-96287d810a0a req-3a79f892-a8ee-43c6-abcb-e218c9b22b8d service nova] Acquiring lock "refresh_cache-3963cffc-9397-45ca-bf80-198b219beb4f" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:41:33 user nova-compute[73104]: DEBUG nova.network.neutron [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:41:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:33 user nova-compute[73104]: DEBUG nova.network.neutron [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Updating instance_info_cache with network_info: [{"id": "bdecf202-93ef-451c-af71-4683fe993589", "address": "fa:16:3e:3d:be:58", "network": {"id": "77cbe2e5-4ec7-4dff-a3b8-8fa7b46e5165", "bridge": "br-int", "label": "tempest-TestVolumeSwap-643731537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04c9c6d04e234fe5a9665af6a8b63aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdecf202-93", "ovs_interfaceid": "bdecf202-93ef-451c-af71-4683fe993589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:41:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Releasing lock "refresh_cache-3963cffc-9397-45ca-bf80-198b219beb4f" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:41:33 user nova-compute[73104]: DEBUG nova.compute.manager [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Instance network_info: |[{"id": "bdecf202-93ef-451c-af71-4683fe993589", "address": "fa:16:3e:3d:be:58", "network": {"id": "77cbe2e5-4ec7-4dff-a3b8-8fa7b46e5165", "bridge": "br-int", "label": "tempest-TestVolumeSwap-643731537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04c9c6d04e234fe5a9665af6a8b63aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdecf202-93", "ovs_interfaceid": "bdecf202-93ef-451c-af71-4683fe993589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:41:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f2bdcb9f-e13e-4735-8353-96287d810a0a req-3a79f892-a8ee-43c6-abcb-e218c9b22b8d service nova] Acquired lock "refresh_cache-3963cffc-9397-45ca-bf80-198b219beb4f" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:41:33 user nova-compute[73104]: DEBUG nova.network.neutron [req-f2bdcb9f-e13e-4735-8353-96287d810a0a req-3a79f892-a8ee-43c6-abcb-e218c9b22b8d service nova] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Refreshing network info cache for port bdecf202-93ef-451c-af71-4683fe993589 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:41:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Start _get_guest_xml network_info=[{"id": "bdecf202-93ef-451c-af71-4683fe993589", "address": "fa:16:3e:3d:be:58", "network": {"id": "77cbe2e5-4ec7-4dff-a3b8-8fa7b46e5165", "bridge": "br-int", "label": "tempest-TestVolumeSwap-643731537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04c9c6d04e234fe5a9665af6a8b63aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdecf202-93", "ovs_interfaceid": "bdecf202-93ef-451c-af71-4683fe993589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:41:33 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:41:33 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:41:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:41:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:41:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:41:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:41:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:41:33 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:41:33 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:41:33 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:41:33 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:41:33 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:41:33 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:41:33 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:41:33 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:41:33 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:41:33 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:41:33 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:41:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:41:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2037228572',display_name='tempest-TestVolumeSwap-server-2037228572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2037228572',id=16,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAA3lN2AlO1chEqq8KArWigcUlK2OSBTsHZMpZDObdNW4MtsQX590BY2Gvhz5KTg2i+1j0VSG/1X6obzX89xZxQSEISRcvqnhSfbzFkWjVjcEb2SJqlKcU+dt3yyolz3YQ==',key_name='tempest-keypair-1783390580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04c9c6d04e234fe5a9665af6a8b63aea',ramdisk_id='',reservation_id='r-illaqena',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-182361514',owner_user_name='tempest-TestVolumeSwap-182361514-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:41:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ee750f3b67042aba0b417a77ac2b0a0',uuid=3963cffc-9397-45ca-bf80-198b219beb4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdecf202-93ef-451c-af71-4683fe993589", "address": "fa:16:3e:3d:be:58", "network": {"id": "77cbe2e5-4ec7-4dff-a3b8-8fa7b46e5165", "bridge": "br-int", "label": "tempest-TestVolumeSwap-643731537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04c9c6d04e234fe5a9665af6a8b63aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdecf202-93", "ovs_interfaceid": "bdecf202-93ef-451c-af71-4683fe993589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:41:34 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Converting VIF {"id": "bdecf202-93ef-451c-af71-4683fe993589", "address": "fa:16:3e:3d:be:58", "network": {"id": "77cbe2e5-4ec7-4dff-a3b8-8fa7b46e5165", "bridge": "br-int", "label": "tempest-TestVolumeSwap-643731537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04c9c6d04e234fe5a9665af6a8b63aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdecf202-93", "ovs_interfaceid": "bdecf202-93ef-451c-af71-4683fe993589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:41:34 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:be:58,bridge_name='br-int',has_traffic_filtering=True,id=bdecf202-93ef-451c-af71-4683fe993589,network=Network(77cbe2e5-4ec7-4dff-a3b8-8fa7b46e5165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdecf202-93') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:41:34 user nova-compute[73104]: DEBUG nova.objects.instance [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Lazy-loading 'pci_devices' on Instance uuid 3963cffc-9397-45ca-bf80-198b219beb4f {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:41:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:41:34 user nova-compute[73104]:   <uuid>3963cffc-9397-45ca-bf80-198b219beb4f</uuid>
Aug 26 08:41:34 user nova-compute[73104]:   <name>instance-00000010</name>
Aug 26 08:41:34 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:41:34 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:41:34 user nova-compute[73104]:   <metadata>
Aug 26 08:41:34 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:41:34 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:41:34 user nova-compute[73104]:       <nova:name>tempest-TestVolumeSwap-server-2037228572</nova:name>
Aug 26 08:41:34 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:41:33</nova:creationTime>
Aug 26 08:41:34 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:41:34 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:41:34 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:41:34 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:41:34 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:41:34 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:41:34 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:41:34 user nova-compute[73104]:       <nova:owner>
Aug 26 08:41:34 user nova-compute[73104]:         <nova:user uuid="5ee750f3b67042aba0b417a77ac2b0a0">tempest-TestVolumeSwap-182361514-project-member</nova:user>
Aug 26 08:41:34 user nova-compute[73104]:         <nova:project uuid="04c9c6d04e234fe5a9665af6a8b63aea">tempest-TestVolumeSwap-182361514</nova:project>
Aug 26 08:41:34 user nova-compute[73104]:       </nova:owner>
Aug 26 08:41:34 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:41:34 user nova-compute[73104]:       <nova:ports>
Aug 26 08:41:34 user nova-compute[73104]:         <nova:port uuid="bdecf202-93ef-451c-af71-4683fe993589">
Aug 26 08:41:34 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 08:41:34 user nova-compute[73104]:         </nova:port>
Aug 26 08:41:34 user nova-compute[73104]:       </nova:ports>
Aug 26 08:41:34 user nova-compute[73104]:     </nova:instance>
Aug 26 08:41:34 user nova-compute[73104]:   </metadata>
Aug 26 08:41:34 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:41:34 user nova-compute[73104]:     <system>
Aug 26 08:41:34 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:41:34 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:41:34 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:41:34 user nova-compute[73104]:       <entry name="serial">3963cffc-9397-45ca-bf80-198b219beb4f</entry>
Aug 26 08:41:34 user nova-compute[73104]:       <entry name="uuid">3963cffc-9397-45ca-bf80-198b219beb4f</entry>
Aug 26 08:41:34 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:41:34 user nova-compute[73104]:     </system>
Aug 26 08:41:34 user nova-compute[73104]:   </sysinfo>
Aug 26 08:41:34 user nova-compute[73104]:   <os>
Aug 26 08:41:34 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:41:34 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:41:34 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:41:34 user nova-compute[73104]:   </os>
Aug 26 08:41:34 user nova-compute[73104]:   <features>
Aug 26 08:41:34 user nova-compute[73104]:     <acpi/>
Aug 26 08:41:34 user nova-compute[73104]:     <apic/>
Aug 26 08:41:34 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:41:34 user nova-compute[73104]:   </features>
Aug 26 08:41:34 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:41:34 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:41:34 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:41:34 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:41:34 user nova-compute[73104]:   </clock>
Aug 26 08:41:34 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:41:34 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:41:34 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:41:34 user nova-compute[73104]:   </cpu>
Aug 26 08:41:34 user nova-compute[73104]:   <devices>
Aug 26 08:41:34 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:41:34 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:41:34 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/3963cffc-9397-45ca-bf80-198b219beb4f/disk"/>
Aug 26 08:41:34 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:41:34 user nova-compute[73104]:     </disk>
Aug 26 08:41:34 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:41:34 user nova-compute[73104]:       <mac address="fa:16:3e:3d:be:58"/>
Aug 26 08:41:34 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:41:34 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:41:34 user nova-compute[73104]:       <target dev="tapbdecf202-93"/>
Aug 26 08:41:34 user nova-compute[73104]:     </interface>
Aug 26 08:41:34 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:41:34 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/3963cffc-9397-45ca-bf80-198b219beb4f/console.log" append="off"/>
Aug 26 08:41:34 user nova-compute[73104]:     </serial>
Aug 26 08:41:34 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:41:34 user nova-compute[73104]:     <video>
Aug 26 08:41:34 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:41:34 user nova-compute[73104]:     </video>
Aug 26 08:41:34 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:41:34 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:41:34 user nova-compute[73104]:     </rng>
Aug 26 08:41:34 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:41:34 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:41:34 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:41:34 user nova-compute[73104]:     </memballoon>
Aug 26 08:41:34 user nova-compute[73104]:   </devices>
Aug 26 08:41:34 user nova-compute[73104]: </domain>
Aug 26 08:41:34 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:41:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:41:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2037228572',display_name='tempest-TestVolumeSwap-server-2037228572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2037228572',id=16,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAA3lN2AlO1chEqq8KArWigcUlK2OSBTsHZMpZDObdNW4MtsQX590BY2Gvhz5KTg2i+1j0VSG/1X6obzX89xZxQSEISRcvqnhSfbzFkWjVjcEb2SJqlKcU+dt3yyolz3YQ==',key_name='tempest-keypair-1783390580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04c9c6d04e234fe5a9665af6a8b63aea',ramdisk_id='',reservation_id='r-illaqena',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-182361514',owner_user_name='tempest-TestVolumeSwap-182361514-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:41:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ee750f3b67042aba0b417a77ac2b0a0',uuid=3963cffc-9397-45ca-bf80-198b219beb4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdecf202-93ef-451c-af71-4683fe993589", "address": "fa:16:3e:3d:be:58", "network": {"id": "77cbe2e5-4ec7-4dff-a3b8-8fa7b46e5165", "bridge": "br-int", "label": "tempest-TestVolumeSwap-643731537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04c9c6d04e234fe5a9665af6a8b63aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdecf202-93", "ovs_interfaceid": "bdecf202-93ef-451c-af71-4683fe993589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:41:34 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Converting VIF {"id": "bdecf202-93ef-451c-af71-4683fe993589", "address": "fa:16:3e:3d:be:58", "network": {"id": "77cbe2e5-4ec7-4dff-a3b8-8fa7b46e5165", "bridge": "br-int", "label": "tempest-TestVolumeSwap-643731537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04c9c6d04e234fe5a9665af6a8b63aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdecf202-93", "ovs_interfaceid": "bdecf202-93ef-451c-af71-4683fe993589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:41:34 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:be:58,bridge_name='br-int',has_traffic_filtering=True,id=bdecf202-93ef-451c-af71-4683fe993589,network=Network(77cbe2e5-4ec7-4dff-a3b8-8fa7b46e5165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdecf202-93') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:41:34 user nova-compute[73104]: DEBUG os_vif [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:be:58,bridge_name='br-int',has_traffic_filtering=True,id=bdecf202-93ef-451c-af71-4683fe993589,network=Network(77cbe2e5-4ec7-4dff-a3b8-8fa7b46e5165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdecf202-93') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:41:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:41:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:41:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbdecf202-93, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:41:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbdecf202-93, col_values=(('external_ids', {'iface-id': 'bdecf202-93ef-451c-af71-4683fe993589', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:be:58', 'vm-uuid': '3963cffc-9397-45ca-bf80-198b219beb4f'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:41:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:41:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:34 user nova-compute[73104]: INFO os_vif [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:be:58,bridge_name='br-int',has_traffic_filtering=True,id=bdecf202-93ef-451c-af71-4683fe993589,network=Network(77cbe2e5-4ec7-4dff-a3b8-8fa7b46e5165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdecf202-93')
Aug 26 08:41:34 user nova-compute[73104]: DEBUG nova.compute.manager [req-f567ccd1-3caa-4213-998a-93617ca0c878 req-5f9be415-0767-4eb0-9320-e42f847e8678 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-deleted-7aabcef5-79f9-4f25-b095-ac587d15a460 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:34 user nova-compute[73104]: DEBUG nova.compute.manager [req-f567ccd1-3caa-4213-998a-93617ca0c878 req-5f9be415-0767-4eb0-9320-e42f847e8678 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-deleted-8b9e4cb8-1bce-4e95-bd2e-d3bb02854f56 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:34 user nova-compute[73104]: DEBUG nova.compute.manager [req-f567ccd1-3caa-4213-998a-93617ca0c878 req-5f9be415-0767-4eb0-9320-e42f847e8678 service nova] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Received event network-vif-deleted-e77e909b-af87-4825-b30b-a7062763e3ea {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:41:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] No VIF found with MAC fa:16:3e:3d:be:58, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:41:34 user nova-compute[73104]: DEBUG nova.network.neutron [req-f2bdcb9f-e13e-4735-8353-96287d810a0a req-3a79f892-a8ee-43c6-abcb-e218c9b22b8d service nova] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Updated VIF entry in instance network info cache for port bdecf202-93ef-451c-af71-4683fe993589. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:41:34 user nova-compute[73104]: DEBUG nova.network.neutron [req-f2bdcb9f-e13e-4735-8353-96287d810a0a req-3a79f892-a8ee-43c6-abcb-e218c9b22b8d service nova] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Updating instance_info_cache with network_info: [{"id": "bdecf202-93ef-451c-af71-4683fe993589", "address": "fa:16:3e:3d:be:58", "network": {"id": "77cbe2e5-4ec7-4dff-a3b8-8fa7b46e5165", "bridge": "br-int", "label": "tempest-TestVolumeSwap-643731537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04c9c6d04e234fe5a9665af6a8b63aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdecf202-93", "ovs_interfaceid": "bdecf202-93ef-451c-af71-4683fe993589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:41:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f2bdcb9f-e13e-4735-8353-96287d810a0a req-3a79f892-a8ee-43c6-abcb-e218c9b22b8d service nova] Releasing lock "refresh_cache-3963cffc-9397-45ca-bf80-198b219beb4f" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:41:35 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:35 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:35 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:35 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:35 user nova-compute[73104]: DEBUG nova.compute.manager [req-4965adc4-5d01-4203-9db8-e2c034220620 req-d7cd59d1-ce75-4107-959c-70f2bf01023c service nova] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Received event network-vif-plugged-bdecf202-93ef-451c-af71-4683fe993589 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4965adc4-5d01-4203-9db8-e2c034220620 req-d7cd59d1-ce75-4107-959c-70f2bf01023c service nova] Acquiring lock "3963cffc-9397-45ca-bf80-198b219beb4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4965adc4-5d01-4203-9db8-e2c034220620 req-d7cd59d1-ce75-4107-959c-70f2bf01023c service nova] Lock "3963cffc-9397-45ca-bf80-198b219beb4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4965adc4-5d01-4203-9db8-e2c034220620 req-d7cd59d1-ce75-4107-959c-70f2bf01023c service nova] Lock "3963cffc-9397-45ca-bf80-198b219beb4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:35 user nova-compute[73104]: DEBUG nova.compute.manager [req-4965adc4-5d01-4203-9db8-e2c034220620 req-d7cd59d1-ce75-4107-959c-70f2bf01023c service nova] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] No waiting events found dispatching network-vif-plugged-bdecf202-93ef-451c-af71-4683fe993589 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:35 user nova-compute[73104]: WARNING nova.compute.manager [req-4965adc4-5d01-4203-9db8-e2c034220620 req-d7cd59d1-ce75-4107-959c-70f2bf01023c service nova] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Received unexpected event network-vif-plugged-bdecf202-93ef-451c-af71-4683fe993589 for instance with vm_state building and task_state spawning.
Aug 26 08:41:36 user nova-compute[73104]: INFO nova.compute.manager [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Took 3.14 seconds to detach 3 volumes for instance.
Aug 26 08:41:36 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:36 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:36 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:41:36 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:41:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:36 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Deleted allocations for instance 7170b5a8-12a7-4ddf-8089-fde172570fd1
Aug 26 08:41:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-458f4a52-b644-4a2f-a068-494292eddb81 tempest-TaggedBootDevicesTest_v242-834543942 tempest-TaggedBootDevicesTest_v242-834543942-project-member] Lock "7170b5a8-12a7-4ddf-8089-fde172570fd1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 16.278s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.compute.manager [req-c15297cd-0de8-48f5-8da9-49d5e541d052 req-e2d0d7b2-0e79-40b0-a540-d29b31fd91de service nova] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Received event network-vif-plugged-bdecf202-93ef-451c-af71-4683fe993589 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c15297cd-0de8-48f5-8da9-49d5e541d052 req-e2d0d7b2-0e79-40b0-a540-d29b31fd91de service nova] Acquiring lock "3963cffc-9397-45ca-bf80-198b219beb4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c15297cd-0de8-48f5-8da9-49d5e541d052 req-e2d0d7b2-0e79-40b0-a540-d29b31fd91de service nova] Lock "3963cffc-9397-45ca-bf80-198b219beb4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c15297cd-0de8-48f5-8da9-49d5e541d052 req-e2d0d7b2-0e79-40b0-a540-d29b31fd91de service nova] Lock "3963cffc-9397-45ca-bf80-198b219beb4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.compute.manager [req-c15297cd-0de8-48f5-8da9-49d5e541d052 req-e2d0d7b2-0e79-40b0-a540-d29b31fd91de service nova] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] No waiting events found dispatching network-vif-plugged-bdecf202-93ef-451c-af71-4683fe993589 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:38 user nova-compute[73104]: WARNING nova.compute.manager [req-c15297cd-0de8-48f5-8da9-49d5e541d052 req-e2d0d7b2-0e79-40b0-a540-d29b31fd91de service nova] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Received unexpected event network-vif-plugged-bdecf202-93ef-451c-af71-4683fe993589 for instance with vm_state building and task_state spawning.
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039298.0468504, 3963cffc-9397-45ca-bf80-198b219beb4f => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:41:38 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] VM Resumed (Lifecycle Event)
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.compute.manager [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:41:38 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Instance spawned successfully.
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:41:38 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039298.04853, 3963cffc-9397-45ca-bf80-198b219beb4f => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:41:38 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] VM Started (Lifecycle Event)
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693039283.115058, 7170b5a8-12a7-4ddf-8089-fde172570fd1 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:41:38 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] VM Stopped (Lifecycle Event)
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.compute.manager [None req-4354a38f-28f5-47b9-8736-9663ffd6b725 None None] [instance: 7170b5a8-12a7-4ddf-8089-fde172570fd1] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:41:38 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:41:38 user nova-compute[73104]: INFO nova.compute.manager [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Took 6.48 seconds to spawn the instance on the hypervisor.
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.compute.manager [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:41:38 user nova-compute[73104]: INFO nova.compute.manager [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Took 7.45 seconds to build instance.
Aug 26 08:41:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fea29165-9743-43c7-be43-8eb9ff1ebdd7 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Lock "3963cffc-9397-45ca-bf80-198b219beb4f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.566s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Starting finish_migration {{(pid=73104) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Instance directory exists: not creating {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 08:41:38 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Creating image(s)
Aug 26 08:41:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.189s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Checking if we can resize image /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk. size=21474836480 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk 21474836480 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk 21474836480" returned: 0 in 0.050s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Did not create local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Ensure instance console log exists: /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Start _get_guest_xml network_info=[{"id": "d4692900-c165-487d-9847-383fcf1d2270", "address": "fa:16:3e:b9:37:34", "network": {"id": "9aad8a32-d93f-45ef-be53-f84cebd194b1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2017537149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2017537149-network", "vif_mac": "fa:16:3e:b9:37:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc8c266ecf8444919a4a2ed73b784b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4692900-c1", "ovs_interfaceid": "d4692900-c165-487d-9847-383fcf1d2270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '8f33562b-e931-4173-8eb7-db3ae2bdd584', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEOqgAiB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '385c6d93-907d-42d7-9b43-479e6caf66f9', 'attached_at': '2023-08-26T08:41:38.000000', 'detached_at': '', 'volume_id': 'c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44', 'serial': 'c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:41:38 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:41:38 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:41:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEOqgAiB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:41:39 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:41:39 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:41:39 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:41:39 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:41:39 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:41:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f19c38-5427-4493-828c-f0578e310645]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:41:39 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[878e5fa0-1e03-410e-b326-b41d54812366]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44] added
Aug 26 08:41:39 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d08b509-217e-4d80-bb90-57de66fa0b71]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[500ddf35-f4eb-4059-a063-4e3c4448ae1d]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rEOqgAiB {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rEOqgAiB" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20cd113-8edc-4925-8dba-47d0ffef81d0]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rEOqgAiB'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[167d17ec-5661-4e7e-b3ad-defce6ec2185]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eda99b7-dbc6-4633-9ab9-942f67abccc8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:41:39 user nova-compute[73104]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:41:39 user nova-compute[73104]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 (non-flash)
Aug 26 08:41:39 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:41:39 user nova-compute[73104]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:41:39 user nova-compute[73104]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 (non-flash)
Aug 26 08:41:39 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a53775-96f5-437d-8587-273681dc212f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44, portal: 172.16.0.220,3260]
Aug 26 08:41:39 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44, portal: 172.16.0.220,3260] successful.
Aug 26 08:41:39 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b517f66-e628-43a7-ab5e-c15d7ca60d6c]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.143s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69a4e79-72e0-4103-a3cf-08731be19b04]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:41:39 user nova-compute[73104]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:41:39 user nova-compute[73104]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 (non-flash)
Aug 26 08:41:39 user nova-compute[73104]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:41:39 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:41:39 user nova-compute[73104]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:41:39 user nova-compute[73104]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 (non-flash)
Aug 26 08:41:39 user nova-compute[73104]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:41:39 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.482s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.049s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[04785e1a-4b9d-4bab-a126-2d35673849fa]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:41:39 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEOqgAiB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:41:40 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.902s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:41:40 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] <== connect_volume: return (1905ms) {'type': 'block', 'scsi_wwn': '23736613164313738', 'path': '/dev/sdc'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:41:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736613164313738', 'path': '/dev/sdc'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:41:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1752100953',display_name='tempest-ServerActionsTestOtherB-server-1752100953',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1752100953',id=5,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNCl9FBP9XyWyY8/M5Nn5mUzz1vqHS13H5r5WR3mIkiFM7rzl4Rl7e+CWZJ8183D5yYr3nZra0DCol7pvB/KJevg8WITrJ9KzKNvGMc/QWpgMb9Lbrm7qPNUJRloZ083Q==',key_name='tempest-keypair-1221674543',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:37:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bc8c266ecf8444919a4a2ed73b784b53',ramdisk_id='',reservation_id='r-w3k6rkik',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-905162429',owner_user_name='tempest-ServerActionsTestOtherB-905162429-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:41:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4e9fc4dcaaf4aa1aaa51245217b4ded',uuid=385c6d93-907d-42d7-9b43-479e6caf66f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4692900-c165-487d-9847-383fcf1d2270", "address": "fa:16:3e:b9:37:34", "network": {"id": "9aad8a32-d93f-45ef-be53-f84cebd194b1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2017537149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2017537149-network", "vif_mac": "fa:16:3e:b9:37:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc8c266ecf8444919a4a2ed73b784b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4692900-c1", "ovs_interfaceid": "d4692900-c165-487d-9847-383fcf1d2270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:41:40 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Converting VIF {"id": "d4692900-c165-487d-9847-383fcf1d2270", "address": "fa:16:3e:b9:37:34", "network": {"id": "9aad8a32-d93f-45ef-be53-f84cebd194b1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2017537149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2017537149-network", "vif_mac": "fa:16:3e:b9:37:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc8c266ecf8444919a4a2ed73b784b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4692900-c1", "ovs_interfaceid": "d4692900-c165-487d-9847-383fcf1d2270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:41:40 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:37:34,bridge_name='br-int',has_traffic_filtering=True,id=d4692900-c165-487d-9847-383fcf1d2270,network=Network(9aad8a32-d93f-45ef-be53-f84cebd194b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4692900-c1') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:41:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:41:40 user nova-compute[73104]:   <uuid>385c6d93-907d-42d7-9b43-479e6caf66f9</uuid>
Aug 26 08:41:40 user nova-compute[73104]:   <name>instance-00000005</name>
Aug 26 08:41:40 user nova-compute[73104]:   <memory>2097152</memory>
Aug 26 08:41:40 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:41:40 user nova-compute[73104]:   <metadata>
Aug 26 08:41:40 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:41:40 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:41:40 user nova-compute[73104]:       <nova:name>tempest-ServerActionsTestOtherB-server-1752100953</nova:name>
Aug 26 08:41:40 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:41:38</nova:creationTime>
Aug 26 08:41:40 user nova-compute[73104]:       <nova:flavor name="m1.small">
Aug 26 08:41:40 user nova-compute[73104]:         <nova:memory>2048</nova:memory>
Aug 26 08:41:40 user nova-compute[73104]:         <nova:disk>20</nova:disk>
Aug 26 08:41:40 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:41:40 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:41:40 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:41:40 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:41:40 user nova-compute[73104]:       <nova:owner>
Aug 26 08:41:40 user nova-compute[73104]:         <nova:user uuid="a4e9fc4dcaaf4aa1aaa51245217b4ded">tempest-ServerActionsTestOtherB-905162429-project-member</nova:user>
Aug 26 08:41:40 user nova-compute[73104]:         <nova:project uuid="bc8c266ecf8444919a4a2ed73b784b53">tempest-ServerActionsTestOtherB-905162429</nova:project>
Aug 26 08:41:40 user nova-compute[73104]:       </nova:owner>
Aug 26 08:41:40 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:41:40 user nova-compute[73104]:       <nova:ports>
Aug 26 08:41:40 user nova-compute[73104]:         <nova:port uuid="d4692900-c165-487d-9847-383fcf1d2270">
Aug 26 08:41:40 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 08:41:40 user nova-compute[73104]:         </nova:port>
Aug 26 08:41:40 user nova-compute[73104]:       </nova:ports>
Aug 26 08:41:40 user nova-compute[73104]:     </nova:instance>
Aug 26 08:41:40 user nova-compute[73104]:   </metadata>
Aug 26 08:41:40 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:41:40 user nova-compute[73104]:     <system>
Aug 26 08:41:40 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:41:40 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:41:40 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:41:40 user nova-compute[73104]:       <entry name="serial">385c6d93-907d-42d7-9b43-479e6caf66f9</entry>
Aug 26 08:41:40 user nova-compute[73104]:       <entry name="uuid">385c6d93-907d-42d7-9b43-479e6caf66f9</entry>
Aug 26 08:41:40 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:41:40 user nova-compute[73104]:     </system>
Aug 26 08:41:40 user nova-compute[73104]:   </sysinfo>
Aug 26 08:41:40 user nova-compute[73104]:   <os>
Aug 26 08:41:40 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:41:40 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:41:40 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:41:40 user nova-compute[73104]:   </os>
Aug 26 08:41:40 user nova-compute[73104]:   <features>
Aug 26 08:41:40 user nova-compute[73104]:     <acpi/>
Aug 26 08:41:40 user nova-compute[73104]:     <apic/>
Aug 26 08:41:40 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:41:40 user nova-compute[73104]:   </features>
Aug 26 08:41:40 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:41:40 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:41:40 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:41:40 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:41:40 user nova-compute[73104]:   </clock>
Aug 26 08:41:40 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:41:40 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:41:40 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:41:40 user nova-compute[73104]:   </cpu>
Aug 26 08:41:40 user nova-compute[73104]:   <devices>
Aug 26 08:41:40 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:41:40 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:41:40 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk"/>
Aug 26 08:41:40 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:41:40 user nova-compute[73104]:     </disk>
Aug 26 08:41:40 user nova-compute[73104]:     <disk type="block" device="disk">
Aug 26 08:41:40 user nova-compute[73104]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:41:40 user nova-compute[73104]:       <source dev="/dev/sdc"/>
Aug 26 08:41:40 user nova-compute[73104]:       <target dev="vdb" bus="virtio"/>
Aug 26 08:41:40 user nova-compute[73104]:       <serial>c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44</serial>
Aug 26 08:41:40 user nova-compute[73104]:     </disk>
Aug 26 08:41:40 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:41:40 user nova-compute[73104]:       <mac address="fa:16:3e:b9:37:34"/>
Aug 26 08:41:40 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:41:40 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:41:40 user nova-compute[73104]:       <target dev="tapd4692900-c1"/>
Aug 26 08:41:40 user nova-compute[73104]:     </interface>
Aug 26 08:41:40 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:41:40 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/console.log" append="off"/>
Aug 26 08:41:40 user nova-compute[73104]:     </serial>
Aug 26 08:41:40 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:41:40 user nova-compute[73104]:     <video>
Aug 26 08:41:40 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:41:40 user nova-compute[73104]:     </video>
Aug 26 08:41:40 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:41:40 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:41:40 user nova-compute[73104]:     </rng>
Aug 26 08:41:40 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:41:40 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:41:40 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:41:40 user nova-compute[73104]:     </memballoon>
Aug 26 08:41:40 user nova-compute[73104]:   </devices>
Aug 26 08:41:40 user nova-compute[73104]: </domain>
Aug 26 08:41:40 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:41:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1752100953',display_name='tempest-ServerActionsTestOtherB-server-1752100953',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1752100953',id=5,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNCl9FBP9XyWyY8/M5Nn5mUzz1vqHS13H5r5WR3mIkiFM7rzl4Rl7e+CWZJ8183D5yYr3nZra0DCol7pvB/KJevg8WITrJ9KzKNvGMc/QWpgMb9Lbrm7qPNUJRloZ083Q==',key_name='tempest-keypair-1221674543',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:37:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bc8c266ecf8444919a4a2ed73b784b53',ramdisk_id='',reservation_id='r-w3k6rkik',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-905162429',owner_user_name='tempest-ServerActionsTestOtherB-905162429-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:41:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4e9fc4dcaaf4aa1aaa51245217b4ded',uuid=385c6d93-907d-42d7-9b43-479e6caf66f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4692900-c165-487d-9847-383fcf1d2270", "address": "fa:16:3e:b9:37:34", "network": {"id": "9aad8a32-d93f-45ef-be53-f84cebd194b1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2017537149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2017537149-network", "vif_mac": "fa:16:3e:b9:37:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc8c266ecf8444919a4a2ed73b784b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4692900-c1", "ovs_interfaceid": "d4692900-c165-487d-9847-383fcf1d2270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:41:40 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Converting VIF {"id": "d4692900-c165-487d-9847-383fcf1d2270", "address": "fa:16:3e:b9:37:34", "network": {"id": "9aad8a32-d93f-45ef-be53-f84cebd194b1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2017537149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2017537149-network", "vif_mac": "fa:16:3e:b9:37:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc8c266ecf8444919a4a2ed73b784b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4692900-c1", "ovs_interfaceid": "d4692900-c165-487d-9847-383fcf1d2270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:41:40 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:37:34,bridge_name='br-int',has_traffic_filtering=True,id=d4692900-c165-487d-9847-383fcf1d2270,network=Network(9aad8a32-d93f-45ef-be53-f84cebd194b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4692900-c1') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:41:40 user nova-compute[73104]: DEBUG os_vif [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:37:34,bridge_name='br-int',has_traffic_filtering=True,id=d4692900-c165-487d-9847-383fcf1d2270,network=Network(9aad8a32-d93f-45ef-be53-f84cebd194b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4692900-c1') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:41:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:41:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:41:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4692900-c1, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:41:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd4692900-c1, col_values=(('external_ids', {'iface-id': 'd4692900-c165-487d-9847-383fcf1d2270', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:37:34', 'vm-uuid': '385c6d93-907d-42d7-9b43-479e6caf66f9'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:41:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:41:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:41 user nova-compute[73104]: INFO os_vif [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:37:34,bridge_name='br-int',has_traffic_filtering=True,id=d4692900-c165-487d-9847-383fcf1d2270,network=Network(9aad8a32-d93f-45ef-be53-f84cebd194b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4692900-c1')
Aug 26 08:41:41 user nova-compute[73104]: DEBUG nova.compute.manager [req-861da3b2-31a6-4d98-8090-a8ee456374bf req-1b84794c-4246-4100-9dac-144a3c69943d service nova] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Received event network-changed-c0227129-949b-4dec-9100-d8282dfa4b87 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:41 user nova-compute[73104]: DEBUG nova.compute.manager [req-861da3b2-31a6-4d98-8090-a8ee456374bf req-1b84794c-4246-4100-9dac-144a3c69943d service nova] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Refreshing instance network info cache due to event network-changed-c0227129-949b-4dec-9100-d8282dfa4b87. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:41:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-861da3b2-31a6-4d98-8090-a8ee456374bf req-1b84794c-4246-4100-9dac-144a3c69943d service nova] Acquiring lock "refresh_cache-da850cb3-3d57-4243-8af8-13c7f3251787" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:41:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-861da3b2-31a6-4d98-8090-a8ee456374bf req-1b84794c-4246-4100-9dac-144a3c69943d service nova] Acquired lock "refresh_cache-da850cb3-3d57-4243-8af8-13c7f3251787" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:41:41 user nova-compute[73104]: DEBUG nova.network.neutron [req-861da3b2-31a6-4d98-8090-a8ee456374bf req-1b84794c-4246-4100-9dac-144a3c69943d service nova] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Refreshing network info cache for port c0227129-949b-4dec-9100-d8282dfa4b87 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:41:41 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:41:41 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:41:41 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] No VIF found with MAC fa:16:3e:b9:37:34, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:41:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-203baa04-b724-4013-b041-64608dd4ffd7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "da850cb3-3d57-4243-8af8-13c7f3251787" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-203baa04-b724-4013-b041-64608dd4ffd7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "da850cb3-3d57-4243-8af8-13c7f3251787" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-203baa04-b724-4013-b041-64608dd4ffd7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "da850cb3-3d57-4243-8af8-13c7f3251787-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-203baa04-b724-4013-b041-64608dd4ffd7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "da850cb3-3d57-4243-8af8-13c7f3251787-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-203baa04-b724-4013-b041-64608dd4ffd7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "da850cb3-3d57-4243-8af8-13c7f3251787-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:41 user nova-compute[73104]: INFO nova.compute.manager [None req-203baa04-b724-4013-b041-64608dd4ffd7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Terminating instance
Aug 26 08:41:41 user nova-compute[73104]: DEBUG nova.compute.manager [None req-203baa04-b724-4013-b041-64608dd4ffd7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 08:41:41 user nova-compute[73104]: DEBUG nova.network.neutron [req-861da3b2-31a6-4d98-8090-a8ee456374bf req-1b84794c-4246-4100-9dac-144a3c69943d service nova] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Updated VIF entry in instance network info cache for port c0227129-949b-4dec-9100-d8282dfa4b87. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:41:41 user nova-compute[73104]: DEBUG nova.network.neutron [req-861da3b2-31a6-4d98-8090-a8ee456374bf req-1b84794c-4246-4100-9dac-144a3c69943d service nova] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Updating instance_info_cache with network_info: [{"id": "c0227129-949b-4dec-9100-d8282dfa4b87", "address": "fa:16:3e:63:d8:06", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0227129-94", "ovs_interfaceid": "c0227129-949b-4dec-9100-d8282dfa4b87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:41:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-861da3b2-31a6-4d98-8090-a8ee456374bf req-1b84794c-4246-4100-9dac-144a3c69943d service nova] Releasing lock "refresh_cache-da850cb3-3d57-4243-8af8-13c7f3251787" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:41:41 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:41 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:41 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:42 user nova-compute[73104]: DEBUG nova.compute.manager [req-861b05fa-5d22-4c08-b7e0-3e9f5a903c27 req-3088fdbf-6cb2-40cc-9152-7bd29cee62a2 service nova] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Received event network-vif-unplugged-c0227129-949b-4dec-9100-d8282dfa4b87 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-861b05fa-5d22-4c08-b7e0-3e9f5a903c27 req-3088fdbf-6cb2-40cc-9152-7bd29cee62a2 service nova] Acquiring lock "da850cb3-3d57-4243-8af8-13c7f3251787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-861b05fa-5d22-4c08-b7e0-3e9f5a903c27 req-3088fdbf-6cb2-40cc-9152-7bd29cee62a2 service nova] Lock "da850cb3-3d57-4243-8af8-13c7f3251787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-861b05fa-5d22-4c08-b7e0-3e9f5a903c27 req-3088fdbf-6cb2-40cc-9152-7bd29cee62a2 service nova] Lock "da850cb3-3d57-4243-8af8-13c7f3251787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:42 user nova-compute[73104]: DEBUG nova.compute.manager [req-861b05fa-5d22-4c08-b7e0-3e9f5a903c27 req-3088fdbf-6cb2-40cc-9152-7bd29cee62a2 service nova] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] No waiting events found dispatching network-vif-unplugged-c0227129-949b-4dec-9100-d8282dfa4b87 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:42 user nova-compute[73104]: DEBUG nova.compute.manager [req-861b05fa-5d22-4c08-b7e0-3e9f5a903c27 req-3088fdbf-6cb2-40cc-9152-7bd29cee62a2 service nova] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Received event network-vif-unplugged-c0227129-949b-4dec-9100-d8282dfa4b87 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:41:42 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Instance destroyed successfully.
Aug 26 08:41:42 user nova-compute[73104]: DEBUG nova.objects.instance [None req-203baa04-b724-4013-b041-64608dd4ffd7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lazy-loading 'resources' on Instance uuid da850cb3-3d57-4243-8af8-13c7f3251787 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:41:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:42 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-203baa04-b724-4013-b041-64608dd4ffd7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:39:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1948580857',display_name='tempest-AttachVolumeNegativeTest-server-1948580857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1948580857',id=13,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEalDMDm3bWX+y2VD0g97vGCJXuv0dkrAXho/niYXWZQ03OmCezCCUXxscILCpWel9c7I4u3lDpLwhqvtOGSRceLR3Q3ciigyVsoR4Qi3sqa0pBFmqOiaFOE//oFS5rdyQ==',key_name='tempest-keypair-236508621',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:39:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ad68e5623014e2fb3f10ba92d388291',ramdisk_id='',reservation_id='r-5fvdxjp8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1286694855',owner_user_name='tempest-AttachVolumeNegativeTest-1286694855-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:39:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='062587ed00ae457889f884346c99e11b',uuid=da850cb3-3d57-4243-8af8-13c7f3251787,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0227129-949b-4dec-9100-d8282dfa4b87", "address": "fa:16:3e:63:d8:06", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0227129-94", "ovs_interfaceid": "c0227129-949b-4dec-9100-d8282dfa4b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:41:42 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-203baa04-b724-4013-b041-64608dd4ffd7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Converting VIF {"id": "c0227129-949b-4dec-9100-d8282dfa4b87", "address": "fa:16:3e:63:d8:06", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0227129-94", "ovs_interfaceid": "c0227129-949b-4dec-9100-d8282dfa4b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:41:42 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-203baa04-b724-4013-b041-64608dd4ffd7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:d8:06,bridge_name='br-int',has_traffic_filtering=True,id=c0227129-949b-4dec-9100-d8282dfa4b87,network=Network(ea6c6ce0-85a4-40db-96e2-ca078887ab66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0227129-94') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:41:42 user nova-compute[73104]: DEBUG os_vif [None req-203baa04-b724-4013-b041-64608dd4ffd7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:d8:06,bridge_name='br-int',has_traffic_filtering=True,id=c0227129-949b-4dec-9100-d8282dfa4b87,network=Network(ea6c6ce0-85a4-40db-96e2-ca078887ab66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0227129-94') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:41:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0227129-94, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:41:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:41:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:42 user nova-compute[73104]: INFO os_vif [None req-203baa04-b724-4013-b041-64608dd4ffd7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:d8:06,bridge_name='br-int',has_traffic_filtering=True,id=c0227129-949b-4dec-9100-d8282dfa4b87,network=Network(ea6c6ce0-85a4-40db-96e2-ca078887ab66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0227129-94')
Aug 26 08:41:42 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-203baa04-b724-4013-b041-64608dd4ffd7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Deleting instance files /opt/stack/data/nova/instances/da850cb3-3d57-4243-8af8-13c7f3251787_del
Aug 26 08:41:42 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-203baa04-b724-4013-b041-64608dd4ffd7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Deletion of /opt/stack/data/nova/instances/da850cb3-3d57-4243-8af8-13c7f3251787_del complete
Aug 26 08:41:43 user nova-compute[73104]: INFO nova.compute.manager [None req-203baa04-b724-4013-b041-64608dd4ffd7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Took 1.52 seconds to destroy the instance on the hypervisor.
Aug 26 08:41:43 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-203baa04-b724-4013-b041-64608dd4ffd7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 08:41:43 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 08:41:43 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 08:41:43 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:41:43 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 08:41:43 user nova-compute[73104]: DEBUG nova.compute.manager [req-c5e88f52-4a68-440e-bd6f-cb1d009c4174 req-7adc9b85-d477-4e8b-ac0a-d9e4704139da service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Received event network-vif-plugged-d4692900-c165-487d-9847-383fcf1d2270 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c5e88f52-4a68-440e-bd6f-cb1d009c4174 req-7adc9b85-d477-4e8b-ac0a-d9e4704139da service nova] Acquiring lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c5e88f52-4a68-440e-bd6f-cb1d009c4174 req-7adc9b85-d477-4e8b-ac0a-d9e4704139da service nova] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c5e88f52-4a68-440e-bd6f-cb1d009c4174 req-7adc9b85-d477-4e8b-ac0a-d9e4704139da service nova] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:43 user nova-compute[73104]: DEBUG nova.compute.manager [req-c5e88f52-4a68-440e-bd6f-cb1d009c4174 req-7adc9b85-d477-4e8b-ac0a-d9e4704139da service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] No waiting events found dispatching network-vif-plugged-d4692900-c165-487d-9847-383fcf1d2270 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:43 user nova-compute[73104]: WARNING nova.compute.manager [req-c5e88f52-4a68-440e-bd6f-cb1d009c4174 req-7adc9b85-d477-4e8b-ac0a-d9e4704139da service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Received unexpected event network-vif-plugged-d4692900-c165-487d-9847-383fcf1d2270 for instance with vm_state active and task_state resize_finish.
Aug 26 08:41:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-93244bcd-34be-46f3-85e6-87bb5e69888d" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:41:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-93244bcd-34be-46f3-85e6-87bb5e69888d" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:41:43 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 08:41:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:44 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Updating instance_info_cache with network_info: [{"id": "af8b0ae5-581c-4096-98de-4442fe942572", "address": "fa:16:3e:d5:84:96", "network": {"id": "58299b40-db54-4ba9-b4aa-8a40f0c2c2d4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-295087397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef6f6e226b23400481b2ad063356bc06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8b0ae5-58", "ovs_interfaceid": "af8b0ae5-581c-4096-98de-4442fe942572", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:41:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-93244bcd-34be-46f3-85e6-87bb5e69888d" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:41:44 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 08:41:44 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:41:44 user nova-compute[73104]: DEBUG nova.compute.manager [req-89731cd0-adbf-43d3-9f50-bd97470a4be6 req-519a26a7-8aad-4056-92be-72fe5e57ddcd service nova] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Received event network-vif-plugged-c0227129-949b-4dec-9100-d8282dfa4b87 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-89731cd0-adbf-43d3-9f50-bd97470a4be6 req-519a26a7-8aad-4056-92be-72fe5e57ddcd service nova] Acquiring lock "da850cb3-3d57-4243-8af8-13c7f3251787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-89731cd0-adbf-43d3-9f50-bd97470a4be6 req-519a26a7-8aad-4056-92be-72fe5e57ddcd service nova] Lock "da850cb3-3d57-4243-8af8-13c7f3251787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-89731cd0-adbf-43d3-9f50-bd97470a4be6 req-519a26a7-8aad-4056-92be-72fe5e57ddcd service nova] Lock "da850cb3-3d57-4243-8af8-13c7f3251787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:44 user nova-compute[73104]: DEBUG nova.compute.manager [req-89731cd0-adbf-43d3-9f50-bd97470a4be6 req-519a26a7-8aad-4056-92be-72fe5e57ddcd service nova] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] No waiting events found dispatching network-vif-plugged-c0227129-949b-4dec-9100-d8282dfa4b87 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:44 user nova-compute[73104]: WARNING nova.compute.manager [req-89731cd0-adbf-43d3-9f50-bd97470a4be6 req-519a26a7-8aad-4056-92be-72fe5e57ddcd service nova] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Received unexpected event network-vif-plugged-c0227129-949b-4dec-9100-d8282dfa4b87 for instance with vm_state active and task_state deleting.
Aug 26 08:41:44 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:41:44 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:41:44 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 08:41:44 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:41:44 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Took 1.69 seconds to deallocate network for instance.
Aug 26 08:41:44 user nova-compute[73104]: DEBUG nova.compute.manager [req-7b83b140-f7e2-4a52-8702-3a3ee830a7f8 req-c6afc7bf-b5dc-4f26-a714-efe1f9376447 service nova] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Received event network-vif-deleted-c0227129-949b-4dec-9100-d8282dfa4b87 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-203baa04-b724-4013-b041-64608dd4ffd7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-203baa04-b724-4013-b041-64608dd4ffd7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:45 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-203baa04-b724-4013-b041-64608dd4ffd7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:41:45 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693039290.1778243, 85eea82a-c221-4661-9525-06a925b57e1c => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:41:45 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] VM Stopped (Lifecycle Event)
Aug 26 08:41:45 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-203baa04-b724-4013-b041-64608dd4ffd7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:41:45 user nova-compute[73104]: DEBUG nova.compute.manager [None req-0cb10fda-f5f8-4715-9782-f49ef649d194 None None] [instance: 85eea82a-c221-4661-9525-06a925b57e1c] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:41:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-203baa04-b724-4013-b041-64608dd4ffd7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.441s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:45 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039305.3053448, 385c6d93-907d-42d7-9b43-479e6caf66f9 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:41:45 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] VM Resumed (Lifecycle Event)
Aug 26 08:41:45 user nova-compute[73104]: DEBUG nova.compute.manager [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:41:45 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Instance running successfully.
Aug 26 08:41:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Failed to set time: agent not configured {{(pid=73104) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 26 08:41:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-25780c16-c619-4df7-bb02-97ddff949203 tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] finish_migration finished successfully. {{(pid=73104) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 26 08:41:45 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-203baa04-b724-4013-b041-64608dd4ffd7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Deleted allocations for instance da850cb3-3d57-4243-8af8-13c7f3251787
Aug 26 08:41:45 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:41:45 user nova-compute[73104]: DEBUG nova.compute.manager [req-3d033531-59cf-488c-8a16-18ff40c88cc2 req-7bb6c3d6-b8a9-4f63-b8cc-4cda8dadc45b service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Received event network-vif-plugged-d4692900-c165-487d-9847-383fcf1d2270 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:41:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3d033531-59cf-488c-8a16-18ff40c88cc2 req-7bb6c3d6-b8a9-4f63-b8cc-4cda8dadc45b service nova] Acquiring lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3d033531-59cf-488c-8a16-18ff40c88cc2 req-7bb6c3d6-b8a9-4f63-b8cc-4cda8dadc45b service nova] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3d033531-59cf-488c-8a16-18ff40c88cc2 req-7bb6c3d6-b8a9-4f63-b8cc-4cda8dadc45b service nova] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:45 user nova-compute[73104]: DEBUG nova.compute.manager [req-3d033531-59cf-488c-8a16-18ff40c88cc2 req-7bb6c3d6-b8a9-4f63-b8cc-4cda8dadc45b service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] No waiting events found dispatching network-vif-plugged-d4692900-c165-487d-9847-383fcf1d2270 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:41:45 user nova-compute[73104]: WARNING nova.compute.manager [req-3d033531-59cf-488c-8a16-18ff40c88cc2 req-7bb6c3d6-b8a9-4f63-b8cc-4cda8dadc45b service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Received unexpected event network-vif-plugged-d4692900-c165-487d-9847-383fcf1d2270 for instance with vm_state active and task_state resize_finish.
Aug 26 08:41:45 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:41:45 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 08:41:45 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039305.3075187, 385c6d93-907d-42d7-9b43-479e6caf66f9 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:41:45 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] VM Started (Lifecycle Event)
Aug 26 08:41:45 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:41:45 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:41:45 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 08:41:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-203baa04-b724-4013-b041-64608dd4ffd7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "da850cb3-3d57-4243-8af8-13c7f3251787" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.909s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:46 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:41:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:46 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 08:41:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c433050-8e37-4929-aa50-a55a6fedd171/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c433050-8e37-4929-aa50-a55a6fedd171/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c433050-8e37-4929-aa50-a55a6fedd171/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c433050-8e37-4929-aa50-a55a6fedd171/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:46 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:41:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3963cffc-9397-45ca-bf80-198b219beb4f/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3963cffc-9397-45ca-bf80-198b219beb4f/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3963cffc-9397-45ca-bf80-198b219beb4f/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3963cffc-9397-45ca-bf80-198b219beb4f/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:47 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:41:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:48 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:41:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:49 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:41:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:41:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:41:49 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:41:49 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:41:49 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=7525MB free_disk=24.576171875GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 08:41:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:41:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:41:50 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Applying migration context for instance 385c6d93-907d-42d7-9b43-479e6caf66f9 as it has an incoming, in-progress migration 34377794-1383-41db-ab9f-219dc1867bba. Migration status is finished {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 08:41:50 user nova-compute[73104]: INFO nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Updating resource usage from migration 34377794-1383-41db-ab9f-219dc1867bba
Aug 26 08:41:50 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance dcec7631-b94f-4dbf-b85d-e8ad9c6396b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:41:50 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 13200b79-17a6-4c18-87da-653311946a04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:41:50 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 93244bcd-34be-46f3-85e6-87bb5e69888d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:41:50 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 7095c1e6-3825-47d2-8b63-5755fab42b49 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:41:50 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 7c433050-8e37-4929-aa50-a55a6fedd171 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:41:50 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 94de2062-7017-44fe-8df0-0a3cd63d5498 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:41:50 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Migration 34377794-1383-41db-ab9f-219dc1867bba is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 08:41:50 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 385c6d93-907d-42d7-9b43-479e6caf66f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:41:50 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 3963cffc-9397-45ca-bf80-198b219beb4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:41:50 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 08:41:50 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 08:41:50 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:50 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:41:50 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:41:50 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 08:41:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.606s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:41:52 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:41:52 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:41:52 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:41:52 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:41:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:57 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693039302.8509383, da850cb3-3d57-4243-8af8-13c7f3251787 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:41:57 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] VM Stopped (Lifecycle Event)
Aug 26 08:41:57 user nova-compute[73104]: DEBUG nova.compute.manager [None req-1012361f-c2ed-47de-a196-d66b4898ee62 None None] [instance: da850cb3-3d57-4243-8af8-13c7f3251787] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:41:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:41:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:01 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "b5e1f82c-5675-4c37-8ba2-44e6a341a576" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:42:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "b5e1f82c-5675-4c37-8ba2-44e6a341a576" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:42:07 user nova-compute[73104]: DEBUG nova.compute.manager [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:42:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:42:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:42:07 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:42:07 user nova-compute[73104]: INFO nova.compute.claims [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Claim successful on node user
Aug 26 08:42:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:08 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:42:08 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:42:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:42:08 user nova-compute[73104]: DEBUG nova.compute.manager [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:42:08 user nova-compute[73104]: DEBUG nova.compute.manager [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:42:08 user nova-compute[73104]: DEBUG nova.network.neutron [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:42:08 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:42:08 user nova-compute[73104]: DEBUG nova.compute.manager [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:42:08 user nova-compute[73104]: DEBUG nova.policy [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '257343af54bd42b591e8874ef4ecf8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb864c0a34541dca00c6dbbcea17319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:42:08 user nova-compute[73104]: DEBUG nova.compute.manager [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:42:08 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:42:08 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Creating image(s)
Aug 26 08:42:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:42:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "/opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:42:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "/opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:42:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.184s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:42:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:42:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.182s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk 1073741824" returned: 0 in 0.050s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:42:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.173s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:09 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 08:42:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:09 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Cannot resize image /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 08:42:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:42:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Ensure instance console log exists: /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:42:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:42:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:42:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:42:09 user nova-compute[73104]: DEBUG nova.network.neutron [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Successfully created port: 3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.network.neutron [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Successfully updated port: 3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "refresh_cache-b5e1f82c-5675-4c37-8ba2-44e6a341a576" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquired lock "refresh_cache-b5e1f82c-5675-4c37-8ba2-44e6a341a576" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.network.neutron [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.network.neutron [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.compute.manager [req-f45d1f9a-98f5-4fde-8b70-3c4c6336aa9d req-06824bea-a04e-4542-adb7-fc14d7ae854d service nova] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Received event network-changed-3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.compute.manager [req-f45d1f9a-98f5-4fde-8b70-3c4c6336aa9d req-06824bea-a04e-4542-adb7-fc14d7ae854d service nova] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Refreshing instance network info cache due to event network-changed-3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f45d1f9a-98f5-4fde-8b70-3c4c6336aa9d req-06824bea-a04e-4542-adb7-fc14d7ae854d service nova] Acquiring lock "refresh_cache-b5e1f82c-5675-4c37-8ba2-44e6a341a576" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.network.neutron [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Updating instance_info_cache with network_info: [{"id": "3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96", "address": "fa:16:3e:c0:56:86", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3913bdf7-1f", "ovs_interfaceid": "3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Releasing lock "refresh_cache-b5e1f82c-5675-4c37-8ba2-44e6a341a576" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.compute.manager [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Instance network_info: |[{"id": "3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96", "address": "fa:16:3e:c0:56:86", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3913bdf7-1f", "ovs_interfaceid": "3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f45d1f9a-98f5-4fde-8b70-3c4c6336aa9d req-06824bea-a04e-4542-adb7-fc14d7ae854d service nova] Acquired lock "refresh_cache-b5e1f82c-5675-4c37-8ba2-44e6a341a576" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.network.neutron [req-f45d1f9a-98f5-4fde-8b70-3c4c6336aa9d req-06824bea-a04e-4542-adb7-fc14d7ae854d service nova] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Refreshing network info cache for port 3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Start _get_guest_xml network_info=[{"id": "3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96", "address": "fa:16:3e:c0:56:86", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3913bdf7-1f", "ovs_interfaceid": "3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:42:10 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:42:10 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:42:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-896235300',display_name='tempest-ServerActionsTestOtherA-server-896235300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-896235300',id=17,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDd7CVbfrgJk+LANTVyASPXlTQ9/WFcC61mCbmrDUGOXT5afWNcplXvZ22xaA7blYJtw8QDJAtG8f1dybdt3ItZCTVqOwov6sASWzyNlxMeQebqYtQoQd/bQsWZ9J2R2Q==',key_name='tempest-keypair-923484929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efb864c0a34541dca00c6dbbcea17319',ramdisk_id='',reservation_id='r-dutocx91',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1245661612',owner_user_name='tempest-ServerActionsTestOtherA-1245661612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:42:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='257343af54bd42b591e8874ef4ecf8dc',uuid=b5e1f82c-5675-4c37-8ba2-44e6a341a576,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96", "address": "fa:16:3e:c0:56:86", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3913bdf7-1f", "ovs_interfaceid": "3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Converting VIF {"id": "3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96", "address": "fa:16:3e:c0:56:86", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3913bdf7-1f", "ovs_interfaceid": "3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:56:86,bridge_name='br-int',has_traffic_filtering=True,id=3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3913bdf7-1f') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.objects.instance [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lazy-loading 'pci_devices' on Instance uuid b5e1f82c-5675-4c37-8ba2-44e6a341a576 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:42:10 user nova-compute[73104]:   <uuid>b5e1f82c-5675-4c37-8ba2-44e6a341a576</uuid>
Aug 26 08:42:10 user nova-compute[73104]:   <name>instance-00000011</name>
Aug 26 08:42:10 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:42:10 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:42:10 user nova-compute[73104]:   <metadata>
Aug 26 08:42:10 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:42:10 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:42:10 user nova-compute[73104]:       <nova:name>tempest-ServerActionsTestOtherA-server-896235300</nova:name>
Aug 26 08:42:10 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:42:10</nova:creationTime>
Aug 26 08:42:10 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:42:10 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:42:10 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:42:10 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:42:10 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:42:10 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:42:10 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:42:10 user nova-compute[73104]:       <nova:owner>
Aug 26 08:42:10 user nova-compute[73104]:         <nova:user uuid="257343af54bd42b591e8874ef4ecf8dc">tempest-ServerActionsTestOtherA-1245661612-project-member</nova:user>
Aug 26 08:42:10 user nova-compute[73104]:         <nova:project uuid="efb864c0a34541dca00c6dbbcea17319">tempest-ServerActionsTestOtherA-1245661612</nova:project>
Aug 26 08:42:10 user nova-compute[73104]:       </nova:owner>
Aug 26 08:42:10 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:42:10 user nova-compute[73104]:       <nova:ports>
Aug 26 08:42:10 user nova-compute[73104]:         <nova:port uuid="3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96">
Aug 26 08:42:10 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 08:42:10 user nova-compute[73104]:         </nova:port>
Aug 26 08:42:10 user nova-compute[73104]:       </nova:ports>
Aug 26 08:42:10 user nova-compute[73104]:     </nova:instance>
Aug 26 08:42:10 user nova-compute[73104]:   </metadata>
Aug 26 08:42:10 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:42:10 user nova-compute[73104]:     <system>
Aug 26 08:42:10 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:42:10 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:42:10 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:42:10 user nova-compute[73104]:       <entry name="serial">b5e1f82c-5675-4c37-8ba2-44e6a341a576</entry>
Aug 26 08:42:10 user nova-compute[73104]:       <entry name="uuid">b5e1f82c-5675-4c37-8ba2-44e6a341a576</entry>
Aug 26 08:42:10 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:42:10 user nova-compute[73104]:     </system>
Aug 26 08:42:10 user nova-compute[73104]:   </sysinfo>
Aug 26 08:42:10 user nova-compute[73104]:   <os>
Aug 26 08:42:10 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:42:10 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:42:10 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:42:10 user nova-compute[73104]:   </os>
Aug 26 08:42:10 user nova-compute[73104]:   <features>
Aug 26 08:42:10 user nova-compute[73104]:     <acpi/>
Aug 26 08:42:10 user nova-compute[73104]:     <apic/>
Aug 26 08:42:10 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:42:10 user nova-compute[73104]:   </features>
Aug 26 08:42:10 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:42:10 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:42:10 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:42:10 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:42:10 user nova-compute[73104]:   </clock>
Aug 26 08:42:10 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:42:10 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:42:10 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:42:10 user nova-compute[73104]:   </cpu>
Aug 26 08:42:10 user nova-compute[73104]:   <devices>
Aug 26 08:42:10 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:42:10 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:42:10 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk"/>
Aug 26 08:42:10 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:42:10 user nova-compute[73104]:     </disk>
Aug 26 08:42:10 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:42:10 user nova-compute[73104]:       <mac address="fa:16:3e:c0:56:86"/>
Aug 26 08:42:10 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:42:10 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:42:10 user nova-compute[73104]:       <target dev="tap3913bdf7-1f"/>
Aug 26 08:42:10 user nova-compute[73104]:     </interface>
Aug 26 08:42:10 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:42:10 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/console.log" append="off"/>
Aug 26 08:42:10 user nova-compute[73104]:     </serial>
Aug 26 08:42:10 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:42:10 user nova-compute[73104]:     <video>
Aug 26 08:42:10 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:42:10 user nova-compute[73104]:     </video>
Aug 26 08:42:10 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:42:10 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:42:10 user nova-compute[73104]:     </rng>
Aug 26 08:42:10 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:42:10 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:42:10 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:42:10 user nova-compute[73104]:     </memballoon>
Aug 26 08:42:10 user nova-compute[73104]:   </devices>
Aug 26 08:42:10 user nova-compute[73104]: </domain>
Aug 26 08:42:10 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:42:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-896235300',display_name='tempest-ServerActionsTestOtherA-server-896235300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-896235300',id=17,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDd7CVbfrgJk+LANTVyASPXlTQ9/WFcC61mCbmrDUGOXT5afWNcplXvZ22xaA7blYJtw8QDJAtG8f1dybdt3ItZCTVqOwov6sASWzyNlxMeQebqYtQoQd/bQsWZ9J2R2Q==',key_name='tempest-keypair-923484929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efb864c0a34541dca00c6dbbcea17319',ramdisk_id='',reservation_id='r-dutocx91',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1245661612',owner_user_name='tempest-ServerActionsTestOtherA-1245661612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:42:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='257343af54bd42b591e8874ef4ecf8dc',uuid=b5e1f82c-5675-4c37-8ba2-44e6a341a576,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96", "address": "fa:16:3e:c0:56:86", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3913bdf7-1f", "ovs_interfaceid": "3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Converting VIF {"id": "3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96", "address": "fa:16:3e:c0:56:86", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3913bdf7-1f", "ovs_interfaceid": "3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:56:86,bridge_name='br-int',has_traffic_filtering=True,id=3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3913bdf7-1f') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG os_vif [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:56:86,bridge_name='br-int',has_traffic_filtering=True,id=3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3913bdf7-1f') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3913bdf7-1f, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3913bdf7-1f, col_values=(('external_ids', {'iface-id': '3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:56:86', 'vm-uuid': 'b5e1f82c-5675-4c37-8ba2-44e6a341a576'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:10 user nova-compute[73104]: INFO os_vif [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:56:86,bridge_name='br-int',has_traffic_filtering=True,id=3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3913bdf7-1f')
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:42:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] No VIF found with MAC fa:16:3e:c0:56:86, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:42:11 user nova-compute[73104]: DEBUG nova.network.neutron [req-f45d1f9a-98f5-4fde-8b70-3c4c6336aa9d req-06824bea-a04e-4542-adb7-fc14d7ae854d service nova] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Updated VIF entry in instance network info cache for port 3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:42:11 user nova-compute[73104]: DEBUG nova.network.neutron [req-f45d1f9a-98f5-4fde-8b70-3c4c6336aa9d req-06824bea-a04e-4542-adb7-fc14d7ae854d service nova] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Updating instance_info_cache with network_info: [{"id": "3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96", "address": "fa:16:3e:c0:56:86", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3913bdf7-1f", "ovs_interfaceid": "3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:42:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f45d1f9a-98f5-4fde-8b70-3c4c6336aa9d req-06824bea-a04e-4542-adb7-fc14d7ae854d service nova] Releasing lock "refresh_cache-b5e1f82c-5675-4c37-8ba2-44e6a341a576" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:42:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:12 user nova-compute[73104]: DEBUG nova.compute.manager [req-23930801-fe16-4afa-a3c6-f0d3731f6492 req-01854eb0-4ea0-442d-8427-4e5333f49540 service nova] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Received event network-vif-plugged-3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:42:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-23930801-fe16-4afa-a3c6-f0d3731f6492 req-01854eb0-4ea0-442d-8427-4e5333f49540 service nova] Acquiring lock "b5e1f82c-5675-4c37-8ba2-44e6a341a576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:42:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-23930801-fe16-4afa-a3c6-f0d3731f6492 req-01854eb0-4ea0-442d-8427-4e5333f49540 service nova] Lock "b5e1f82c-5675-4c37-8ba2-44e6a341a576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:42:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-23930801-fe16-4afa-a3c6-f0d3731f6492 req-01854eb0-4ea0-442d-8427-4e5333f49540 service nova] Lock "b5e1f82c-5675-4c37-8ba2-44e6a341a576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:42:12 user nova-compute[73104]: DEBUG nova.compute.manager [req-23930801-fe16-4afa-a3c6-f0d3731f6492 req-01854eb0-4ea0-442d-8427-4e5333f49540 service nova] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] No waiting events found dispatching network-vif-plugged-3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:42:12 user nova-compute[73104]: WARNING nova.compute.manager [req-23930801-fe16-4afa-a3c6-f0d3731f6492 req-01854eb0-4ea0-442d-8427-4e5333f49540 service nova] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Received unexpected event network-vif-plugged-3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96 for instance with vm_state building and task_state spawning.
Aug 26 08:42:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:14 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039334.291975, b5e1f82c-5675-4c37-8ba2-44e6a341a576 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:42:14 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] VM Resumed (Lifecycle Event)
Aug 26 08:42:14 user nova-compute[73104]: DEBUG nova.compute.manager [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:42:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:42:14 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Instance spawned successfully.
Aug 26 08:42:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:42:14 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:42:14 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:42:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:42:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:42:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:42:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:42:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:42:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:42:14 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:42:14 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039334.2956927, b5e1f82c-5675-4c37-8ba2-44e6a341a576 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:42:14 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] VM Started (Lifecycle Event)
Aug 26 08:42:14 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:42:14 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:42:14 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:42:14 user nova-compute[73104]: INFO nova.compute.manager [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Took 5.98 seconds to spawn the instance on the hypervisor.
Aug 26 08:42:14 user nova-compute[73104]: DEBUG nova.compute.manager [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:42:14 user nova-compute[73104]: INFO nova.compute.manager [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Took 6.80 seconds to build instance.
Aug 26 08:42:14 user nova-compute[73104]: DEBUG nova.compute.manager [req-1f2cf2c5-5825-43b1-8009-5a1ec638ee64 req-40931e18-0834-4cdd-bbdd-b12c92470b28 service nova] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Received event network-vif-plugged-3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:42:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1f2cf2c5-5825-43b1-8009-5a1ec638ee64 req-40931e18-0834-4cdd-bbdd-b12c92470b28 service nova] Acquiring lock "b5e1f82c-5675-4c37-8ba2-44e6a341a576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:42:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1f2cf2c5-5825-43b1-8009-5a1ec638ee64 req-40931e18-0834-4cdd-bbdd-b12c92470b28 service nova] Lock "b5e1f82c-5675-4c37-8ba2-44e6a341a576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:42:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1f2cf2c5-5825-43b1-8009-5a1ec638ee64 req-40931e18-0834-4cdd-bbdd-b12c92470b28 service nova] Lock "b5e1f82c-5675-4c37-8ba2-44e6a341a576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:42:14 user nova-compute[73104]: DEBUG nova.compute.manager [req-1f2cf2c5-5825-43b1-8009-5a1ec638ee64 req-40931e18-0834-4cdd-bbdd-b12c92470b28 service nova] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] No waiting events found dispatching network-vif-plugged-3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:42:14 user nova-compute[73104]: WARNING nova.compute.manager [req-1f2cf2c5-5825-43b1-8009-5a1ec638ee64 req-40931e18-0834-4cdd-bbdd-b12c92470b28 service nova] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Received unexpected event network-vif-plugged-3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96 for instance with vm_state active and task_state None.
Aug 26 08:42:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1ca6c55f-ad8e-4d83-bf3b-e03ad2117c51 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "b5e1f82c-5675-4c37-8ba2-44e6a341a576" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.906s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:42:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:25 user nova-compute[73104]: DEBUG nova.compute.manager [req-5c830a7b-4d8c-4a00-93a9-8414c94f2886 req-45863578-26df-438d-bc95-43038fee3737 service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Received event network-changed-85d806c2-eef6-493b-96cc-f04d9580652d {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:42:25 user nova-compute[73104]: DEBUG nova.compute.manager [req-5c830a7b-4d8c-4a00-93a9-8414c94f2886 req-45863578-26df-438d-bc95-43038fee3737 service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Refreshing instance network info cache due to event network-changed-85d806c2-eef6-493b-96cc-f04d9580652d. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:42:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5c830a7b-4d8c-4a00-93a9-8414c94f2886 req-45863578-26df-438d-bc95-43038fee3737 service nova] Acquiring lock "refresh_cache-7095c1e6-3825-47d2-8b63-5755fab42b49" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:42:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5c830a7b-4d8c-4a00-93a9-8414c94f2886 req-45863578-26df-438d-bc95-43038fee3737 service nova] Acquired lock "refresh_cache-7095c1e6-3825-47d2-8b63-5755fab42b49" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:42:25 user nova-compute[73104]: DEBUG nova.network.neutron [req-5c830a7b-4d8c-4a00-93a9-8414c94f2886 req-45863578-26df-438d-bc95-43038fee3737 service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Refreshing network info cache for port 85d806c2-eef6-493b-96cc-f04d9580652d {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:42:25 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:26 user nova-compute[73104]: DEBUG nova.network.neutron [req-5c830a7b-4d8c-4a00-93a9-8414c94f2886 req-45863578-26df-438d-bc95-43038fee3737 service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Updated VIF entry in instance network info cache for port 85d806c2-eef6-493b-96cc-f04d9580652d. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:42:26 user nova-compute[73104]: DEBUG nova.network.neutron [req-5c830a7b-4d8c-4a00-93a9-8414c94f2886 req-45863578-26df-438d-bc95-43038fee3737 service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Updating instance_info_cache with network_info: [{"id": "85d806c2-eef6-493b-96cc-f04d9580652d", "address": "fa:16:3e:6e:38:0c", "network": {"id": "ef7a15d0-8aa7-47da-948d-c0f35a723f6f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-316051521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0807a5c94bea4801bd80bbcdef223a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d806c2-ee", "ovs_interfaceid": "85d806c2-eef6-493b-96cc-f04d9580652d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:42:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5c830a7b-4d8c-4a00-93a9-8414c94f2886 req-45863578-26df-438d-bc95-43038fee3737 service nova] Releasing lock "refresh_cache-7095c1e6-3825-47d2-8b63-5755fab42b49" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:42:26 user nova-compute[73104]: INFO nova.compute.manager [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Rebuilding instance
Aug 26 08:42:26 user nova-compute[73104]: DEBUG nova.compute.manager [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:42:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:27 user nova-compute[73104]: DEBUG nova.compute.manager [req-6fae67bd-f4df-47d0-830a-41475623e77d req-bd8f5d88-10a1-4898-ade9-ca70e108204a service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Received event network-vif-unplugged-85d806c2-eef6-493b-96cc-f04d9580652d {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:42:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6fae67bd-f4df-47d0-830a-41475623e77d req-bd8f5d88-10a1-4898-ade9-ca70e108204a service nova] Acquiring lock "7095c1e6-3825-47d2-8b63-5755fab42b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:42:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6fae67bd-f4df-47d0-830a-41475623e77d req-bd8f5d88-10a1-4898-ade9-ca70e108204a service nova] Lock "7095c1e6-3825-47d2-8b63-5755fab42b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:42:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6fae67bd-f4df-47d0-830a-41475623e77d req-bd8f5d88-10a1-4898-ade9-ca70e108204a service nova] Lock "7095c1e6-3825-47d2-8b63-5755fab42b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:42:27 user nova-compute[73104]: DEBUG nova.compute.manager [req-6fae67bd-f4df-47d0-830a-41475623e77d req-bd8f5d88-10a1-4898-ade9-ca70e108204a service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] No waiting events found dispatching network-vif-unplugged-85d806c2-eef6-493b-96cc-f04d9580652d {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:42:27 user nova-compute[73104]: WARNING nova.compute.manager [req-6fae67bd-f4df-47d0-830a-41475623e77d req-bd8f5d88-10a1-4898-ade9-ca70e108204a service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Received unexpected event network-vif-unplugged-85d806c2-eef6-493b-96cc-f04d9580652d for instance with vm_state active and task_state rebuilding.
Aug 26 08:42:27 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Instance destroyed successfully.
Aug 26 08:42:27 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Instance destroyed successfully.
Aug 26 08:42:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:40:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1673391366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-485571378',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQRWVfsHBZ4hwdnYVLV5KlTz2Udh43BAhKR/jPOsxlxB/zEqEPc/lSYHzxwVfxX1lYbHxyjeV2oVVw1oFmsH/PJOpMAeQtZFJzj3QYTjDVApGkX3vb+qjI9Jl0kVdHhdQ==',key_name='tempest-keypair-247954255',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:41:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0807a5c94bea4801bd80bbcdef223a57',ramdisk_id='',reservation_id='r-0gki1p05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1626526271',owner_user_name='tempest-ServerActionsV293TestJSON-1626526271-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:42:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc49fb86f3ad4cc0930f0048701225d5',uuid=7095c1e6-3825-47d2-8b63-5755fab42b49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85d806c2-eef6-493b-96cc-f04d9580652d", "address": "fa:16:3e:6e:38:0c", "network": {"id": "ef7a15d0-8aa7-47da-948d-c0f35a723f6f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-316051521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0807a5c94bea4801bd80bbcdef223a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d806c2-ee", "ovs_interfaceid": "85d806c2-eef6-493b-96cc-f04d9580652d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:42:27 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Converting VIF {"id": "85d806c2-eef6-493b-96cc-f04d9580652d", "address": "fa:16:3e:6e:38:0c", "network": {"id": "ef7a15d0-8aa7-47da-948d-c0f35a723f6f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-316051521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0807a5c94bea4801bd80bbcdef223a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d806c2-ee", "ovs_interfaceid": "85d806c2-eef6-493b-96cc-f04d9580652d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:42:27 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:38:0c,bridge_name='br-int',has_traffic_filtering=True,id=85d806c2-eef6-493b-96cc-f04d9580652d,network=Network(ef7a15d0-8aa7-47da-948d-c0f35a723f6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85d806c2-ee') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:42:27 user nova-compute[73104]: DEBUG os_vif [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:38:0c,bridge_name='br-int',has_traffic_filtering=True,id=85d806c2-eef6-493b-96cc-f04d9580652d,network=Network(ef7a15d0-8aa7-47da-948d-c0f35a723f6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85d806c2-ee') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:42:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85d806c2-ee, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:42:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:42:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:27 user nova-compute[73104]: INFO os_vif [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:38:0c,bridge_name='br-int',has_traffic_filtering=True,id=85d806c2-eef6-493b-96cc-f04d9580652d,network=Network(ef7a15d0-8aa7-47da-948d-c0f35a723f6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85d806c2-ee')
Aug 26 08:42:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:42:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'weZcSxGo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:42:27 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 08:42:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:42:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:42:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:42:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:27 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[21673637-1f7f-443d-b091-bc6df961b8cc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:27 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2df615-7cac-4670-af2d-682ab876601a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:42:27 user nova-compute[73104]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:42:27 user nova-compute[73104]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 (non-flash)
Aug 26 08:42:27 user nova-compute[73104]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:42:27 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:42:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:42:27 user nova-compute[73104]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:42:27 user nova-compute[73104]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 (non-flash)
Aug 26 08:42:27 user nova-compute[73104]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:42:27 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:42:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0c4689f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207'): ({'sdj'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:42:27 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Removing single pathed devices sdj {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:42:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.036s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:27 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc97dd1-6a52-4861-b303-6e560235518b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.028s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe8603b-5c48-4da3-8ecf-103b3badcf50]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Flushing IO for device /dev/sdj {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ff2215-f69c-466b-aa44-1093babcffa1]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.054s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91fd430-0211-4208-8cea-cbfac3435c84]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] SCSI volumes sdj have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOf51c55f7-b9b8f511f0ef79b1', '/dev/disk/by-id/scsi-26239623866353131', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f51c55f7') {{(pid=84263) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0d227d-4a91-4dfb-b0e9-b01433337aa9]: (4, None) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bb2b79-6479-4a00-be07-5c451441d7a8]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f8a40a-7a62-4d68-a151-94db34170248]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207, portal: 172.16.0.220,3260]
Aug 26 08:42:28 user nova-compute[73104]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207, portal: 172.16.0.220,3260] successful.
Aug 26 08:42:28 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4268ae-6ddc-4b04-b594-270abef13619]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] <== disconnect_volume: return (366ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:42:28 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Deleting instance files /opt/stack/data/nova/instances/7095c1e6-3825-47d2-8b63-5755fab42b49_del
Aug 26 08:42:28 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Deletion of /opt/stack/data/nova/instances/7095c1e6-3825-47d2-8b63-5755fab42b49_del complete
Aug 26 08:42:28 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 7095c1e6-3825-47d2-8b63-5755fab42b49 could not be found.
Aug 26 08:42:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'weZcSxGo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:42:28 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 08:42:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5090a31-973f-4d52-a740-d3056b7be304]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f8fcd8-df39-4e80-b75c-bf1694696de1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:42:28 user nova-compute[73104]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 (non-flash)
Aug 26 08:42:28 user nova-compute[73104]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:42:28 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:42:28 user nova-compute[73104]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 (non-flash)
Aug 26 08:42:28 user nova-compute[73104]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:42:28 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b4781900>, {}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Disconnecting from: [] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.056s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] <== disconnect_volume: return (57ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:42:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:29 user nova-compute[73104]: DEBUG nova.compute.manager [req-f51409c8-2f5d-41f5-85ee-6bbda85fb3f6 req-49872cbd-7dc6-44ec-82cb-07710b8842ee service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Received event network-vif-plugged-85d806c2-eef6-493b-96cc-f04d9580652d {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:42:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f51409c8-2f5d-41f5-85ee-6bbda85fb3f6 req-49872cbd-7dc6-44ec-82cb-07710b8842ee service nova] Acquiring lock "7095c1e6-3825-47d2-8b63-5755fab42b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:42:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f51409c8-2f5d-41f5-85ee-6bbda85fb3f6 req-49872cbd-7dc6-44ec-82cb-07710b8842ee service nova] Lock "7095c1e6-3825-47d2-8b63-5755fab42b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:42:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f51409c8-2f5d-41f5-85ee-6bbda85fb3f6 req-49872cbd-7dc6-44ec-82cb-07710b8842ee service nova] Lock "7095c1e6-3825-47d2-8b63-5755fab42b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:42:29 user nova-compute[73104]: DEBUG nova.compute.manager [req-f51409c8-2f5d-41f5-85ee-6bbda85fb3f6 req-49872cbd-7dc6-44ec-82cb-07710b8842ee service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] No waiting events found dispatching network-vif-plugged-85d806c2-eef6-493b-96cc-f04d9580652d {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:42:29 user nova-compute[73104]: WARNING nova.compute.manager [req-f51409c8-2f5d-41f5-85ee-6bbda85fb3f6 req-49872cbd-7dc6-44ec-82cb-07710b8842ee service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Received unexpected event network-vif-plugged-85d806c2-eef6-493b-96cc-f04d9580652d for instance with vm_state active and task_state rebuilding.
Aug 26 08:42:29 user nova-compute[73104]: DEBUG nova.compute.manager [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Preparing to wait for external event volume-reimaged-b1752f0e-7e98-4f66-8c11-e5bb3410c207 {{(pid=73104) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 26 08:42:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Acquiring lock "7095c1e6-3825-47d2-8b63-5755fab42b49-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:42:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lock "7095c1e6-3825-47d2-8b63-5755fab42b49-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:42:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lock "7095c1e6-3825-47d2-8b63-5755fab42b49-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:42:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-97a31c53-d39a-4c50-9ba7-ae9197299990 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "13200b79-17a6-4c18-87da-653311946a04" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-97a31c53-d39a-4c50-9ba7-ae9197299990 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "13200b79-17a6-4c18-87da-653311946a04" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:42:33 user nova-compute[73104]: INFO nova.compute.manager [None req-97a31c53-d39a-4c50-9ba7-ae9197299990 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Detaching volume 509cda48-d4cc-4341-bd5b-25cc81265966
Aug 26 08:42:33 user nova-compute[73104]: INFO nova.virt.block_device [None req-97a31c53-d39a-4c50-9ba7-ae9197299990 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Attempting to driver detach volume 509cda48-d4cc-4341-bd5b-25cc81265966 from mountpoint /dev/vdb
Aug 26 08:42:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-97a31c53-d39a-4c50-9ba7-ae9197299990 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Attempting to detach device vdb from instance 13200b79-17a6-4c18-87da-653311946a04 from the persistent domain config. {{(pid=73104) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-97a31c53-d39a-4c50-9ba7-ae9197299990 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:42:33 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:42:33 user nova-compute[73104]:   <source dev="/dev/sdi"/>
Aug 26 08:42:33 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:42:33 user nova-compute[73104]:   <serial>509cda48-d4cc-4341-bd5b-25cc81265966</serial>
Aug 26 08:42:33 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 08:42:33 user nova-compute[73104]: </disk>
Aug 26 08:42:33 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:42:33 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-97a31c53-d39a-4c50-9ba7-ae9197299990 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Successfully detached device vdb from instance 13200b79-17a6-4c18-87da-653311946a04 from the persistent domain config.
Aug 26 08:42:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-97a31c53-d39a-4c50-9ba7-ae9197299990 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 13200b79-17a6-4c18-87da-653311946a04 from the live domain config. {{(pid=73104) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-97a31c53-d39a-4c50-9ba7-ae9197299990 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:42:33 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:42:33 user nova-compute[73104]:   <source dev="/dev/sdi"/>
Aug 26 08:42:33 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:42:33 user nova-compute[73104]:   <serial>509cda48-d4cc-4341-bd5b-25cc81265966</serial>
Aug 26 08:42:33 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 08:42:33 user nova-compute[73104]: </disk>
Aug 26 08:42:33 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Received event <DeviceRemovedEvent: 1693039353.804581, 13200b79-17a6-4c18-87da-653311946a04 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73104) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-97a31c53-d39a-4c50-9ba7-ae9197299990 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 13200b79-17a6-4c18-87da-653311946a04 {{(pid=73104) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 08:42:33 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-97a31c53-d39a-4c50-9ba7-ae9197299990 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Successfully detached device vdb from instance 13200b79-17a6-4c18-87da-653311946a04 from the live domain config.
Aug 26 08:42:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97a31c53-d39a-4c50-9ba7-ae9197299990 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-97a31c53-d39a-4c50-9ba7-ae9197299990 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CnVhZiGL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:42:33 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-97a31c53-d39a-4c50-9ba7-ae9197299990 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:42:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-97a31c53-d39a-4c50-9ba7-ae9197299990 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-97a31c53-d39a-4c50-9ba7-ae9197299990 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-97a31c53-d39a-4c50-9ba7-ae9197299990 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ce2804-5ee6-4c58-bda1-7ec1a7b55f38]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dcaa4b-0d9e-4445-a421-0e0c3111cdb4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-97a31c53-d39a-4c50-9ba7-ae9197299990 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:42:33 user nova-compute[73104]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 (non-flash)
Aug 26 08:42:33 user nova-compute[73104]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:42:33 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-97a31c53-d39a-4c50-9ba7-ae9197299990 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 (non-flash)
Aug 26 08:42:33 user nova-compute[73104]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 (non-flash)
Aug 26 08:42:33 user nova-compute[73104]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:42:33 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-97a31c53-d39a-4c50-9ba7-ae9197299990 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0c41bd3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966'): ({'sdi'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-97a31c53-d39a-4c50-9ba7-ae9197299990 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Removing single pathed devices sdi {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[10370006-955f-428c-b096-9836b3523375]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d504709-ea39-47f0-94b7-f8d040c9ce01]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-97a31c53-d39a-4c50-9ba7-ae9197299990 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Flushing IO for device /dev/sdi {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[43aca321-b7d7-4913-9f3d-b8766bf7cc2c]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-97a31c53-d39a-4c50-9ba7-ae9197299990 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.036s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f396c3ce-147c-4120-8ff4-e9e2bb585143]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-97a31c53-d39a-4c50-9ba7-ae9197299990 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-97a31c53-d39a-4c50-9ba7-ae9197299990 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] SCSI volumes sdi have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-97a31c53-d39a-4c50-9ba7-ae9197299990 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:42:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:34 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e05e24-960d-495d-998d-e2a79ce85835]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:34 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-97a31c53-d39a-4c50-9ba7-ae9197299990 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:42:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:34 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[88754561-e57c-45ba-a6aa-5c142524cd16]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:34 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-97a31c53-d39a-4c50-9ba7-ae9197299990 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966, portal: 172.16.0.220,3260]
Aug 26 08:42:34 user nova-compute[73104]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966, portal: 172.16.0.220,3260] successful.
Aug 26 08:42:34 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:42:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:509cda48-d4cc-4341-bd5b-25cc81265966 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:34 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4221e1-d7b2-452e-b512-4a1a74c84a6c]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:34 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-97a31c53-d39a-4c50-9ba7-ae9197299990 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:42:34 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-97a31c53-d39a-4c50-9ba7-ae9197299990 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:42:34 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-97a31c53-d39a-4c50-9ba7-ae9197299990 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] <== disconnect_volume: return (284ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:42:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97a31c53-d39a-4c50-9ba7-ae9197299990 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:42:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:41 user nova-compute[73104]: DEBUG nova.objects.instance [None req-97a31c53-d39a-4c50-9ba7-ae9197299990 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lazy-loading 'flavor' on Instance uuid 13200b79-17a6-4c18-87da-653311946a04 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:42:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-97a31c53-d39a-4c50-9ba7-ae9197299990 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "13200b79-17a6-4c18-87da-653311946a04" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.870s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:42:42 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693039347.8020923, 7095c1e6-3825-47d2-8b63-5755fab42b49 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:42:42 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] VM Stopped (Lifecycle Event)
Aug 26 08:42:42 user nova-compute[73104]: DEBUG nova.compute.manager [None req-4c08bff2-7746-4899-b4ed-fd4570ccd79c None None] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:42:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:44 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:42:45 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:42:45 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 08:42:45 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Rebuilding the list of instances to heal {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 08:42:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-dcec7631-b94f-4dbf-b85d-e8ad9c6396b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:42:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-dcec7631-b94f-4dbf-b85d-e8ad9c6396b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:42:45 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 08:42:45 user nova-compute[73104]: DEBUG nova.objects.instance [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lazy-loading 'info_cache' on Instance uuid dcec7631-b94f-4dbf-b85d-e8ad9c6396b7 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:42:45 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Updating instance_info_cache with network_info: [{"id": "be09acc4-f1a1-40a1-bfab-90b23ac8000c", "address": "fa:16:3e:f0:64:0b", "network": {"id": "c6ce9852-f528-4ac1-aa7a-be833ed25137", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2003310403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a0141c91ef45e4bf23a4b1cc4eb029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe09acc4-f1", "ovs_interfaceid": "be09acc4-f1a1-40a1-bfab-90b23ac8000c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:42:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-dcec7631-b94f-4dbf-b85d-e8ad9c6396b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:42:45 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 08:42:45 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:42:45 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 08:42:45 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:42:45 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73104) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 08:42:45 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:42:46 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b23bf4e0-ebcf-4439-bf54-155a4e1c0a78 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "94de2062-7017-44fe-8df0-0a3cd63d5498" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b23bf4e0-ebcf-4439-bf54-155a4e1c0a78 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:42:47 user nova-compute[73104]: WARNING nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Aug 26 08:42:47 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Triggering sync for uuid dcec7631-b94f-4dbf-b85d-e8ad9c6396b7 {{(pid=73104) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Triggering sync for uuid 94de2062-7017-44fe-8df0-0a3cd63d5498 {{(pid=73104) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Triggering sync for uuid 13200b79-17a6-4c18-87da-653311946a04 {{(pid=73104) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Triggering sync for uuid 385c6d93-907d-42d7-9b43-479e6caf66f9 {{(pid=73104) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Triggering sync for uuid 93244bcd-34be-46f3-85e6-87bb5e69888d {{(pid=73104) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Triggering sync for uuid 7095c1e6-3825-47d2-8b63-5755fab42b49 {{(pid=73104) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Triggering sync for uuid 7c433050-8e37-4929-aa50-a55a6fedd171 {{(pid=73104) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Triggering sync for uuid 3963cffc-9397-45ca-bf80-198b219beb4f {{(pid=73104) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Triggering sync for uuid b5e1f82c-5675-4c37-8ba2-44e6a341a576 {{(pid=73104) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "dcec7631-b94f-4dbf-b85d-e8ad9c6396b7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "dcec7631-b94f-4dbf-b85d-e8ad9c6396b7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "94de2062-7017-44fe-8df0-0a3cd63d5498" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "13200b79-17a6-4c18-87da-653311946a04" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "13200b79-17a6-4c18-87da-653311946a04" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "385c6d93-907d-42d7-9b43-479e6caf66f9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "93244bcd-34be-46f3-85e6-87bb5e69888d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "93244bcd-34be-46f3-85e6-87bb5e69888d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "7095c1e6-3825-47d2-8b63-5755fab42b49" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "7095c1e6-3825-47d2-8b63-5755fab42b49" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:42:47 user nova-compute[73104]: INFO nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] During sync_power_state the instance has a pending task (rebuilding). Skip.
Aug 26 08:42:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "7095c1e6-3825-47d2-8b63-5755fab42b49" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "7c433050-8e37-4929-aa50-a55a6fedd171" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "7c433050-8e37-4929-aa50-a55a6fedd171" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "3963cffc-9397-45ca-bf80-198b219beb4f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "3963cffc-9397-45ca-bf80-198b219beb4f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "b5e1f82c-5675-4c37-8ba2-44e6a341a576" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "b5e1f82c-5675-4c37-8ba2-44e6a341a576" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:42:47 user nova-compute[73104]: INFO nova.compute.manager [None req-b23bf4e0-ebcf-4439-bf54-155a4e1c0a78 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Detaching volume 5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80
Aug 26 08:42:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "7c433050-8e37-4929-aa50-a55a6fedd171" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "93244bcd-34be-46f3-85e6-87bb5e69888d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "b5e1f82c-5675-4c37-8ba2-44e6a341a576" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "13200b79-17a6-4c18-87da-653311946a04" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "dcec7631-b94f-4dbf-b85d-e8ad9c6396b7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.121s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:42:47 user nova-compute[73104]: INFO nova.virt.block_device [None req-b23bf4e0-ebcf-4439-bf54-155a4e1c0a78 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Attempting to driver detach volume 5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 from mountpoint /dev/vdc
Aug 26 08:42:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "3963cffc-9397-45ca-bf80-198b219beb4f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.150s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b23bf4e0-ebcf-4439-bf54-155a4e1c0a78 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Attempting to detach device vdc from instance 94de2062-7017-44fe-8df0-0a3cd63d5498 from the persistent domain config. {{(pid=73104) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-b23bf4e0-ebcf-4439-bf54-155a4e1c0a78 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:42:47 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:42:47 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 08:42:47 user nova-compute[73104]:   <target dev="vdc" bus="virtio"/>
Aug 26 08:42:47 user nova-compute[73104]:   <serial>5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80</serial>
Aug 26 08:42:47 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 08:42:47 user nova-compute[73104]: </disk>
Aug 26 08:42:47 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:42:47 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-b23bf4e0-ebcf-4439-bf54-155a4e1c0a78 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Successfully detached device vdc from instance 94de2062-7017-44fe-8df0-0a3cd63d5498 from the persistent domain config.
Aug 26 08:42:47 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b23bf4e0-ebcf-4439-bf54-155a4e1c0a78 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 94de2062-7017-44fe-8df0-0a3cd63d5498 from the live domain config. {{(pid=73104) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-b23bf4e0-ebcf-4439-bf54-155a4e1c0a78 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:42:47 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:42:47 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 08:42:47 user nova-compute[73104]:   <target dev="vdc" bus="virtio"/>
Aug 26 08:42:47 user nova-compute[73104]:   <serial>5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80</serial>
Aug 26 08:42:47 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 08:42:47 user nova-compute[73104]: </disk>
Aug 26 08:42:47 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:42:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Received event <DeviceRemovedEvent: 1693039368.3474214, 94de2062-7017-44fe-8df0-0a3cd63d5498 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73104) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b23bf4e0-ebcf-4439-bf54-155a4e1c0a78 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 94de2062-7017-44fe-8df0-0a3cd63d5498 {{(pid=73104) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 08:42:48 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-b23bf4e0-ebcf-4439-bf54-155a4e1c0a78 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Successfully detached device vdc from instance 94de2062-7017-44fe-8df0-0a3cd63d5498 from the live domain config.
Aug 26 08:42:48 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b23bf4e0-ebcf-4439-bf54-155a4e1c0a78 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b23bf4e0-ebcf-4439-bf54-155a4e1c0a78 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeTRDnvu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:42:48 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-b23bf4e0-ebcf-4439-bf54-155a4e1c0a78 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:42:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b23bf4e0-ebcf-4439-bf54-155a4e1c0a78 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b23bf4e0-ebcf-4439-bf54-155a4e1c0a78 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b23bf4e0-ebcf-4439-bf54-155a4e1c0a78 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44438dd-58cd-4f83-b35d-efcd6b19827d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00c371e-1d8d-42d1-a7b5-70d13b4968cf]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b23bf4e0-ebcf-4439-bf54-155a4e1c0a78 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 (non-flash)
Aug 26 08:42:48 user nova-compute[73104]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:42:48 user nova-compute[73104]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:42:48 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b23bf4e0-ebcf-4439-bf54-155a4e1c0a78 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 (non-flash)
Aug 26 08:42:48 user nova-compute[73104]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:42:48 user nova-compute[73104]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:42:48 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b23bf4e0-ebcf-4439-bf54-155a4e1c0a78 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0cc173c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80'): ({'sdb'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b23bf4e0-ebcf-4439-bf54-155a4e1c0a78 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Removing single pathed devices sdb {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde9331a-3d5e-444d-bc02-3391427737e4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6ed8ad-3d4e-49ab-994a-dd865104f3b4]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b23bf4e0-ebcf-4439-bf54-155a4e1c0a78 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Flushing IO for device /dev/sdb {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.046s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df4d4d5-4dfe-48e6-892d-d5588bc4fb23]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b23bf4e0-ebcf-4439-bf54-155a4e1c0a78 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c433050-8e37-4929-aa50-a55a6fedd171/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[36758958-15ca-4b1e-8f22-490c1ee72ffb]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b23bf4e0-ebcf-4439-bf54-155a4e1c0a78 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b23bf4e0-ebcf-4439-bf54-155a4e1c0a78 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b23bf4e0-ebcf-4439-bf54-155a4e1c0a78 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca90c9b-f74a-4fba-ad2e-02f2b7e22699]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b23bf4e0-ebcf-4439-bf54-155a4e1c0a78 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd68ddfd-2589-46d6-94c0-f0b667eb07f0]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b23bf4e0-ebcf-4439-bf54-155a4e1c0a78 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80, portal: 172.16.0.220,3260]
Aug 26 08:42:48 user nova-compute[73104]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80, portal: 172.16.0.220,3260] successful.
Aug 26 08:42:48 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ae9b1ad-ff5a-4fb9-b023-f2b2ae7c6a80 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b15de41-1440-47bf-b072-644c5047c3cc]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b23bf4e0-ebcf-4439-bf54-155a4e1c0a78 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b23bf4e0-ebcf-4439-bf54-155a4e1c0a78 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b23bf4e0-ebcf-4439-bf54-155a4e1c0a78 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] <== disconnect_volume: return (337ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b23bf4e0-ebcf-4439-bf54-155a4e1c0a78 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c433050-8e37-4929-aa50-a55a6fedd171/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c433050-8e37-4929-aa50-a55a6fedd171/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c433050-8e37-4929-aa50-a55a6fedd171/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3963cffc-9397-45ca-bf80-198b219beb4f/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3963cffc-9397-45ca-bf80-198b219beb4f/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3963cffc-9397-45ca-bf80-198b219beb4f/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3963cffc-9397-45ca-bf80-198b219beb4f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:49 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:49 user nova-compute[73104]: DEBUG nova.objects.instance [None req-b23bf4e0-ebcf-4439-bf54-155a4e1c0a78 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lazy-loading 'flavor' on Instance uuid 94de2062-7017-44fe-8df0-0a3cd63d5498 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:42:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b23bf4e0-ebcf-4439-bf54-155a4e1c0a78 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.415s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:42:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.406s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:42:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:42:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:50 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:51 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:42:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:52 user nova-compute[73104]: DEBUG nova.compute.manager [req-55b13c9f-014b-4739-9004-3ee03ef5842d req-e450d942-0284-472d-8667-8beebc11d2eb service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Received event volume-reimaged-b1752f0e-7e98-4f66-8c11-e5bb3410c207 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:42:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-55b13c9f-014b-4739-9004-3ee03ef5842d req-e450d942-0284-472d-8667-8beebc11d2eb service nova] Acquiring lock "7095c1e6-3825-47d2-8b63-5755fab42b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:42:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-55b13c9f-014b-4739-9004-3ee03ef5842d req-e450d942-0284-472d-8667-8beebc11d2eb service nova] Lock "7095c1e6-3825-47d2-8b63-5755fab42b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:42:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-55b13c9f-014b-4739-9004-3ee03ef5842d req-e450d942-0284-472d-8667-8beebc11d2eb service nova] Lock "7095c1e6-3825-47d2-8b63-5755fab42b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:42:52 user nova-compute[73104]: DEBUG nova.compute.manager [req-55b13c9f-014b-4739-9004-3ee03ef5842d req-e450d942-0284-472d-8667-8beebc11d2eb service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Processing event volume-reimaged-b1752f0e-7e98-4f66-8c11-e5bb3410c207 {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 26 08:42:52 user nova-compute[73104]: DEBUG nova.compute.manager [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Instance event wait completed in 22 seconds for volume-reimaged {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:42:52 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:42:52 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:42:52 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=7268MB free_disk=24.485313415527344GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 08:42:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:42:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:42:52 user nova-compute[73104]: INFO nova.virt.block_device [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Booting with volume b1752f0e-7e98-4f66-8c11-e5bb3410c207 at /dev/vda
Aug 26 08:42:52 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Applying migration context for instance 385c6d93-907d-42d7-9b43-479e6caf66f9 as it has an incoming, in-progress migration 34377794-1383-41db-ab9f-219dc1867bba. Migration status is finished {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 08:42:52 user nova-compute[73104]: INFO nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Updating resource usage from migration 34377794-1383-41db-ab9f-219dc1867bba
Aug 26 08:42:52 user nova-compute[73104]: DEBUG os_brick.utils [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:42:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:52 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1fbd54-afd4-4fca-9e89-f3643074b28e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:52 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7c3fd5-6ea7-48f0-954c-91e1c0622f03]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:42:52 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3a804c-8126-4cb1-b483-80fec682bdab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:52 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[06dd31c9-9790-429b-84bb-b9961fb34505]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:42:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:42:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:42:53 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance dcec7631-b94f-4dbf-b85d-e8ad9c6396b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:42:53 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 13200b79-17a6-4c18-87da-653311946a04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:42:53 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 93244bcd-34be-46f3-85e6-87bb5e69888d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:42:53 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 7095c1e6-3825-47d2-8b63-5755fab42b49 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:42:53 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 7c433050-8e37-4929-aa50-a55a6fedd171 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:42:53 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 94de2062-7017-44fe-8df0-0a3cd63d5498 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:42:53 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Migration 34377794-1383-41db-ab9f-219dc1867bba is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 08:42:53 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 385c6d93-907d-42d7-9b43-479e6caf66f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:42:53 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 3963cffc-9397-45ca-bf80-198b219beb4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:42:53 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance b5e1f82c-5675-4c37-8ba2-44e6a341a576 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:42:53 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 08:42:53 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 08:42:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:42:53 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:42:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[966e4e5d-8770-4671-b2d3-4e03c6d87822]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:42:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:42:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:42:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:42:53 user nova-compute[73104]: DEBUG os_brick.utils [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] <== get_connector_properties: return (525ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:42:53 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Updating existing volume attachment record: b43cf8a8-393e-4444-9a90-45246b92498b {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 08:42:53 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Refreshing inventories for resource provider 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 08:42:53 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Updating ProviderTree inventory for provider 8a2a2397-4d47-4524-8146-84db4225a812 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 08:42:53 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Updating inventory in ProviderTree for provider 8a2a2397-4d47-4524-8146-84db4225a812 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 08:42:53 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Refreshing aggregate associations for resource provider 8a2a2397-4d47-4524-8146-84db4225a812, aggregates: None {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 08:42:53 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Refreshing trait associations for resource provider 8a2a2397-4d47-4524-8146-84db4225a812, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 08:42:53 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:42:53 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:42:53 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 08:42:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.268s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:42:53 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:42:53 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Cleaning up deleted instances {{(pid=73104) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 08:42:53 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] There are 0 instances to clean {{(pid=73104) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 08:42:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-aa21006d-06c1-417d-908a-99da16d2e671 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Acquiring lock "7c433050-8e37-4929-aa50-a55a6fedd171" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:42:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-aa21006d-06c1-417d-908a-99da16d2e671 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "7c433050-8e37-4929-aa50-a55a6fedd171" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:42:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-aa21006d-06c1-417d-908a-99da16d2e671 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Acquiring lock "7c433050-8e37-4929-aa50-a55a6fedd171-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:42:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-aa21006d-06c1-417d-908a-99da16d2e671 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "7c433050-8e37-4929-aa50-a55a6fedd171-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:42:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-aa21006d-06c1-417d-908a-99da16d2e671 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "7c433050-8e37-4929-aa50-a55a6fedd171-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:42:54 user nova-compute[73104]: INFO nova.compute.manager [None req-aa21006d-06c1-417d-908a-99da16d2e671 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Terminating instance
Aug 26 08:42:54 user nova-compute[73104]: DEBUG nova.compute.manager [None req-aa21006d-06c1-417d-908a-99da16d2e671 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 08:42:54 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:42:54 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:42:54 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:42:54 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:42:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:55 user nova-compute[73104]: DEBUG nova.compute.manager [req-9a58c9e7-6599-4c14-b30d-e09682dc98d1 req-1021aee9-99ba-428d-bfff-a29eaac36b81 service nova] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Received event network-vif-unplugged-affefe3c-1cfa-41fd-a361-5d40b56728ab {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:42:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9a58c9e7-6599-4c14-b30d-e09682dc98d1 req-1021aee9-99ba-428d-bfff-a29eaac36b81 service nova] Acquiring lock "7c433050-8e37-4929-aa50-a55a6fedd171-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:42:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9a58c9e7-6599-4c14-b30d-e09682dc98d1 req-1021aee9-99ba-428d-bfff-a29eaac36b81 service nova] Lock "7c433050-8e37-4929-aa50-a55a6fedd171-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:42:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9a58c9e7-6599-4c14-b30d-e09682dc98d1 req-1021aee9-99ba-428d-bfff-a29eaac36b81 service nova] Lock "7c433050-8e37-4929-aa50-a55a6fedd171-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:42:55 user nova-compute[73104]: DEBUG nova.compute.manager [req-9a58c9e7-6599-4c14-b30d-e09682dc98d1 req-1021aee9-99ba-428d-bfff-a29eaac36b81 service nova] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] No waiting events found dispatching network-vif-unplugged-affefe3c-1cfa-41fd-a361-5d40b56728ab {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:42:55 user nova-compute[73104]: DEBUG nova.compute.manager [req-9a58c9e7-6599-4c14-b30d-e09682dc98d1 req-1021aee9-99ba-428d-bfff-a29eaac36b81 service nova] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Received event network-vif-unplugged-affefe3c-1cfa-41fd-a361-5d40b56728ab for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:42:55 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Instance destroyed successfully.
Aug 26 08:42:55 user nova-compute[73104]: DEBUG nova.objects.instance [None req-aa21006d-06c1-417d-908a-99da16d2e671 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lazy-loading 'resources' on Instance uuid 7c433050-8e37-4929-aa50-a55a6fedd171 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:42:55 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-aa21006d-06c1-417d-908a-99da16d2e671 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:40:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-382989856',display_name='tempest-VolumesAdminNegativeTest-server-382989856',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-382989856',id=15,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:40:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef6f6e226b23400481b2ad063356bc06',ramdisk_id='',reservation_id='r-sm7tt7xo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-933148822',owner_user_name='tempest-VolumesAdminNegativeTest-933148822-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:40:50Z,user_data=None,user_id='5653cc2733b44477957b797143a854f6',uuid=7c433050-8e37-4929-aa50-a55a6fedd171,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "affefe3c-1cfa-41fd-a361-5d40b56728ab", "address": "fa:16:3e:f4:4f:ea", "network": {"id": "58299b40-db54-4ba9-b4aa-8a40f0c2c2d4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-295087397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef6f6e226b23400481b2ad063356bc06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffefe3c-1c", "ovs_interfaceid": "affefe3c-1cfa-41fd-a361-5d40b56728ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:42:55 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-aa21006d-06c1-417d-908a-99da16d2e671 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Converting VIF {"id": "affefe3c-1cfa-41fd-a361-5d40b56728ab", "address": "fa:16:3e:f4:4f:ea", "network": {"id": "58299b40-db54-4ba9-b4aa-8a40f0c2c2d4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-295087397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef6f6e226b23400481b2ad063356bc06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffefe3c-1c", "ovs_interfaceid": "affefe3c-1cfa-41fd-a361-5d40b56728ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:42:55 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-aa21006d-06c1-417d-908a-99da16d2e671 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:4f:ea,bridge_name='br-int',has_traffic_filtering=True,id=affefe3c-1cfa-41fd-a361-5d40b56728ab,network=Network(58299b40-db54-4ba9-b4aa-8a40f0c2c2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaffefe3c-1c') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:42:55 user nova-compute[73104]: DEBUG os_vif [None req-aa21006d-06c1-417d-908a-99da16d2e671 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:4f:ea,bridge_name='br-int',has_traffic_filtering=True,id=affefe3c-1cfa-41fd-a361-5d40b56728ab,network=Network(58299b40-db54-4ba9-b4aa-8a40f0c2c2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaffefe3c-1c') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:42:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaffefe3c-1c, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:42:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:42:55 user nova-compute[73104]: INFO os_vif [None req-aa21006d-06c1-417d-908a-99da16d2e671 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:4f:ea,bridge_name='br-int',has_traffic_filtering=True,id=affefe3c-1cfa-41fd-a361-5d40b56728ab,network=Network(58299b40-db54-4ba9-b4aa-8a40f0c2c2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaffefe3c-1c')
Aug 26 08:42:55 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-aa21006d-06c1-417d-908a-99da16d2e671 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Deleting instance files /opt/stack/data/nova/instances/7c433050-8e37-4929-aa50-a55a6fedd171_del
Aug 26 08:42:55 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-aa21006d-06c1-417d-908a-99da16d2e671 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Deletion of /opt/stack/data/nova/instances/7c433050-8e37-4929-aa50-a55a6fedd171_del complete
Aug 26 08:42:55 user nova-compute[73104]: INFO nova.compute.manager [None req-aa21006d-06c1-417d-908a-99da16d2e671 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 26 08:42:55 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-aa21006d-06c1-417d-908a-99da16d2e671 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 08:42:55 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 08:42:55 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 08:42:56 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:42:56 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Took 0.61 seconds to deallocate network for instance.
Aug 26 08:42:56 user nova-compute[73104]: DEBUG nova.compute.manager [req-606b14cd-b998-43d2-b591-3e73cf2492c1 req-208bb102-5572-4907-a15f-9da3634e33b5 service nova] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Received event network-vif-deleted-affefe3c-1cfa-41fd-a361-5d40b56728ab {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:42:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-aa21006d-06c1-417d-908a-99da16d2e671 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:42:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-aa21006d-06c1-417d-908a-99da16d2e671 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:42:56 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-aa21006d-06c1-417d-908a-99da16d2e671 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:42:56 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-aa21006d-06c1-417d-908a-99da16d2e671 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:42:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-aa21006d-06c1-417d-908a-99da16d2e671 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.530s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:42:56 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-aa21006d-06c1-417d-908a-99da16d2e671 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Deleted allocations for instance 7c433050-8e37-4929-aa50-a55a6fedd171
Aug 26 08:42:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-aa21006d-06c1-417d-908a-99da16d2e671 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "7c433050-8e37-4929-aa50-a55a6fedd171" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.314s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:42:57 user nova-compute[73104]: DEBUG nova.compute.manager [req-84f32891-47dc-47b7-b0b8-191b7e64ddab req-9cc39e59-58f7-4c1c-8bb8-749540fe4a0e service nova] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Received event network-vif-plugged-affefe3c-1cfa-41fd-a361-5d40b56728ab {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:42:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-84f32891-47dc-47b7-b0b8-191b7e64ddab req-9cc39e59-58f7-4c1c-8bb8-749540fe4a0e service nova] Acquiring lock "7c433050-8e37-4929-aa50-a55a6fedd171-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:42:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-84f32891-47dc-47b7-b0b8-191b7e64ddab req-9cc39e59-58f7-4c1c-8bb8-749540fe4a0e service nova] Lock "7c433050-8e37-4929-aa50-a55a6fedd171-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:42:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-84f32891-47dc-47b7-b0b8-191b7e64ddab req-9cc39e59-58f7-4c1c-8bb8-749540fe4a0e service nova] Lock "7c433050-8e37-4929-aa50-a55a6fedd171-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:42:57 user nova-compute[73104]: DEBUG nova.compute.manager [req-84f32891-47dc-47b7-b0b8-191b7e64ddab req-9cc39e59-58f7-4c1c-8bb8-749540fe4a0e service nova] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] No waiting events found dispatching network-vif-plugged-affefe3c-1cfa-41fd-a361-5d40b56728ab {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:42:57 user nova-compute[73104]: WARNING nova.compute.manager [req-84f32891-47dc-47b7-b0b8-191b7e64ddab req-9cc39e59-58f7-4c1c-8bb8-749540fe4a0e service nova] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Received unexpected event network-vif-plugged-affefe3c-1cfa-41fd-a361-5d40b56728ab for instance with vm_state deleted and task_state None.
Aug 26 08:42:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:02 user nova-compute[73104]: DEBUG nova.network.neutron [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Port d4692900-c165-487d-9847-383fcf1d2270 binding to destination host user is already ACTIVE {{(pid=73104) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 26 08:43:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquiring lock "refresh_cache-385c6d93-907d-42d7-9b43-479e6caf66f9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:43:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquired lock "refresh_cache-385c6d93-907d-42d7-9b43-479e6caf66f9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:43:02 user nova-compute[73104]: DEBUG nova.network.neutron [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:43:03 user nova-compute[73104]: DEBUG nova.network.neutron [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Updating instance_info_cache with network_info: [{"id": "d4692900-c165-487d-9847-383fcf1d2270", "address": "fa:16:3e:b9:37:34", "network": {"id": "9aad8a32-d93f-45ef-be53-f84cebd194b1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2017537149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc8c266ecf8444919a4a2ed73b784b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4692900-c1", "ovs_interfaceid": "d4692900-c165-487d-9847-383fcf1d2270", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:43:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Releasing lock "refresh_cache-385c6d93-907d-42d7-9b43-479e6caf66f9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:43:03 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Creating tmpfile /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/tmp9qpc8nyx to verify with other compute node that the instance is on the same shared storage. {{(pid=73104) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 26 08:43:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:03 user nova-compute[73104]: DEBUG nova.compute.manager [req-612e91a0-ad20-4527-8ba0-63eca4a440e1 req-53791deb-2477-4560-9f50-f8b2f0372d0b service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Received event network-vif-unplugged-d4692900-c165-487d-9847-383fcf1d2270 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:43:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-612e91a0-ad20-4527-8ba0-63eca4a440e1 req-53791deb-2477-4560-9f50-f8b2f0372d0b service nova] Acquiring lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-612e91a0-ad20-4527-8ba0-63eca4a440e1 req-53791deb-2477-4560-9f50-f8b2f0372d0b service nova] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-612e91a0-ad20-4527-8ba0-63eca4a440e1 req-53791deb-2477-4560-9f50-f8b2f0372d0b service nova] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:03 user nova-compute[73104]: DEBUG nova.compute.manager [req-612e91a0-ad20-4527-8ba0-63eca4a440e1 req-53791deb-2477-4560-9f50-f8b2f0372d0b service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] No waiting events found dispatching network-vif-unplugged-d4692900-c165-487d-9847-383fcf1d2270 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:43:03 user nova-compute[73104]: WARNING nova.compute.manager [req-612e91a0-ad20-4527-8ba0-63eca4a440e1 req-53791deb-2477-4560-9f50-f8b2f0372d0b service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Received unexpected event network-vif-unplugged-d4692900-c165-487d-9847-383fcf1d2270 for instance with vm_state resized and task_state resize_reverting.
Aug 26 08:43:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:04 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Instance destroyed successfully.
Aug 26 08:43:04 user nova-compute[73104]: DEBUG nova.objects.instance [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lazy-loading 'resources' on Instance uuid 385c6d93-907d-42d7-9b43-479e6caf66f9 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1752100953',display_name='tempest-ServerActionsTestOtherB-server-1752100953',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1752100953',id=5,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNCl9FBP9XyWyY8/M5Nn5mUzz1vqHS13H5r5WR3mIkiFM7rzl4Rl7e+CWZJ8183D5yYr3nZra0DCol7pvB/KJevg8WITrJ9KzKNvGMc/QWpgMb9Lbrm7qPNUJRloZ083Q==',key_name='tempest-keypair-1221674543',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:41:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc8c266ecf8444919a4a2ed73b784b53',ramdisk_id='',reservation_id='r-w3k6rkik',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-905162429',owner_user_name='tempest-ServerActionsTestOtherB-905162429-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:41:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4e9fc4dcaaf4aa1aaa51245217b4ded',uuid=385c6d93-907d-42d7-9b43-479e6caf66f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "d4692900-c165-487d-9847-383fcf1d2270", "address": "fa:16:3e:b9:37:34", "network": {"id": "9aad8a32-d93f-45ef-be53-f84cebd194b1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2017537149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc8c266ecf8444919a4a2ed73b784b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4692900-c1", "ovs_interfaceid": "d4692900-c165-487d-9847-383fcf1d2270", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Converting VIF {"id": "d4692900-c165-487d-9847-383fcf1d2270", "address": "fa:16:3e:b9:37:34", "network": {"id": "9aad8a32-d93f-45ef-be53-f84cebd194b1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2017537149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc8c266ecf8444919a4a2ed73b784b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4692900-c1", "ovs_interfaceid": "d4692900-c165-487d-9847-383fcf1d2270", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:37:34,bridge_name='br-int',has_traffic_filtering=True,id=d4692900-c165-487d-9847-383fcf1d2270,network=Network(9aad8a32-d93f-45ef-be53-f84cebd194b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4692900-c1') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG os_vif [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:37:34,bridge_name='br-int',has_traffic_filtering=True,id=d4692900-c165-487d-9847-383fcf1d2270,network=Network(9aad8a32-d93f-45ef-be53-f84cebd194b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4692900-c1') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4692900-c1, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:43:04 user nova-compute[73104]: INFO os_vif [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:37:34,bridge_name='br-int',has_traffic_filtering=True,id=d4692900-c165-487d-9847-383fcf1d2270,network=Network(9aad8a32-d93f-45ef-be53-f84cebd194b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4692900-c1')
Aug 26 08:43:04 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEOqgAiB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:43:04 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:43:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0479adf6-acc8-4cbb-ac00-59d03ff3f50e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cbba51-f0bb-4ec9-9c87-d47380c97f67]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:43:04 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:43:04 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b47827a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44'): ({'sdc'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Removing single pathed devices sdc {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f591e07f-05fc-4ce4-a61f-739cc2ca6446]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b461d92d-6e1a-4ce1-8712-76fa60f46d53]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Flushing IO for device /dev/sdc {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f149556d-6514-44ac-99c7-f7692884d5a4]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1edc14-fe45-40da-ae26-fd07176964e3]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] SCSI volumes sdc have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[43037ccd-ad00-4e4e-a542-c766ebda63cf]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[945afec2-815f-4564-90e4-02b5022679cb]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44, portal: 172.16.0.220,3260]
Aug 26 08:43:04 user nova-compute[73104]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44, portal: 172.16.0.220,3260] successful.
Aug 26 08:43:04 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8555bab2-dc67-4349-946a-eb573af759a7]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] <== disconnect_volume: return (302ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:43:04 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:43:05 user nova-compute[73104]: DEBUG nova.compute.manager [req-3b83e058-14b2-49c6-a1b8-88311436cdaf req-f14cc3f8-c08a-42bd-8fe1-a9e57da0c50a service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Received event network-vif-plugged-d4692900-c165-487d-9847-383fcf1d2270 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:43:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3b83e058-14b2-49c6-a1b8-88311436cdaf req-f14cc3f8-c08a-42bd-8fe1-a9e57da0c50a service nova] Acquiring lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3b83e058-14b2-49c6-a1b8-88311436cdaf req-f14cc3f8-c08a-42bd-8fe1-a9e57da0c50a service nova] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3b83e058-14b2-49c6-a1b8-88311436cdaf req-f14cc3f8-c08a-42bd-8fe1-a9e57da0c50a service nova] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:05 user nova-compute[73104]: DEBUG nova.compute.manager [req-3b83e058-14b2-49c6-a1b8-88311436cdaf req-f14cc3f8-c08a-42bd-8fe1-a9e57da0c50a service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] No waiting events found dispatching network-vif-plugged-d4692900-c165-487d-9847-383fcf1d2270 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:43:05 user nova-compute[73104]: WARNING nova.compute.manager [req-3b83e058-14b2-49c6-a1b8-88311436cdaf req-f14cc3f8-c08a-42bd-8fe1-a9e57da0c50a service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Received unexpected event network-vif-plugged-d4692900-c165-487d-9847-383fcf1d2270 for instance with vm_state resized and task_state resize_reverting.
Aug 26 08:43:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:05 user nova-compute[73104]: DEBUG nova.objects.instance [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lazy-loading 'migration_context' on Instance uuid 385c6d93-907d-42d7-9b43-479e6caf66f9 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:43:05 user nova-compute[73104]: DEBUG nova.objects.base [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Object Instance<385c6d93-907d-42d7-9b43-479e6caf66f9> lazy-loaded attributes: resources,migration_context {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:43:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:06 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:43:06 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:43:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.491s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:06 user nova-compute[73104]: INFO nova.compute.manager [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Swapping old allocation on dict_keys(['8a2a2397-4d47-4524-8146-84db4225a812']) held by migration 34377794-1383-41db-ab9f-219dc1867bba for instance
Aug 26 08:43:06 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Overwriting current allocation {'allocations': {'8a2a2397-4d47-4524-8146-84db4225a812': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 22}}, 'project_id': 'bc8c266ecf8444919a4a2ed73b784b53', 'user_id': 'a4e9fc4dcaaf4aa1aaa51245217b4ded', 'consumer_generation': 1} on consumer 385c6d93-907d-42d7-9b43-479e6caf66f9 {{(pid=73104) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 26 08:43:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquiring lock "refresh_cache-385c6d93-907d-42d7-9b43-479e6caf66f9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:43:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquired lock "refresh_cache-385c6d93-907d-42d7-9b43-479e6caf66f9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:43:06 user nova-compute[73104]: DEBUG nova.network.neutron [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:43:07 user nova-compute[73104]: DEBUG nova.network.neutron [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Updating instance_info_cache with network_info: [{"id": "d4692900-c165-487d-9847-383fcf1d2270", "address": "fa:16:3e:b9:37:34", "network": {"id": "9aad8a32-d93f-45ef-be53-f84cebd194b1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2017537149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc8c266ecf8444919a4a2ed73b784b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4692900-c1", "ovs_interfaceid": "d4692900-c165-487d-9847-383fcf1d2270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:43:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Releasing lock "refresh_cache-385c6d93-907d-42d7-9b43-479e6caf66f9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:43:07 user nova-compute[73104]: DEBUG os_brick.utils [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:43:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:07 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65bba69-726a-4938-ba4e-234a4e623c60]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:07 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d515115-96ea-4eed-9ce3-eff8614970c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:07 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa589e63-2575-4d92-82f8-48563de393ba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:07 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea97bc9d-00dc-4783-8d22-3bded8dee17e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:43:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:43:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:43:07 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:43:07 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d2c2ab-8fec-4e6e-857a-8898aae8d483]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:43:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:43:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:43:07 user nova-compute[73104]: DEBUG os_brick.utils [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:43:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Acquiring lock "24fbf9f0-c459-4d24-b0ff-b25281378f52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "24fbf9f0-c459-4d24-b0ff-b25281378f52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:07 user nova-compute[73104]: DEBUG nova.compute.manager [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:43:07 user nova-compute[73104]: DEBUG nova.compute.manager [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:43:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:08 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:43:08 user nova-compute[73104]: INFO nova.compute.claims [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Claim successful on node user
Aug 26 08:43:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:08 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:43:08 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:43:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:08 user nova-compute[73104]: DEBUG nova.compute.manager [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:43:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.372s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:08 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:43:08 user nova-compute[73104]: INFO nova.compute.claims [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Claim successful on node user
Aug 26 08:43:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:08 user nova-compute[73104]: DEBUG nova.compute.manager [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:43:08 user nova-compute[73104]: DEBUG nova.network.neutron [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:43:08 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:43:09 user nova-compute[73104]: DEBUG nova.compute.manager [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG nova.policy [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aca885fd82294677abf751087bcfc5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cbb61cb896e4b3cbbdc04d82df1cea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG nova.compute.manager [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:43:09 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Creating image(s)
Aug 26 08:43:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Acquiring lock "/opt/stack/data/nova/instances/24fbf9f0-c459-4d24-b0ff-b25281378f52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "/opt/stack/data/nova/instances/24fbf9f0-c459-4d24-b0ff-b25281378f52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "/opt/stack/data/nova/instances/24fbf9f0-c459-4d24-b0ff-b25281378f52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.187s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.774s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG nova.compute.manager [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG nova.compute.manager [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG nova.network.neutron [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:43:09 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:43:09 user nova-compute[73104]: DEBUG nova.compute.manager [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.209s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/24fbf9f0-c459-4d24-b0ff-b25281378f52/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/24fbf9f0-c459-4d24-b0ff-b25281378f52/disk 1073741824" returned: 0 in 0.056s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG nova.policy [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bcd11beb7046440f814cbf4a13ab0272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a37356203d547c2abf0aa634c2ad548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG nova.compute.manager [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:43:09 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Creating image(s)
Aug 26 08:43:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "/opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "/opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "/opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.181s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Checking if we can resize image /opt/stack/data/nova/instances/24fbf9f0-c459-4d24-b0ff-b25281378f52/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fbf9f0-c459-4d24-b0ff-b25281378f52/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG nova.network.neutron [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Successfully created port: 693629a9-d0ad-4257-8160-901fccb6f3fd {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.212s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fbf9f0-c459-4d24-b0ff-b25281378f52/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:10 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Cannot resize image /opt/stack/data/nova/instances/24fbf9f0-c459-4d24-b0ff-b25281378f52/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 08:43:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:43:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Ensure instance console log exists: /opt/stack/data/nova/instances/24fbf9f0-c459-4d24-b0ff-b25281378f52/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:43:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.251s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk 1073741824" returned: 0 in 0.060s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.317s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:10 user nova-compute[73104]: DEBUG nova.network.neutron [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Successfully created port: 1ff011d7-db1c-4bac-a2d3-ecf253085265 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:43:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.214s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:10 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 08:43:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:10 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693039375.5505128, 7c433050-8e37-4929-aa50-a55a6fedd171 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:43:10 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] VM Stopped (Lifecycle Event)
Aug 26 08:43:10 user nova-compute[73104]: DEBUG nova.compute.manager [None req-c4197f14-14b4-40c1-9e6d-54c8c5db9779 None None] [instance: 7c433050-8e37-4929-aa50-a55a6fedd171] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:43:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:10 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Cannot resize image /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 08:43:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:43:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Ensure instance console log exists: /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:43:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:10 user nova-compute[73104]: DEBUG nova.network.neutron [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Successfully updated port: 693629a9-d0ad-4257-8160-901fccb6f3fd {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:43:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Acquiring lock "refresh_cache-24fbf9f0-c459-4d24-b0ff-b25281378f52" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:43:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Acquired lock "refresh_cache-24fbf9f0-c459-4d24-b0ff-b25281378f52" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:43:10 user nova-compute[73104]: DEBUG nova.network.neutron [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:43:10 user nova-compute[73104]: DEBUG nova.compute.manager [req-6251c3cd-0b4c-4f6e-91a2-2db0e27d2b1e req-a98e5167-fdc2-47cc-a4cd-506b05a1336d service nova] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Received event network-changed-693629a9-d0ad-4257-8160-901fccb6f3fd {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:43:10 user nova-compute[73104]: DEBUG nova.compute.manager [req-6251c3cd-0b4c-4f6e-91a2-2db0e27d2b1e req-a98e5167-fdc2-47cc-a4cd-506b05a1336d service nova] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Refreshing instance network info cache due to event network-changed-693629a9-d0ad-4257-8160-901fccb6f3fd. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:43:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6251c3cd-0b4c-4f6e-91a2-2db0e27d2b1e req-a98e5167-fdc2-47cc-a4cd-506b05a1336d service nova] Acquiring lock "refresh_cache-24fbf9f0-c459-4d24-b0ff-b25281378f52" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:43:10 user nova-compute[73104]: DEBUG nova.network.neutron [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.network.neutron [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Updating instance_info_cache with network_info: [{"id": "693629a9-d0ad-4257-8160-901fccb6f3fd", "address": "fa:16:3e:02:20:11", "network": {"id": "84dc5f73-5b46-4788-8e58-69d57f2f089f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-856831086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbb61cb896e4b3cbbdc04d82df1cea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693629a9-d0", "ovs_interfaceid": "693629a9-d0ad-4257-8160-901fccb6f3fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Releasing lock "refresh_cache-24fbf9f0-c459-4d24-b0ff-b25281378f52" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.compute.manager [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Instance network_info: |[{"id": "693629a9-d0ad-4257-8160-901fccb6f3fd", "address": "fa:16:3e:02:20:11", "network": {"id": "84dc5f73-5b46-4788-8e58-69d57f2f089f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-856831086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbb61cb896e4b3cbbdc04d82df1cea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693629a9-d0", "ovs_interfaceid": "693629a9-d0ad-4257-8160-901fccb6f3fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6251c3cd-0b4c-4f6e-91a2-2db0e27d2b1e req-a98e5167-fdc2-47cc-a4cd-506b05a1336d service nova] Acquired lock "refresh_cache-24fbf9f0-c459-4d24-b0ff-b25281378f52" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.network.neutron [req-6251c3cd-0b4c-4f6e-91a2-2db0e27d2b1e req-a98e5167-fdc2-47cc-a4cd-506b05a1336d service nova] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Refreshing network info cache for port 693629a9-d0ad-4257-8160-901fccb6f3fd {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Start _get_guest_xml network_info=[{"id": "693629a9-d0ad-4257-8160-901fccb6f3fd", "address": "fa:16:3e:02:20:11", "network": {"id": "84dc5f73-5b46-4788-8e58-69d57f2f089f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-856831086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbb61cb896e4b3cbbdc04d82df1cea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693629a9-d0", "ovs_interfaceid": "693629a9-d0ad-4257-8160-901fccb6f3fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.network.neutron [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Successfully updated port: 1ff011d7-db1c-4bac-a2d3-ecf253085265 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "refresh_cache-3cf85d2f-de0d-4e9b-a534-98c799ae8db9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquired lock "refresh_cache-3cf85d2f-de0d-4e9b-a534-98c799ae8db9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.network.neutron [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:43:11 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:43:11 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:43:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1467979521',display_name='tempest-VolumesSnapshotTestJSON-instance-1467979521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1467979521',id=18,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxVtrRSezPYPY+Gbqr1llM3nb4T8ykUog6/jBtBYtycYtt0mtjKKQ9GMlHhymtJJmEdnT+Vrqdkk5RhZF+X7yLO2Jp8jtESlA8tcTfvdepMrD3gg8sm41JWH5MMR1xxOw==',key_name='tempest-keypair-1570730096',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cbb61cb896e4b3cbbdc04d82df1cea9',ramdisk_id='',reservation_id='r-v55gezhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1828823155',owner_user_name='tempest-VolumesSnapshotTestJSON-1828823155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:43:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aca885fd82294677abf751087bcfc5e1',uuid=24fbf9f0-c459-4d24-b0ff-b25281378f52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "693629a9-d0ad-4257-8160-901fccb6f3fd", "address": "fa:16:3e:02:20:11", "network": {"id": "84dc5f73-5b46-4788-8e58-69d57f2f089f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-856831086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbb61cb896e4b3cbbdc04d82df1cea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693629a9-d0", "ovs_interfaceid": "693629a9-d0ad-4257-8160-901fccb6f3fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Converting VIF {"id": "693629a9-d0ad-4257-8160-901fccb6f3fd", "address": "fa:16:3e:02:20:11", "network": {"id": "84dc5f73-5b46-4788-8e58-69d57f2f089f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-856831086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbb61cb896e4b3cbbdc04d82df1cea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693629a9-d0", "ovs_interfaceid": "693629a9-d0ad-4257-8160-901fccb6f3fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:20:11,bridge_name='br-int',has_traffic_filtering=True,id=693629a9-d0ad-4257-8160-901fccb6f3fd,network=Network(84dc5f73-5b46-4788-8e58-69d57f2f089f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693629a9-d0') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.objects.instance [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lazy-loading 'pci_devices' on Instance uuid 24fbf9f0-c459-4d24-b0ff-b25281378f52 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.compute.manager [req-4864f08f-f80a-486b-a017-d9fdcec40274 req-8653cfba-8265-45dc-a93d-06660d5eeb2c service nova] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Received event network-changed-1ff011d7-db1c-4bac-a2d3-ecf253085265 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.compute.manager [req-4864f08f-f80a-486b-a017-d9fdcec40274 req-8653cfba-8265-45dc-a93d-06660d5eeb2c service nova] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Refreshing instance network info cache due to event network-changed-1ff011d7-db1c-4bac-a2d3-ecf253085265. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4864f08f-f80a-486b-a017-d9fdcec40274 req-8653cfba-8265-45dc-a93d-06660d5eeb2c service nova] Acquiring lock "refresh_cache-3cf85d2f-de0d-4e9b-a534-98c799ae8db9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:43:11 user nova-compute[73104]:   <uuid>24fbf9f0-c459-4d24-b0ff-b25281378f52</uuid>
Aug 26 08:43:11 user nova-compute[73104]:   <name>instance-00000012</name>
Aug 26 08:43:11 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:43:11 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:43:11 user nova-compute[73104]:   <metadata>
Aug 26 08:43:11 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:43:11 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:43:11 user nova-compute[73104]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1467979521</nova:name>
Aug 26 08:43:11 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:43:11</nova:creationTime>
Aug 26 08:43:11 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:43:11 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:43:11 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:43:11 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:43:11 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:43:11 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:43:11 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:43:11 user nova-compute[73104]:       <nova:owner>
Aug 26 08:43:11 user nova-compute[73104]:         <nova:user uuid="aca885fd82294677abf751087bcfc5e1">tempest-VolumesSnapshotTestJSON-1828823155-project-member</nova:user>
Aug 26 08:43:11 user nova-compute[73104]:         <nova:project uuid="6cbb61cb896e4b3cbbdc04d82df1cea9">tempest-VolumesSnapshotTestJSON-1828823155</nova:project>
Aug 26 08:43:11 user nova-compute[73104]:       </nova:owner>
Aug 26 08:43:11 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:43:11 user nova-compute[73104]:       <nova:ports>
Aug 26 08:43:11 user nova-compute[73104]:         <nova:port uuid="693629a9-d0ad-4257-8160-901fccb6f3fd">
Aug 26 08:43:11 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 08:43:11 user nova-compute[73104]:         </nova:port>
Aug 26 08:43:11 user nova-compute[73104]:       </nova:ports>
Aug 26 08:43:11 user nova-compute[73104]:     </nova:instance>
Aug 26 08:43:11 user nova-compute[73104]:   </metadata>
Aug 26 08:43:11 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:43:11 user nova-compute[73104]:     <system>
Aug 26 08:43:11 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:43:11 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:43:11 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:43:11 user nova-compute[73104]:       <entry name="serial">24fbf9f0-c459-4d24-b0ff-b25281378f52</entry>
Aug 26 08:43:11 user nova-compute[73104]:       <entry name="uuid">24fbf9f0-c459-4d24-b0ff-b25281378f52</entry>
Aug 26 08:43:11 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:43:11 user nova-compute[73104]:     </system>
Aug 26 08:43:11 user nova-compute[73104]:   </sysinfo>
Aug 26 08:43:11 user nova-compute[73104]:   <os>
Aug 26 08:43:11 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:43:11 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:43:11 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:43:11 user nova-compute[73104]:   </os>
Aug 26 08:43:11 user nova-compute[73104]:   <features>
Aug 26 08:43:11 user nova-compute[73104]:     <acpi/>
Aug 26 08:43:11 user nova-compute[73104]:     <apic/>
Aug 26 08:43:11 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:43:11 user nova-compute[73104]:   </features>
Aug 26 08:43:11 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:43:11 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:43:11 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:43:11 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:43:11 user nova-compute[73104]:   </clock>
Aug 26 08:43:11 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:43:11 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:43:11 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:43:11 user nova-compute[73104]:   </cpu>
Aug 26 08:43:11 user nova-compute[73104]:   <devices>
Aug 26 08:43:11 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:43:11 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:43:11 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/24fbf9f0-c459-4d24-b0ff-b25281378f52/disk"/>
Aug 26 08:43:11 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:43:11 user nova-compute[73104]:     </disk>
Aug 26 08:43:11 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:43:11 user nova-compute[73104]:       <mac address="fa:16:3e:02:20:11"/>
Aug 26 08:43:11 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:43:11 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:43:11 user nova-compute[73104]:       <target dev="tap693629a9-d0"/>
Aug 26 08:43:11 user nova-compute[73104]:     </interface>
Aug 26 08:43:11 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:43:11 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/24fbf9f0-c459-4d24-b0ff-b25281378f52/console.log" append="off"/>
Aug 26 08:43:11 user nova-compute[73104]:     </serial>
Aug 26 08:43:11 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:43:11 user nova-compute[73104]:     <video>
Aug 26 08:43:11 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:43:11 user nova-compute[73104]:     </video>
Aug 26 08:43:11 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:43:11 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:43:11 user nova-compute[73104]:     </rng>
Aug 26 08:43:11 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:43:11 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:43:11 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:43:11 user nova-compute[73104]:     </memballoon>
Aug 26 08:43:11 user nova-compute[73104]:   </devices>
Aug 26 08:43:11 user nova-compute[73104]: </domain>
Aug 26 08:43:11 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:43:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1467979521',display_name='tempest-VolumesSnapshotTestJSON-instance-1467979521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1467979521',id=18,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxVtrRSezPYPY+Gbqr1llM3nb4T8ykUog6/jBtBYtycYtt0mtjKKQ9GMlHhymtJJmEdnT+Vrqdkk5RhZF+X7yLO2Jp8jtESlA8tcTfvdepMrD3gg8sm41JWH5MMR1xxOw==',key_name='tempest-keypair-1570730096',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cbb61cb896e4b3cbbdc04d82df1cea9',ramdisk_id='',reservation_id='r-v55gezhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1828823155',owner_user_name='tempest-VolumesSnapshotTestJSON-1828823155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:43:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aca885fd82294677abf751087bcfc5e1',uuid=24fbf9f0-c459-4d24-b0ff-b25281378f52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "693629a9-d0ad-4257-8160-901fccb6f3fd", "address": "fa:16:3e:02:20:11", "network": {"id": "84dc5f73-5b46-4788-8e58-69d57f2f089f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-856831086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbb61cb896e4b3cbbdc04d82df1cea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693629a9-d0", "ovs_interfaceid": "693629a9-d0ad-4257-8160-901fccb6f3fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Converting VIF {"id": "693629a9-d0ad-4257-8160-901fccb6f3fd", "address": "fa:16:3e:02:20:11", "network": {"id": "84dc5f73-5b46-4788-8e58-69d57f2f089f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-856831086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbb61cb896e4b3cbbdc04d82df1cea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693629a9-d0", "ovs_interfaceid": "693629a9-d0ad-4257-8160-901fccb6f3fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:20:11,bridge_name='br-int',has_traffic_filtering=True,id=693629a9-d0ad-4257-8160-901fccb6f3fd,network=Network(84dc5f73-5b46-4788-8e58-69d57f2f089f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693629a9-d0') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG os_vif [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:20:11,bridge_name='br-int',has_traffic_filtering=True,id=693629a9-d0ad-4257-8160-901fccb6f3fd,network=Network(84dc5f73-5b46-4788-8e58-69d57f2f089f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693629a9-d0') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap693629a9-d0, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap693629a9-d0, col_values=(('external_ids', {'iface-id': '693629a9-d0ad-4257-8160-901fccb6f3fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:20:11', 'vm-uuid': '24fbf9f0-c459-4d24-b0ff-b25281378f52'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:11 user nova-compute[73104]: INFO os_vif [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:20:11,bridge_name='br-int',has_traffic_filtering=True,id=693629a9-d0ad-4257-8160-901fccb6f3fd,network=Network(84dc5f73-5b46-4788-8e58-69d57f2f089f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693629a9-d0')
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] No VIF found with MAC fa:16:3e:02:20:11, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.network.neutron [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.network.neutron [req-6251c3cd-0b4c-4f6e-91a2-2db0e27d2b1e req-a98e5167-fdc2-47cc-a4cd-506b05a1336d service nova] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Updated VIF entry in instance network info cache for port 693629a9-d0ad-4257-8160-901fccb6f3fd. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.network.neutron [req-6251c3cd-0b4c-4f6e-91a2-2db0e27d2b1e req-a98e5167-fdc2-47cc-a4cd-506b05a1336d service nova] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Updating instance_info_cache with network_info: [{"id": "693629a9-d0ad-4257-8160-901fccb6f3fd", "address": "fa:16:3e:02:20:11", "network": {"id": "84dc5f73-5b46-4788-8e58-69d57f2f089f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-856831086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbb61cb896e4b3cbbdc04d82df1cea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693629a9-d0", "ovs_interfaceid": "693629a9-d0ad-4257-8160-901fccb6f3fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6251c3cd-0b4c-4f6e-91a2-2db0e27d2b1e req-a98e5167-fdc2-47cc-a4cd-506b05a1336d service nova] Releasing lock "refresh_cache-24fbf9f0-c459-4d24-b0ff-b25281378f52" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.network.neutron [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Updating instance_info_cache with network_info: [{"id": "1ff011d7-db1c-4bac-a2d3-ecf253085265", "address": "fa:16:3e:72:e3:65", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff011d7-db", "ovs_interfaceid": "1ff011d7-db1c-4bac-a2d3-ecf253085265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Releasing lock "refresh_cache-3cf85d2f-de0d-4e9b-a534-98c799ae8db9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.compute.manager [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Instance network_info: |[{"id": "1ff011d7-db1c-4bac-a2d3-ecf253085265", "address": "fa:16:3e:72:e3:65", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff011d7-db", "ovs_interfaceid": "1ff011d7-db1c-4bac-a2d3-ecf253085265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4864f08f-f80a-486b-a017-d9fdcec40274 req-8653cfba-8265-45dc-a93d-06660d5eeb2c service nova] Acquired lock "refresh_cache-3cf85d2f-de0d-4e9b-a534-98c799ae8db9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.network.neutron [req-4864f08f-f80a-486b-a017-d9fdcec40274 req-8653cfba-8265-45dc-a93d-06660d5eeb2c service nova] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Refreshing network info cache for port 1ff011d7-db1c-4bac-a2d3-ecf253085265 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Start _get_guest_xml network_info=[{"id": "1ff011d7-db1c-4bac-a2d3-ecf253085265", "address": "fa:16:3e:72:e3:65", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff011d7-db", "ovs_interfaceid": "1ff011d7-db1c-4bac-a2d3-ecf253085265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:43:11 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:43:11 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:43:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1255899903',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1255899903',id=19,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a37356203d547c2abf0aa634c2ad548',ramdisk_id='',reservation_id='r-540hullf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1111216102',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:43:10Z,user_data=None,user_id='bcd11beb7046440f814cbf4a13ab0272',uuid=3cf85d2f-de0d-4e9b-a534-98c799ae8db9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ff011d7-db1c-4bac-a2d3-ecf253085265", "address": "fa:16:3e:72:e3:65", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff011d7-db", "ovs_interfaceid": "1ff011d7-db1c-4bac-a2d3-ecf253085265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Converting VIF {"id": "1ff011d7-db1c-4bac-a2d3-ecf253085265", "address": "fa:16:3e:72:e3:65", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff011d7-db", "ovs_interfaceid": "1ff011d7-db1c-4bac-a2d3-ecf253085265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:e3:65,bridge_name='br-int',has_traffic_filtering=True,id=1ff011d7-db1c-4bac-a2d3-ecf253085265,network=Network(ce0a529c-2119-4b2a-a08f-567e3671c3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ff011d7-db') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:43:11 user nova-compute[73104]: DEBUG nova.objects.instance [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lazy-loading 'pci_devices' on Instance uuid 3cf85d2f-de0d-4e9b-a534-98c799ae8db9 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:43:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:43:12 user nova-compute[73104]:   <uuid>3cf85d2f-de0d-4e9b-a534-98c799ae8db9</uuid>
Aug 26 08:43:12 user nova-compute[73104]:   <name>instance-00000013</name>
Aug 26 08:43:12 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:43:12 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:43:12 user nova-compute[73104]:   <metadata>
Aug 26 08:43:12 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:43:12 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:43:12 user nova-compute[73104]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1255899903</nova:name>
Aug 26 08:43:12 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:43:11</nova:creationTime>
Aug 26 08:43:12 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:43:12 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:43:12 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:43:12 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:43:12 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:43:12 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:43:12 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:43:12 user nova-compute[73104]:       <nova:owner>
Aug 26 08:43:12 user nova-compute[73104]:         <nova:user uuid="bcd11beb7046440f814cbf4a13ab0272">tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member</nova:user>
Aug 26 08:43:12 user nova-compute[73104]:         <nova:project uuid="8a37356203d547c2abf0aa634c2ad548">tempest-ServerBootFromVolumeStableRescueTest-1111216102</nova:project>
Aug 26 08:43:12 user nova-compute[73104]:       </nova:owner>
Aug 26 08:43:12 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:43:12 user nova-compute[73104]:       <nova:ports>
Aug 26 08:43:12 user nova-compute[73104]:         <nova:port uuid="1ff011d7-db1c-4bac-a2d3-ecf253085265">
Aug 26 08:43:12 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 08:43:12 user nova-compute[73104]:         </nova:port>
Aug 26 08:43:12 user nova-compute[73104]:       </nova:ports>
Aug 26 08:43:12 user nova-compute[73104]:     </nova:instance>
Aug 26 08:43:12 user nova-compute[73104]:   </metadata>
Aug 26 08:43:12 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:43:12 user nova-compute[73104]:     <system>
Aug 26 08:43:12 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:43:12 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:43:12 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:43:12 user nova-compute[73104]:       <entry name="serial">3cf85d2f-de0d-4e9b-a534-98c799ae8db9</entry>
Aug 26 08:43:12 user nova-compute[73104]:       <entry name="uuid">3cf85d2f-de0d-4e9b-a534-98c799ae8db9</entry>
Aug 26 08:43:12 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:43:12 user nova-compute[73104]:     </system>
Aug 26 08:43:12 user nova-compute[73104]:   </sysinfo>
Aug 26 08:43:12 user nova-compute[73104]:   <os>
Aug 26 08:43:12 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:43:12 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:43:12 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:43:12 user nova-compute[73104]:   </os>
Aug 26 08:43:12 user nova-compute[73104]:   <features>
Aug 26 08:43:12 user nova-compute[73104]:     <acpi/>
Aug 26 08:43:12 user nova-compute[73104]:     <apic/>
Aug 26 08:43:12 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:43:12 user nova-compute[73104]:   </features>
Aug 26 08:43:12 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:43:12 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:43:12 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:43:12 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:43:12 user nova-compute[73104]:   </clock>
Aug 26 08:43:12 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:43:12 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:43:12 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:43:12 user nova-compute[73104]:   </cpu>
Aug 26 08:43:12 user nova-compute[73104]:   <devices>
Aug 26 08:43:12 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:43:12 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:43:12 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk"/>
Aug 26 08:43:12 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:43:12 user nova-compute[73104]:     </disk>
Aug 26 08:43:12 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:43:12 user nova-compute[73104]:       <mac address="fa:16:3e:72:e3:65"/>
Aug 26 08:43:12 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:43:12 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:43:12 user nova-compute[73104]:       <target dev="tap1ff011d7-db"/>
Aug 26 08:43:12 user nova-compute[73104]:     </interface>
Aug 26 08:43:12 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:43:12 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/console.log" append="off"/>
Aug 26 08:43:12 user nova-compute[73104]:     </serial>
Aug 26 08:43:12 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:43:12 user nova-compute[73104]:     <video>
Aug 26 08:43:12 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:43:12 user nova-compute[73104]:     </video>
Aug 26 08:43:12 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:43:12 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:43:12 user nova-compute[73104]:     </rng>
Aug 26 08:43:12 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:43:12 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:43:12 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:43:12 user nova-compute[73104]:     </memballoon>
Aug 26 08:43:12 user nova-compute[73104]:   </devices>
Aug 26 08:43:12 user nova-compute[73104]: </domain>
Aug 26 08:43:12 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:43:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:43:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1255899903',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1255899903',id=19,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a37356203d547c2abf0aa634c2ad548',ramdisk_id='',reservation_id='r-540hullf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1111216102',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:43:10Z,user_data=None,user_id='bcd11beb7046440f814cbf4a13ab0272',uuid=3cf85d2f-de0d-4e9b-a534-98c799ae8db9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ff011d7-db1c-4bac-a2d3-ecf253085265", "address": "fa:16:3e:72:e3:65", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff011d7-db", "ovs_interfaceid": "1ff011d7-db1c-4bac-a2d3-ecf253085265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:43:12 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Converting VIF {"id": "1ff011d7-db1c-4bac-a2d3-ecf253085265", "address": "fa:16:3e:72:e3:65", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff011d7-db", "ovs_interfaceid": "1ff011d7-db1c-4bac-a2d3-ecf253085265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:43:12 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:e3:65,bridge_name='br-int',has_traffic_filtering=True,id=1ff011d7-db1c-4bac-a2d3-ecf253085265,network=Network(ce0a529c-2119-4b2a-a08f-567e3671c3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ff011d7-db') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:43:12 user nova-compute[73104]: DEBUG os_vif [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:e3:65,bridge_name='br-int',has_traffic_filtering=True,id=1ff011d7-db1c-4bac-a2d3-ecf253085265,network=Network(ce0a529c-2119-4b2a-a08f-567e3671c3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ff011d7-db') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:43:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:43:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:43:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ff011d7-db, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:43:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ff011d7-db, col_values=(('external_ids', {'iface-id': '1ff011d7-db1c-4bac-a2d3-ecf253085265', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:e3:65', 'vm-uuid': '3cf85d2f-de0d-4e9b-a534-98c799ae8db9'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:43:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:43:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:12 user nova-compute[73104]: INFO os_vif [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:e3:65,bridge_name='br-int',has_traffic_filtering=True,id=1ff011d7-db1c-4bac-a2d3-ecf253085265,network=Network(ce0a529c-2119-4b2a-a08f-567e3671c3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ff011d7-db')
Aug 26 08:43:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:43:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] No VIF found with MAC fa:16:3e:72:e3:65, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:43:12 user nova-compute[73104]: DEBUG nova.network.neutron [req-4864f08f-f80a-486b-a017-d9fdcec40274 req-8653cfba-8265-45dc-a93d-06660d5eeb2c service nova] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Updated VIF entry in instance network info cache for port 1ff011d7-db1c-4bac-a2d3-ecf253085265. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:43:12 user nova-compute[73104]: DEBUG nova.network.neutron [req-4864f08f-f80a-486b-a017-d9fdcec40274 req-8653cfba-8265-45dc-a93d-06660d5eeb2c service nova] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Updating instance_info_cache with network_info: [{"id": "1ff011d7-db1c-4bac-a2d3-ecf253085265", "address": "fa:16:3e:72:e3:65", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff011d7-db", "ovs_interfaceid": "1ff011d7-db1c-4bac-a2d3-ecf253085265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:43:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4864f08f-f80a-486b-a017-d9fdcec40274 req-8653cfba-8265-45dc-a93d-06660d5eeb2c service nova] Releasing lock "refresh_cache-3cf85d2f-de0d-4e9b-a534-98c799ae8db9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:43:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:13 user nova-compute[73104]: DEBUG nova.compute.manager [req-462b1832-fe22-4997-a11d-a7ae4ad0baf5 req-ff466e9a-e18c-49b2-b69f-b33afd07f16f service nova] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Received event network-vif-plugged-693629a9-d0ad-4257-8160-901fccb6f3fd {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:43:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-462b1832-fe22-4997-a11d-a7ae4ad0baf5 req-ff466e9a-e18c-49b2-b69f-b33afd07f16f service nova] Acquiring lock "24fbf9f0-c459-4d24-b0ff-b25281378f52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-462b1832-fe22-4997-a11d-a7ae4ad0baf5 req-ff466e9a-e18c-49b2-b69f-b33afd07f16f service nova] Lock "24fbf9f0-c459-4d24-b0ff-b25281378f52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-462b1832-fe22-4997-a11d-a7ae4ad0baf5 req-ff466e9a-e18c-49b2-b69f-b33afd07f16f service nova] Lock "24fbf9f0-c459-4d24-b0ff-b25281378f52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:13 user nova-compute[73104]: DEBUG nova.compute.manager [req-462b1832-fe22-4997-a11d-a7ae4ad0baf5 req-ff466e9a-e18c-49b2-b69f-b33afd07f16f service nova] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] No waiting events found dispatching network-vif-plugged-693629a9-d0ad-4257-8160-901fccb6f3fd {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:43:13 user nova-compute[73104]: WARNING nova.compute.manager [req-462b1832-fe22-4997-a11d-a7ae4ad0baf5 req-ff466e9a-e18c-49b2-b69f-b33afd07f16f service nova] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Received unexpected event network-vif-plugged-693629a9-d0ad-4257-8160-901fccb6f3fd for instance with vm_state building and task_state spawning.
Aug 26 08:43:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:14 user nova-compute[73104]: DEBUG nova.compute.manager [req-4d897fb8-6080-4104-9181-96b186ed5e52 req-671f744c-303f-406e-8d88-488e030a28af service nova] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Received event network-vif-plugged-1ff011d7-db1c-4bac-a2d3-ecf253085265 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:43:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4d897fb8-6080-4104-9181-96b186ed5e52 req-671f744c-303f-406e-8d88-488e030a28af service nova] Acquiring lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4d897fb8-6080-4104-9181-96b186ed5e52 req-671f744c-303f-406e-8d88-488e030a28af service nova] Lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4d897fb8-6080-4104-9181-96b186ed5e52 req-671f744c-303f-406e-8d88-488e030a28af service nova] Lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:14 user nova-compute[73104]: DEBUG nova.compute.manager [req-4d897fb8-6080-4104-9181-96b186ed5e52 req-671f744c-303f-406e-8d88-488e030a28af service nova] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] No waiting events found dispatching network-vif-plugged-1ff011d7-db1c-4bac-a2d3-ecf253085265 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:43:14 user nova-compute[73104]: WARNING nova.compute.manager [req-4d897fb8-6080-4104-9181-96b186ed5e52 req-671f744c-303f-406e-8d88-488e030a28af service nova] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Received unexpected event network-vif-plugged-1ff011d7-db1c-4bac-a2d3-ecf253085265 for instance with vm_state building and task_state spawning.
Aug 26 08:43:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:15 user nova-compute[73104]: DEBUG nova.compute.manager [req-6539c61e-5b98-4620-b5f2-d638c990a901 req-4005d81e-1b3c-4a19-b475-e83b51497143 service nova] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Received event network-vif-plugged-693629a9-d0ad-4257-8160-901fccb6f3fd {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:43:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6539c61e-5b98-4620-b5f2-d638c990a901 req-4005d81e-1b3c-4a19-b475-e83b51497143 service nova] Acquiring lock "24fbf9f0-c459-4d24-b0ff-b25281378f52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6539c61e-5b98-4620-b5f2-d638c990a901 req-4005d81e-1b3c-4a19-b475-e83b51497143 service nova] Lock "24fbf9f0-c459-4d24-b0ff-b25281378f52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6539c61e-5b98-4620-b5f2-d638c990a901 req-4005d81e-1b3c-4a19-b475-e83b51497143 service nova] Lock "24fbf9f0-c459-4d24-b0ff-b25281378f52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:15 user nova-compute[73104]: DEBUG nova.compute.manager [req-6539c61e-5b98-4620-b5f2-d638c990a901 req-4005d81e-1b3c-4a19-b475-e83b51497143 service nova] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] No waiting events found dispatching network-vif-plugged-693629a9-d0ad-4257-8160-901fccb6f3fd {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:43:15 user nova-compute[73104]: WARNING nova.compute.manager [req-6539c61e-5b98-4620-b5f2-d638c990a901 req-4005d81e-1b3c-4a19-b475-e83b51497143 service nova] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Received unexpected event network-vif-plugged-693629a9-d0ad-4257-8160-901fccb6f3fd for instance with vm_state building and task_state spawning.
Aug 26 08:43:16 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039396.557039, 24fbf9f0-c459-4d24-b0ff-b25281378f52 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:43:16 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] VM Resumed (Lifecycle Event)
Aug 26 08:43:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:43:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:43:16 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Instance spawned successfully.
Aug 26 08:43:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:43:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:43:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:43:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:43:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:43:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:43:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:43:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:43:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:43:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:43:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:43:16 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:43:16 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039396.55909, 24fbf9f0-c459-4d24-b0ff-b25281378f52 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:43:16 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] VM Started (Lifecycle Event)
Aug 26 08:43:16 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Instance spawned successfully.
Aug 26 08:43:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:43:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-3518fc40-4d87-4660-85fd-055e194ecffc req-ec95d15d-7574-4e2d-99e4-cc524a43d64c service nova] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Received event network-vif-plugged-1ff011d7-db1c-4bac-a2d3-ecf253085265 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:43:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3518fc40-4d87-4660-85fd-055e194ecffc req-ec95d15d-7574-4e2d-99e4-cc524a43d64c service nova] Acquiring lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3518fc40-4d87-4660-85fd-055e194ecffc req-ec95d15d-7574-4e2d-99e4-cc524a43d64c service nova] Lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3518fc40-4d87-4660-85fd-055e194ecffc req-ec95d15d-7574-4e2d-99e4-cc524a43d64c service nova] Lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-3518fc40-4d87-4660-85fd-055e194ecffc req-ec95d15d-7574-4e2d-99e4-cc524a43d64c service nova] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] No waiting events found dispatching network-vif-plugged-1ff011d7-db1c-4bac-a2d3-ecf253085265 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:43:16 user nova-compute[73104]: WARNING nova.compute.manager [req-3518fc40-4d87-4660-85fd-055e194ecffc req-ec95d15d-7574-4e2d-99e4-cc524a43d64c service nova] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Received unexpected event network-vif-plugged-1ff011d7-db1c-4bac-a2d3-ecf253085265 for instance with vm_state building and task_state spawning.
Aug 26 08:43:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:43:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:43:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:43:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:43:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:43:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:43:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:43:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:43:16 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:43:16 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039396.6087956, 3cf85d2f-de0d-4e9b-a534-98c799ae8db9 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:43:16 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] VM Resumed (Lifecycle Event)
Aug 26 08:43:16 user nova-compute[73104]: INFO nova.compute.manager [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Took 7.03 seconds to spawn the instance on the hypervisor.
Aug 26 08:43:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:43:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:43:16 user nova-compute[73104]: INFO nova.compute.manager [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Took 7.64 seconds to spawn the instance on the hypervisor.
Aug 26 08:43:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:43:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:43:16 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:43:16 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039396.6196063, 3cf85d2f-de0d-4e9b-a534-98c799ae8db9 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:43:16 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] VM Started (Lifecycle Event)
Aug 26 08:43:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:43:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:43:16 user nova-compute[73104]: INFO nova.compute.manager [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Took 8.66 seconds to build instance.
Aug 26 08:43:16 user nova-compute[73104]: INFO nova.compute.manager [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Took 9.01 seconds to build instance.
Aug 26 08:43:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cfc3aa4d-a8e3-4fe4-8f35-ffcd28e796e3 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.088s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5fdc9db5-3437-4a5a-a6a0-d269e2598e7b tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "24fbf9f0-c459-4d24-b0ff-b25281378f52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.098s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:43:17 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Creating image(s)
Aug 26 08:43:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Did not create local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 08:43:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Ensure instance console log exists: /opt/stack/data/nova/instances/7095c1e6-3825-47d2-8b63-5755fab42b49/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:43:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Start _get_guest_xml network_info=[{"id": "85d806c2-eef6-493b-96cc-f04d9580652d", "address": "fa:16:3e:6e:38:0c", "network": {"id": "ef7a15d0-8aa7-47da-948d-c0f35a723f6f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-316051521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0807a5c94bea4801bd80bbcdef223a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d806c2-ee", "ovs_interfaceid": "85d806c2-eef6-493b-96cc-f04d9580652d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'b43cf8a8-393e-4444-9a90-45246b92498b', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'weZcSxGo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7095c1e6-3825-47d2-8b63-5755fab42b49', 'attached_at': '', 'detached_at': '', 'volume_id': 'b1752f0e-7e98-4f66-8c11-e5bb3410c207', 'serial': 'b1752f0e-7e98-4f66-8c11-e5bb3410c207'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:43:17 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 08:43:17 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 08:43:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:43:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:43:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:43:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:43:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:43:17 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:43:17 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:43:17 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:43:17 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:43:17 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:43:17 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:43:17 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:43:17 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:43:17 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:43:17 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:43:17 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:43:17 user nova-compute[73104]: DEBUG nova.objects.instance [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7095c1e6-3825-47d2-8b63-5755fab42b49 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:43:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:43:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'weZcSxGo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:43:17 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 08:43:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:43:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:43:17 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 08:43:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:43:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:43:17 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:43:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc556f52-73e5-4ffa-bc30-5a98890e10bc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:43:18 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd88dc4-e020-4487-a1f0-1dfd43966d9a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207] added
Aug 26 08:43:18 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[19eb0683-a058-45d4-b6e2-3a23f75e8d17]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9cedfc-5d8f-40ed-87c3-4f4a4cb8ea41]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v weZcSxGo {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v weZcSxGo" returned: 0 in 0.028s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1319690b-9ffe-4f34-a650-7d86d57c6a6d]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'weZcSxGo'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f69d0e-3b67-4962-8ead-f9c6b09c6cdf]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c49fd6e-4072-4e51-a8d8-afcf9c030b40]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 08:43:18 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 08:43:18 user nova-compute[73104]:  {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:43:18 user nova-compute[73104]: WARNING os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 08:43:18 user nova-compute[73104]: : NotImplementedError
Aug 26 08:43:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[422cd554-1476-4ae0-bd19-cee4d5cec220]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207, portal: 172.16.0.220,3260]
Aug 26 08:43:18 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207, portal: 172.16.0.220,3260] successful.
Aug 26 08:43:18 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f91ced0-5840-44e3-a721-54cf303fdef4]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca3c138-b3d2-4602-a882-2069bc2d45b4]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:43:18 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:43:18 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[75645b74-1f84-470b-877c-a46544c1ba2b]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: None {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:43:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693039384.2765043, 385c6d93-907d-42d7-9b43-479e6caf66f9 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:43:19 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] VM Stopped (Lifecycle Event)
Aug 26 08:43:19 user nova-compute[73104]: DEBUG nova.compute.manager [None req-fb666cb5-c424-443c-98a7-9eaf11fa67f4 None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'weZcSxGo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '26239623866353131', 'path': '/dev/sdb'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239623866353131', 'path': '/dev/sdb'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T08:40:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1673391366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-485571378',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQRWVfsHBZ4hwdnYVLV5KlTz2Udh43BAhKR/jPOsxlxB/zEqEPc/lSYHzxwVfxX1lYbHxyjeV2oVVw1oFmsH/PJOpMAeQtZFJzj3QYTjDVApGkX3vb+qjI9Jl0kVdHhdQ==',key_name='tempest-keypair-247954255',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:41:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0807a5c94bea4801bd80bbcdef223a57',ramdisk_id='',reservation_id='r-0gki1p05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1626526271',owner_user_name='tempest-ServerActionsV293TestJSON-1626526271-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:42:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc49fb86f3ad4cc0930f0048701225d5',uuid=7095c1e6-3825-47d2-8b63-5755fab42b49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85d806c2-eef6-493b-96cc-f04d9580652d", "address": "fa:16:3e:6e:38:0c", "network": {"id": "ef7a15d0-8aa7-47da-948d-c0f35a723f6f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-316051521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0807a5c94bea4801bd80bbcdef223a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d806c2-ee", "ovs_interfaceid": "85d806c2-eef6-493b-96cc-f04d9580652d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Converting VIF {"id": "85d806c2-eef6-493b-96cc-f04d9580652d", "address": "fa:16:3e:6e:38:0c", "network": {"id": "ef7a15d0-8aa7-47da-948d-c0f35a723f6f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-316051521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0807a5c94bea4801bd80bbcdef223a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d806c2-ee", "ovs_interfaceid": "85d806c2-eef6-493b-96cc-f04d9580652d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:38:0c,bridge_name='br-int',has_traffic_filtering=True,id=85d806c2-eef6-493b-96cc-f04d9580652d,network=Network(ef7a15d0-8aa7-47da-948d-c0f35a723f6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85d806c2-ee') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:43:19 user nova-compute[73104]:   <uuid>7095c1e6-3825-47d2-8b63-5755fab42b49</uuid>
Aug 26 08:43:19 user nova-compute[73104]:   <name>instance-0000000e</name>
Aug 26 08:43:19 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:43:19 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:43:19 user nova-compute[73104]:   <metadata>
Aug 26 08:43:19 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:43:19 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:43:19 user nova-compute[73104]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1673391366</nova:name>
Aug 26 08:43:19 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:43:17</nova:creationTime>
Aug 26 08:43:19 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:43:19 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:43:19 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:43:19 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:43:19 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:43:19 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:43:19 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:43:19 user nova-compute[73104]:       <nova:owner>
Aug 26 08:43:19 user nova-compute[73104]:         <nova:user uuid="cc49fb86f3ad4cc0930f0048701225d5">tempest-ServerActionsV293TestJSON-1626526271-project-member</nova:user>
Aug 26 08:43:19 user nova-compute[73104]:         <nova:project uuid="0807a5c94bea4801bd80bbcdef223a57">tempest-ServerActionsV293TestJSON-1626526271</nova:project>
Aug 26 08:43:19 user nova-compute[73104]:       </nova:owner>
Aug 26 08:43:19 user nova-compute[73104]:       <nova:ports>
Aug 26 08:43:19 user nova-compute[73104]:         <nova:port uuid="85d806c2-eef6-493b-96cc-f04d9580652d">
Aug 26 08:43:19 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 08:43:19 user nova-compute[73104]:         </nova:port>
Aug 26 08:43:19 user nova-compute[73104]:       </nova:ports>
Aug 26 08:43:19 user nova-compute[73104]:     </nova:instance>
Aug 26 08:43:19 user nova-compute[73104]:   </metadata>
Aug 26 08:43:19 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:43:19 user nova-compute[73104]:     <system>
Aug 26 08:43:19 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:43:19 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:43:19 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:43:19 user nova-compute[73104]:       <entry name="serial">7095c1e6-3825-47d2-8b63-5755fab42b49</entry>
Aug 26 08:43:19 user nova-compute[73104]:       <entry name="uuid">7095c1e6-3825-47d2-8b63-5755fab42b49</entry>
Aug 26 08:43:19 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:43:19 user nova-compute[73104]:     </system>
Aug 26 08:43:19 user nova-compute[73104]:   </sysinfo>
Aug 26 08:43:19 user nova-compute[73104]:   <os>
Aug 26 08:43:19 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:43:19 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:43:19 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:43:19 user nova-compute[73104]:   </os>
Aug 26 08:43:19 user nova-compute[73104]:   <features>
Aug 26 08:43:19 user nova-compute[73104]:     <acpi/>
Aug 26 08:43:19 user nova-compute[73104]:     <apic/>
Aug 26 08:43:19 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:43:19 user nova-compute[73104]:   </features>
Aug 26 08:43:19 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:43:19 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:43:19 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:43:19 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:43:19 user nova-compute[73104]:   </clock>
Aug 26 08:43:19 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:43:19 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:43:19 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:43:19 user nova-compute[73104]:   </cpu>
Aug 26 08:43:19 user nova-compute[73104]:   <devices>
Aug 26 08:43:19 user nova-compute[73104]:     <disk type="block" device="disk">
Aug 26 08:43:19 user nova-compute[73104]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:43:19 user nova-compute[73104]:       <source dev="/dev/sdb"/>
Aug 26 08:43:19 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:43:19 user nova-compute[73104]:       <serial>b1752f0e-7e98-4f66-8c11-e5bb3410c207</serial>
Aug 26 08:43:19 user nova-compute[73104]:     </disk>
Aug 26 08:43:19 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:43:19 user nova-compute[73104]:       <mac address="fa:16:3e:6e:38:0c"/>
Aug 26 08:43:19 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:43:19 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:43:19 user nova-compute[73104]:       <target dev="tap85d806c2-ee"/>
Aug 26 08:43:19 user nova-compute[73104]:     </interface>
Aug 26 08:43:19 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:43:19 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/7095c1e6-3825-47d2-8b63-5755fab42b49/console.log" append="off"/>
Aug 26 08:43:19 user nova-compute[73104]:     </serial>
Aug 26 08:43:19 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:43:19 user nova-compute[73104]:     <video>
Aug 26 08:43:19 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:43:19 user nova-compute[73104]:     </video>
Aug 26 08:43:19 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:43:19 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:43:19 user nova-compute[73104]:     </rng>
Aug 26 08:43:19 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:43:19 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:43:19 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:43:19 user nova-compute[73104]:     </memballoon>
Aug 26 08:43:19 user nova-compute[73104]:   </devices>
Aug 26 08:43:19 user nova-compute[73104]: </domain>
Aug 26 08:43:19 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T08:40:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1673391366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-485571378',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQRWVfsHBZ4hwdnYVLV5KlTz2Udh43BAhKR/jPOsxlxB/zEqEPc/lSYHzxwVfxX1lYbHxyjeV2oVVw1oFmsH/PJOpMAeQtZFJzj3QYTjDVApGkX3vb+qjI9Jl0kVdHhdQ==',key_name='tempest-keypair-247954255',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:41:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0807a5c94bea4801bd80bbcdef223a57',ramdisk_id='',reservation_id='r-0gki1p05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1626526271',owner_user_name='tempest-ServerActionsV293TestJSON-1626526271-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:42:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc49fb86f3ad4cc0930f0048701225d5',uuid=7095c1e6-3825-47d2-8b63-5755fab42b49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85d806c2-eef6-493b-96cc-f04d9580652d", "address": "fa:16:3e:6e:38:0c", "network": {"id": "ef7a15d0-8aa7-47da-948d-c0f35a723f6f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-316051521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0807a5c94bea4801bd80bbcdef223a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d806c2-ee", "ovs_interfaceid": "85d806c2-eef6-493b-96cc-f04d9580652d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Converting VIF {"id": "85d806c2-eef6-493b-96cc-f04d9580652d", "address": "fa:16:3e:6e:38:0c", "network": {"id": "ef7a15d0-8aa7-47da-948d-c0f35a723f6f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-316051521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0807a5c94bea4801bd80bbcdef223a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d806c2-ee", "ovs_interfaceid": "85d806c2-eef6-493b-96cc-f04d9580652d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:38:0c,bridge_name='br-int',has_traffic_filtering=True,id=85d806c2-eef6-493b-96cc-f04d9580652d,network=Network(ef7a15d0-8aa7-47da-948d-c0f35a723f6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85d806c2-ee') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG os_vif [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:38:0c,bridge_name='br-int',has_traffic_filtering=True,id=85d806c2-eef6-493b-96cc-f04d9580652d,network=Network(ef7a15d0-8aa7-47da-948d-c0f35a723f6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85d806c2-ee') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85d806c2-ee, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap85d806c2-ee, col_values=(('external_ids', {'iface-id': '85d806c2-eef6-493b-96cc-f04d9580652d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:38:0c', 'vm-uuid': '7095c1e6-3825-47d2-8b63-5755fab42b49'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:19 user nova-compute[73104]: INFO os_vif [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:38:0c,bridge_name='br-int',has_traffic_filtering=True,id=85d806c2-eef6-493b-96cc-f04d9580652d,network=Network(ef7a15d0-8aa7-47da-948d-c0f35a723f6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85d806c2-ee')
Aug 26 08:43:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] No VIF found with MAC fa:16:3e:6e:38:0c, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Starting finish_revert_migration {{(pid=73104) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Start _get_guest_xml network_info=[{"id": "d4692900-c165-487d-9847-383fcf1d2270", "address": "fa:16:3e:b9:37:34", "network": {"id": "9aad8a32-d93f-45ef-be53-f84cebd194b1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2017537149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc8c266ecf8444919a4a2ed73b784b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4692900-c1", "ovs_interfaceid": "d4692900-c165-487d-9847-383fcf1d2270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '51f49465-9989-4678-8dcd-62fac93cfd15', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEOqgAiB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '385c6d93-907d-42d7-9b43-479e6caf66f9', 'attached_at': '2023-08-26T08:43:19.000000', 'detached_at': '', 'volume_id': 'c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44', 'serial': 'c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:43:19 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:43:19 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:43:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG nova.objects.instance [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lazy-loading 'vcpu_model' on Instance uuid 385c6d93-907d-42d7-9b43-479e6caf66f9 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEOqgAiB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:43:19 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:43:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:43:19 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:43:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:43:19 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:43:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bf22fe-eeef-4748-9405-b38776285bc8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:43:19 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9e3245-d7b7-4d07-a1b3-5bda3501364e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44] added
Aug 26 08:43:19 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[64dd8656-5ed4-4c93-bc69-36761d4d3701]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba3d10b-5b7f-4fe2-8b59-ba1828196d41]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rEOqgAiB {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rEOqgAiB" returned: 0 in 0.027s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7164bf96-3f25-4337-96ae-225b0c40a6df]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rEOqgAiB'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0bc554-3f2d-471b-afe4-11831b500917]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[682e9063-9881-46a1-a000-a84e5b76fac1]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:43:19 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:43:19 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:43:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:20 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f869721d-53f5-4264-b263-5bb29827e77d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:20 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44, portal: 172.16.0.220,3260]
Aug 26 08:43:20 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44, portal: 172.16.0.220,3260] successful.
Aug 26 08:43:20 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:20 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98b5967-6bb3-49c2-8e63-1e0128fa905c]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:20 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:20 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[911638c5-5a1a-4d1a-8fb7-c8cbcbc740ea]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:20 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:43:20 user nova-compute[73104]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:43:20 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:43:20 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:43:20 user nova-compute[73104]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:43:20 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:43:20 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:43:20 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:43:20 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:43:20 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:43:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:20 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[481dd094-30e3-48b5-8407-af38c95b19d1]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:20 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:43:20 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEOqgAiB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:43:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:21 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:43:21 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23736613164313738', 'path': '/dev/sdc'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:43:21 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736613164313738', 'path': '/dev/sdc'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:43:21 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1752100953',display_name='tempest-ServerActionsTestOtherB-server-1752100953',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1752100953',id=5,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNCl9FBP9XyWyY8/M5Nn5mUzz1vqHS13H5r5WR3mIkiFM7rzl4Rl7e+CWZJ8183D5yYr3nZra0DCol7pvB/KJevg8WITrJ9KzKNvGMc/QWpgMb9Lbrm7qPNUJRloZ083Q==',key_name='tempest-keypair-1221674543',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:41:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bc8c266ecf8444919a4a2ed73b784b53',ramdisk_id='',reservation_id='r-w3k6rkik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-905162429',owner_user_name='tempest-ServerActionsTestOtherB-905162429-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:43:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4e9fc4dcaaf4aa1aaa51245217b4ded',uuid=385c6d93-907d-42d7-9b43-479e6caf66f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "d4692900-c165-487d-9847-383fcf1d2270", "address": "fa:16:3e:b9:37:34", "network": {"id": "9aad8a32-d93f-45ef-be53-f84cebd194b1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2017537149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc8c266ecf8444919a4a2ed73b784b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4692900-c1", "ovs_interfaceid": "d4692900-c165-487d-9847-383fcf1d2270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:43:21 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Converting VIF {"id": "d4692900-c165-487d-9847-383fcf1d2270", "address": "fa:16:3e:b9:37:34", "network": {"id": "9aad8a32-d93f-45ef-be53-f84cebd194b1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2017537149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc8c266ecf8444919a4a2ed73b784b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4692900-c1", "ovs_interfaceid": "d4692900-c165-487d-9847-383fcf1d2270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:43:21 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:37:34,bridge_name='br-int',has_traffic_filtering=True,id=d4692900-c165-487d-9847-383fcf1d2270,network=Network(9aad8a32-d93f-45ef-be53-f84cebd194b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4692900-c1') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:43:21 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:43:21 user nova-compute[73104]:   <uuid>385c6d93-907d-42d7-9b43-479e6caf66f9</uuid>
Aug 26 08:43:21 user nova-compute[73104]:   <name>instance-00000005</name>
Aug 26 08:43:21 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:43:21 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:43:21 user nova-compute[73104]:   <metadata>
Aug 26 08:43:21 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:43:21 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:43:21 user nova-compute[73104]:       <nova:name>tempest-ServerActionsTestOtherB-server-1752100953</nova:name>
Aug 26 08:43:21 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:43:19</nova:creationTime>
Aug 26 08:43:21 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:43:21 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:43:21 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:43:21 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:43:21 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:43:21 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:43:21 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:43:21 user nova-compute[73104]:       <nova:owner>
Aug 26 08:43:21 user nova-compute[73104]:         <nova:user uuid="a4e9fc4dcaaf4aa1aaa51245217b4ded">tempest-ServerActionsTestOtherB-905162429-project-member</nova:user>
Aug 26 08:43:21 user nova-compute[73104]:         <nova:project uuid="bc8c266ecf8444919a4a2ed73b784b53">tempest-ServerActionsTestOtherB-905162429</nova:project>
Aug 26 08:43:21 user nova-compute[73104]:       </nova:owner>
Aug 26 08:43:21 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:43:21 user nova-compute[73104]:       <nova:ports>
Aug 26 08:43:21 user nova-compute[73104]:         <nova:port uuid="d4692900-c165-487d-9847-383fcf1d2270">
Aug 26 08:43:21 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 08:43:21 user nova-compute[73104]:         </nova:port>
Aug 26 08:43:21 user nova-compute[73104]:       </nova:ports>
Aug 26 08:43:21 user nova-compute[73104]:     </nova:instance>
Aug 26 08:43:21 user nova-compute[73104]:   </metadata>
Aug 26 08:43:21 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:43:21 user nova-compute[73104]:     <system>
Aug 26 08:43:21 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:43:21 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:43:21 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:43:21 user nova-compute[73104]:       <entry name="serial">385c6d93-907d-42d7-9b43-479e6caf66f9</entry>
Aug 26 08:43:21 user nova-compute[73104]:       <entry name="uuid">385c6d93-907d-42d7-9b43-479e6caf66f9</entry>
Aug 26 08:43:21 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:43:21 user nova-compute[73104]:     </system>
Aug 26 08:43:21 user nova-compute[73104]:   </sysinfo>
Aug 26 08:43:21 user nova-compute[73104]:   <os>
Aug 26 08:43:21 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:43:21 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:43:21 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:43:21 user nova-compute[73104]:   </os>
Aug 26 08:43:21 user nova-compute[73104]:   <features>
Aug 26 08:43:21 user nova-compute[73104]:     <acpi/>
Aug 26 08:43:21 user nova-compute[73104]:     <apic/>
Aug 26 08:43:21 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:43:21 user nova-compute[73104]:   </features>
Aug 26 08:43:21 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:43:21 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:43:21 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:43:21 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:43:21 user nova-compute[73104]:   </clock>
Aug 26 08:43:21 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:43:21 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:43:21 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:43:21 user nova-compute[73104]:   </cpu>
Aug 26 08:43:21 user nova-compute[73104]:   <devices>
Aug 26 08:43:21 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:43:21 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:43:21 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk"/>
Aug 26 08:43:21 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:43:21 user nova-compute[73104]:     </disk>
Aug 26 08:43:21 user nova-compute[73104]:     <disk type="block" device="disk">
Aug 26 08:43:21 user nova-compute[73104]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:43:21 user nova-compute[73104]:       <source dev="/dev/sdc"/>
Aug 26 08:43:21 user nova-compute[73104]:       <target dev="vdb" bus="virtio"/>
Aug 26 08:43:21 user nova-compute[73104]:       <serial>c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44</serial>
Aug 26 08:43:21 user nova-compute[73104]:     </disk>
Aug 26 08:43:21 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:43:21 user nova-compute[73104]:       <mac address="fa:16:3e:b9:37:34"/>
Aug 26 08:43:21 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:43:21 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:43:21 user nova-compute[73104]:       <target dev="tapd4692900-c1"/>
Aug 26 08:43:21 user nova-compute[73104]:     </interface>
Aug 26 08:43:21 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:43:21 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/console.log" append="off"/>
Aug 26 08:43:21 user nova-compute[73104]:     </serial>
Aug 26 08:43:21 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:43:21 user nova-compute[73104]:     <video>
Aug 26 08:43:21 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:43:21 user nova-compute[73104]:     </video>
Aug 26 08:43:21 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:43:21 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:43:21 user nova-compute[73104]:     </rng>
Aug 26 08:43:21 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:43:21 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:43:21 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:43:21 user nova-compute[73104]:     </memballoon>
Aug 26 08:43:21 user nova-compute[73104]:   </devices>
Aug 26 08:43:21 user nova-compute[73104]: </domain>
Aug 26 08:43:21 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:43:21 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1752100953',display_name='tempest-ServerActionsTestOtherB-server-1752100953',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1752100953',id=5,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNCl9FBP9XyWyY8/M5Nn5mUzz1vqHS13H5r5WR3mIkiFM7rzl4Rl7e+CWZJ8183D5yYr3nZra0DCol7pvB/KJevg8WITrJ9KzKNvGMc/QWpgMb9Lbrm7qPNUJRloZ083Q==',key_name='tempest-keypair-1221674543',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:41:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bc8c266ecf8444919a4a2ed73b784b53',ramdisk_id='',reservation_id='r-w3k6rkik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-905162429',owner_user_name='tempest-ServerActionsTestOtherB-905162429-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:43:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4e9fc4dcaaf4aa1aaa51245217b4ded',uuid=385c6d93-907d-42d7-9b43-479e6caf66f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "d4692900-c165-487d-9847-383fcf1d2270", "address": "fa:16:3e:b9:37:34", "network": {"id": "9aad8a32-d93f-45ef-be53-f84cebd194b1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2017537149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc8c266ecf8444919a4a2ed73b784b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4692900-c1", "ovs_interfaceid": "d4692900-c165-487d-9847-383fcf1d2270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:43:21 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Converting VIF {"id": "d4692900-c165-487d-9847-383fcf1d2270", "address": "fa:16:3e:b9:37:34", "network": {"id": "9aad8a32-d93f-45ef-be53-f84cebd194b1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2017537149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc8c266ecf8444919a4a2ed73b784b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4692900-c1", "ovs_interfaceid": "d4692900-c165-487d-9847-383fcf1d2270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:43:21 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:37:34,bridge_name='br-int',has_traffic_filtering=True,id=d4692900-c165-487d-9847-383fcf1d2270,network=Network(9aad8a32-d93f-45ef-be53-f84cebd194b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4692900-c1') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:43:21 user nova-compute[73104]: DEBUG os_vif [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:37:34,bridge_name='br-int',has_traffic_filtering=True,id=d4692900-c165-487d-9847-383fcf1d2270,network=Network(9aad8a32-d93f-45ef-be53-f84cebd194b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4692900-c1') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:43:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:43:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:43:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4692900-c1, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:43:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd4692900-c1, col_values=(('external_ids', {'iface-id': 'd4692900-c165-487d-9847-383fcf1d2270', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:37:34', 'vm-uuid': '385c6d93-907d-42d7-9b43-479e6caf66f9'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:43:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:43:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:21 user nova-compute[73104]: INFO os_vif [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:37:34,bridge_name='br-int',has_traffic_filtering=True,id=d4692900-c165-487d-9847-383fcf1d2270,network=Network(9aad8a32-d93f-45ef-be53-f84cebd194b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4692900-c1')
Aug 26 08:43:21 user nova-compute[73104]: DEBUG nova.compute.manager [req-bb3d470b-c6ef-4b4f-bdf9-bf82bd271d97 req-2c9ab49c-a8ec-41d8-8922-21adb6e0005c service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Received event network-vif-plugged-85d806c2-eef6-493b-96cc-f04d9580652d {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:43:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-bb3d470b-c6ef-4b4f-bdf9-bf82bd271d97 req-2c9ab49c-a8ec-41d8-8922-21adb6e0005c service nova] Acquiring lock "7095c1e6-3825-47d2-8b63-5755fab42b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-bb3d470b-c6ef-4b4f-bdf9-bf82bd271d97 req-2c9ab49c-a8ec-41d8-8922-21adb6e0005c service nova] Lock "7095c1e6-3825-47d2-8b63-5755fab42b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-bb3d470b-c6ef-4b4f-bdf9-bf82bd271d97 req-2c9ab49c-a8ec-41d8-8922-21adb6e0005c service nova] Lock "7095c1e6-3825-47d2-8b63-5755fab42b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:21 user nova-compute[73104]: DEBUG nova.compute.manager [req-bb3d470b-c6ef-4b4f-bdf9-bf82bd271d97 req-2c9ab49c-a8ec-41d8-8922-21adb6e0005c service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] No waiting events found dispatching network-vif-plugged-85d806c2-eef6-493b-96cc-f04d9580652d {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:43:21 user nova-compute[73104]: WARNING nova.compute.manager [req-bb3d470b-c6ef-4b4f-bdf9-bf82bd271d97 req-2c9ab49c-a8ec-41d8-8922-21adb6e0005c service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Received unexpected event network-vif-plugged-85d806c2-eef6-493b-96cc-f04d9580652d for instance with vm_state active and task_state rebuild_spawning.
Aug 26 08:43:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:22 user nova-compute[73104]: DEBUG nova.compute.manager [req-6e31b208-4880-44ee-b2c7-ed4012c4017f req-be6b645a-e6b6-42ca-905d-dddcf12f1a8b service nova] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Received event network-changed-bdecf202-93ef-451c-af71-4683fe993589 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:43:22 user nova-compute[73104]: DEBUG nova.compute.manager [req-6e31b208-4880-44ee-b2c7-ed4012c4017f req-be6b645a-e6b6-42ca-905d-dddcf12f1a8b service nova] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Refreshing instance network info cache due to event network-changed-bdecf202-93ef-451c-af71-4683fe993589. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:43:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6e31b208-4880-44ee-b2c7-ed4012c4017f req-be6b645a-e6b6-42ca-905d-dddcf12f1a8b service nova] Acquiring lock "refresh_cache-3963cffc-9397-45ca-bf80-198b219beb4f" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:43:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6e31b208-4880-44ee-b2c7-ed4012c4017f req-be6b645a-e6b6-42ca-905d-dddcf12f1a8b service nova] Acquired lock "refresh_cache-3963cffc-9397-45ca-bf80-198b219beb4f" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:43:22 user nova-compute[73104]: DEBUG nova.network.neutron [req-6e31b208-4880-44ee-b2c7-ed4012c4017f req-be6b645a-e6b6-42ca-905d-dddcf12f1a8b service nova] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Refreshing network info cache for port bdecf202-93ef-451c-af71-4683fe993589 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:43:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Acquiring lock "3963cffc-9397-45ca-bf80-198b219beb4f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Lock "3963cffc-9397-45ca-bf80-198b219beb4f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG nova.objects.instance [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Lazy-loading 'flavor' on Instance uuid 3963cffc-9397-45ca-bf80-198b219beb4f {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Lock "3963cffc-9397-45ca-bf80-198b219beb4f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.099s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-a95bf0c9-39f1-4fb1-91df-2733a42cea35 req-d57d5928-9d9d-4f6f-a5fe-f84fd752958d service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Received event network-vif-plugged-d4692900-c165-487d-9847-383fcf1d2270 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a95bf0c9-39f1-4fb1-91df-2733a42cea35 req-d57d5928-9d9d-4f6f-a5fe-f84fd752958d service nova] Acquiring lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a95bf0c9-39f1-4fb1-91df-2733a42cea35 req-d57d5928-9d9d-4f6f-a5fe-f84fd752958d service nova] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a95bf0c9-39f1-4fb1-91df-2733a42cea35 req-d57d5928-9d9d-4f6f-a5fe-f84fd752958d service nova] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-a95bf0c9-39f1-4fb1-91df-2733a42cea35 req-d57d5928-9d9d-4f6f-a5fe-f84fd752958d service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] No waiting events found dispatching network-vif-plugged-d4692900-c165-487d-9847-383fcf1d2270 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:43:23 user nova-compute[73104]: WARNING nova.compute.manager [req-a95bf0c9-39f1-4fb1-91df-2733a42cea35 req-d57d5928-9d9d-4f6f-a5fe-f84fd752958d service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Received unexpected event network-vif-plugged-d4692900-c165-487d-9847-383fcf1d2270 for instance with vm_state resized and task_state resize_reverting.
Aug 26 08:43:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Acquiring lock "3963cffc-9397-45ca-bf80-198b219beb4f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Lock "3963cffc-9397-45ca-bf80-198b219beb4f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:23 user nova-compute[73104]: INFO nova.compute.manager [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Attaching volume 6642f875-ee85-40d1-b6ac-1829f915ea1b to /dev/vdb
Aug 26 08:43:23 user nova-compute[73104]: DEBUG nova.network.neutron [req-6e31b208-4880-44ee-b2c7-ed4012c4017f req-be6b645a-e6b6-42ca-905d-dddcf12f1a8b service nova] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Updated VIF entry in instance network info cache for port bdecf202-93ef-451c-af71-4683fe993589. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG nova.network.neutron [req-6e31b208-4880-44ee-b2c7-ed4012c4017f req-be6b645a-e6b6-42ca-905d-dddcf12f1a8b service nova] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Updating instance_info_cache with network_info: [{"id": "bdecf202-93ef-451c-af71-4683fe993589", "address": "fa:16:3e:3d:be:58", "network": {"id": "77cbe2e5-4ec7-4dff-a3b8-8fa7b46e5165", "bridge": "br-int", "label": "tempest-TestVolumeSwap-643731537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04c9c6d04e234fe5a9665af6a8b63aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdecf202-93", "ovs_interfaceid": "bdecf202-93ef-451c-af71-4683fe993589", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-06fd29d6-72bf-4925-8fec-579714c2ab13 req-4298280f-d454-4526-9151-50bf8b4baa12 service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Received event network-vif-plugged-85d806c2-eef6-493b-96cc-f04d9580652d {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-06fd29d6-72bf-4925-8fec-579714c2ab13 req-4298280f-d454-4526-9151-50bf8b4baa12 service nova] Acquiring lock "7095c1e6-3825-47d2-8b63-5755fab42b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-06fd29d6-72bf-4925-8fec-579714c2ab13 req-4298280f-d454-4526-9151-50bf8b4baa12 service nova] Lock "7095c1e6-3825-47d2-8b63-5755fab42b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-06fd29d6-72bf-4925-8fec-579714c2ab13 req-4298280f-d454-4526-9151-50bf8b4baa12 service nova] Lock "7095c1e6-3825-47d2-8b63-5755fab42b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-06fd29d6-72bf-4925-8fec-579714c2ab13 req-4298280f-d454-4526-9151-50bf8b4baa12 service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] No waiting events found dispatching network-vif-plugged-85d806c2-eef6-493b-96cc-f04d9580652d {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:43:23 user nova-compute[73104]: WARNING nova.compute.manager [req-06fd29d6-72bf-4925-8fec-579714c2ab13 req-4298280f-d454-4526-9151-50bf8b4baa12 service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Received unexpected event network-vif-plugged-85d806c2-eef6-493b-96cc-f04d9580652d for instance with vm_state active and task_state rebuild_spawning.
Aug 26 08:43:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6e31b208-4880-44ee-b2c7-ed4012c4017f req-be6b645a-e6b6-42ca-905d-dddcf12f1a8b service nova] Releasing lock "refresh_cache-3963cffc-9397-45ca-bf80-198b219beb4f" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG os_brick.utils [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8ae802-055e-4c46-a76c-7a1bfae084c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.027s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8217432-ed0b-4def-bc25-5c96289f0e7c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[929d45f8-d4de-48ff-872f-9bdcc821e9f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b740b6-7731-47c7-be92-a5a068eaf376]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0d985ff2-2410-4143-aebb-774781c0ee17 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "13200b79-17a6-4c18-87da-653311946a04" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0d985ff2-2410-4143-aebb-774781c0ee17 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "13200b79-17a6-4c18-87da-653311946a04" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0d985ff2-2410-4143-aebb-774781c0ee17 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "13200b79-17a6-4c18-87da-653311946a04-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0d985ff2-2410-4143-aebb-774781c0ee17 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "13200b79-17a6-4c18-87da-653311946a04-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0d985ff2-2410-4143-aebb-774781c0ee17 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "13200b79-17a6-4c18-87da-653311946a04-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:43:23 user nova-compute[73104]: INFO nova.compute.manager [None req-0d985ff2-2410-4143-aebb-774781c0ee17 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Terminating instance
Aug 26 08:43:23 user nova-compute[73104]: DEBUG nova.compute.manager [None req-0d985ff2-2410-4143-aebb-774781c0ee17 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:43:23 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:43:23 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe986b09-e24a-4115-8b04-87e7646342a3]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG os_brick.utils [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] <== get_connector_properties: return (216ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Updating existing volume attachment record: 32ce6a90-2b19-493c-859f-75d85c4732f6 {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:24 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 13200b79-17a6-4c18-87da-653311946a04] Instance destroyed successfully.
Aug 26 08:43:24 user nova-compute[73104]: DEBUG nova.objects.instance [None req-0d985ff2-2410-4143-aebb-774781c0ee17 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lazy-loading 'resources' on Instance uuid 13200b79-17a6-4c18-87da-653311946a04 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:43:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-0d985ff2-2410-4143-aebb-774781c0ee17 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1718925409',display_name='tempest-AttachVolumeNegativeTest-server-1718925409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1718925409',id=4,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNabyOeHzYWuTgs4Gz325I5C6StKC5gsKQMUFIL+mwErPQHgTXVX0IxTTA/sxPJCNyRDDt3qaNhlXynGeXpIRFjQqLiBWgWe43CGGhyYC2LpBA0tPmFxO+1yNJyhbJvXA==',key_name='tempest-keypair-1494365081',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:37:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ad68e5623014e2fb3f10ba92d388291',ramdisk_id='',reservation_id='r-vr36mgg9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1286694855',owner_user_name='tempest-AttachVolumeNegativeTest-1286694855-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:37:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='062587ed00ae457889f884346c99e11b',uuid=13200b79-17a6-4c18-87da-653311946a04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76ccf91d-d705-4512-8bd8-d6747105f390", "address": "fa:16:3e:16:f1:1c", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ccf91d-d7", "ovs_interfaceid": "76ccf91d-d705-4512-8bd8-d6747105f390", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:43:24 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-0d985ff2-2410-4143-aebb-774781c0ee17 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Converting VIF {"id": "76ccf91d-d705-4512-8bd8-d6747105f390", "address": "fa:16:3e:16:f1:1c", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ccf91d-d7", "ovs_interfaceid": "76ccf91d-d705-4512-8bd8-d6747105f390", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:43:24 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-0d985ff2-2410-4143-aebb-774781c0ee17 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:f1:1c,bridge_name='br-int',has_traffic_filtering=True,id=76ccf91d-d705-4512-8bd8-d6747105f390,network=Network(ea6c6ce0-85a4-40db-96e2-ca078887ab66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ccf91d-d7') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:43:24 user nova-compute[73104]: DEBUG os_vif [None req-0d985ff2-2410-4143-aebb-774781c0ee17 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:f1:1c,bridge_name='br-int',has_traffic_filtering=True,id=76ccf91d-d705-4512-8bd8-d6747105f390,network=Network(ea6c6ce0-85a4-40db-96e2-ca078887ab66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ccf91d-d7') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:43:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76ccf91d-d7, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:43:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:43:24 user nova-compute[73104]: INFO os_vif [None req-0d985ff2-2410-4143-aebb-774781c0ee17 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:f1:1c,bridge_name='br-int',has_traffic_filtering=True,id=76ccf91d-d705-4512-8bd8-d6747105f390,network=Network(ea6c6ce0-85a4-40db-96e2-ca078887ab66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ccf91d-d7')
Aug 26 08:43:24 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-0d985ff2-2410-4143-aebb-774781c0ee17 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Deleting instance files /opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04_del
Aug 26 08:43:24 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-0d985ff2-2410-4143-aebb-774781c0ee17 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Deletion of /opt/stack/data/nova/instances/13200b79-17a6-4c18-87da-653311946a04_del complete
Aug 26 08:43:24 user nova-compute[73104]: INFO nova.compute.manager [None req-0d985ff2-2410-4143-aebb-774781c0ee17 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 13200b79-17a6-4c18-87da-653311946a04] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 26 08:43:24 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-0d985ff2-2410-4143-aebb-774781c0ee17 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 08:43:24 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 13200b79-17a6-4c18-87da-653311946a04] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 08:43:24 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 13200b79-17a6-4c18-87da-653311946a04] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039405.0036936, 7095c1e6-3825-47d2-8b63-5755fab42b49 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:43:25 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] VM Resumed (Lifecycle Event)
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.compute.manager [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:43:25 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Instance spawned successfully.
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:43:25 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039405.0074165, 7095c1e6-3825-47d2-8b63-5755fab42b49 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:43:25 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] VM Started (Lifecycle Event)
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.compute.manager [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:43:25 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 08:43:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.004s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.objects.instance [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73104) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.compute.manager [req-9dbc2484-b2fe-4b10-be33-9ea8be0fd710 req-13e60c92-4326-4b17-a2da-030d18797f67 service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Received event network-vif-plugged-d4692900-c165-487d-9847-383fcf1d2270 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9dbc2484-b2fe-4b10-be33-9ea8be0fd710 req-13e60c92-4326-4b17-a2da-030d18797f67 service nova] Acquiring lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9dbc2484-b2fe-4b10-be33-9ea8be0fd710 req-13e60c92-4326-4b17-a2da-030d18797f67 service nova] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9dbc2484-b2fe-4b10-be33-9ea8be0fd710 req-13e60c92-4326-4b17-a2da-030d18797f67 service nova] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.compute.manager [req-9dbc2484-b2fe-4b10-be33-9ea8be0fd710 req-13e60c92-4326-4b17-a2da-030d18797f67 service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] No waiting events found dispatching network-vif-plugged-d4692900-c165-487d-9847-383fcf1d2270 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:43:25 user nova-compute[73104]: WARNING nova.compute.manager [req-9dbc2484-b2fe-4b10-be33-9ea8be0fd710 req-13e60c92-4326-4b17-a2da-030d18797f67 service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Received unexpected event network-vif-plugged-d4692900-c165-487d-9847-383fcf1d2270 for instance with vm_state resized and task_state resize_reverting.
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.compute.manager [req-9dbc2484-b2fe-4b10-be33-9ea8be0fd710 req-13e60c92-4326-4b17-a2da-030d18797f67 service nova] [instance: 13200b79-17a6-4c18-87da-653311946a04] Received event network-vif-unplugged-76ccf91d-d705-4512-8bd8-d6747105f390 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9dbc2484-b2fe-4b10-be33-9ea8be0fd710 req-13e60c92-4326-4b17-a2da-030d18797f67 service nova] Acquiring lock "13200b79-17a6-4c18-87da-653311946a04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9dbc2484-b2fe-4b10-be33-9ea8be0fd710 req-13e60c92-4326-4b17-a2da-030d18797f67 service nova] Lock "13200b79-17a6-4c18-87da-653311946a04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9dbc2484-b2fe-4b10-be33-9ea8be0fd710 req-13e60c92-4326-4b17-a2da-030d18797f67 service nova] Lock "13200b79-17a6-4c18-87da-653311946a04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.compute.manager [req-9dbc2484-b2fe-4b10-be33-9ea8be0fd710 req-13e60c92-4326-4b17-a2da-030d18797f67 service nova] [instance: 13200b79-17a6-4c18-87da-653311946a04] No waiting events found dispatching network-vif-unplugged-76ccf91d-d705-4512-8bd8-d6747105f390 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.compute.manager [req-9dbc2484-b2fe-4b10-be33-9ea8be0fd710 req-13e60c92-4326-4b17-a2da-030d18797f67 service nova] [instance: 13200b79-17a6-4c18-87da-653311946a04] Received event network-vif-unplugged-76ccf91d-d705-4512-8bd8-d6747105f390 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.compute.manager [req-9dbc2484-b2fe-4b10-be33-9ea8be0fd710 req-13e60c92-4326-4b17-a2da-030d18797f67 service nova] [instance: 13200b79-17a6-4c18-87da-653311946a04] Received event network-vif-plugged-76ccf91d-d705-4512-8bd8-d6747105f390 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9dbc2484-b2fe-4b10-be33-9ea8be0fd710 req-13e60c92-4326-4b17-a2da-030d18797f67 service nova] Acquiring lock "13200b79-17a6-4c18-87da-653311946a04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9dbc2484-b2fe-4b10-be33-9ea8be0fd710 req-13e60c92-4326-4b17-a2da-030d18797f67 service nova] Lock "13200b79-17a6-4c18-87da-653311946a04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9dbc2484-b2fe-4b10-be33-9ea8be0fd710 req-13e60c92-4326-4b17-a2da-030d18797f67 service nova] Lock "13200b79-17a6-4c18-87da-653311946a04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.compute.manager [req-9dbc2484-b2fe-4b10-be33-9ea8be0fd710 req-13e60c92-4326-4b17-a2da-030d18797f67 service nova] [instance: 13200b79-17a6-4c18-87da-653311946a04] No waiting events found dispatching network-vif-plugged-76ccf91d-d705-4512-8bd8-d6747105f390 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:43:25 user nova-compute[73104]: WARNING nova.compute.manager [req-9dbc2484-b2fe-4b10-be33-9ea8be0fd710 req-13e60c92-4326-4b17-a2da-030d18797f67 service nova] [instance: 13200b79-17a6-4c18-87da-653311946a04] Received unexpected event network-vif-plugged-76ccf91d-d705-4512-8bd8-d6747105f390 for instance with vm_state active and task_state deleting.
Aug 26 08:43:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-55b13c9f-014b-4739-9004-3ee03ef5842d tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.147s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 13200b79-17a6-4c18-87da-653311946a04] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.compute.manager [req-c34faa54-98f8-47bc-bf72-383aade5b530 req-76b54313-3671-4ee7-afaf-fc9937f9ff0f service nova] [instance: 13200b79-17a6-4c18-87da-653311946a04] Received event network-vif-deleted-76ccf91d-d705-4512-8bd8-d6747105f390 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:43:25 user nova-compute[73104]: INFO nova.compute.manager [req-c34faa54-98f8-47bc-bf72-383aade5b530 req-76b54313-3671-4ee7-afaf-fc9937f9ff0f service nova] [instance: 13200b79-17a6-4c18-87da-653311946a04] Neutron deleted interface 76ccf91d-d705-4512-8bd8-d6747105f390; detaching it from the instance and deleting it from the info cache
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.network.neutron [req-c34faa54-98f8-47bc-bf72-383aade5b530 req-76b54313-3671-4ee7-afaf-fc9937f9ff0f service nova] [instance: 13200b79-17a6-4c18-87da-653311946a04] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:43:25 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 13200b79-17a6-4c18-87da-653311946a04] Took 1.08 seconds to deallocate network for instance.
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.compute.manager [req-c34faa54-98f8-47bc-bf72-383aade5b530 req-76b54313-3671-4ee7-afaf-fc9937f9ff0f service nova] [instance: 13200b79-17a6-4c18-87da-653311946a04] Detach interface failed, port_id=76ccf91d-d705-4512-8bd8-d6747105f390, reason: Instance 13200b79-17a6-4c18-87da-653311946a04 could not be found. {{(pid=73104) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.compute.manager [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039405.8422167, 385c6d93-907d-42d7-9b43-479e6caf66f9 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:43:25 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] VM Resumed (Lifecycle Event)
Aug 26 08:43:25 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Instance running successfully.
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] finish_revert_migration finished successfully. {{(pid=73104) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:43:25 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039405.8429253, 385c6d93-907d-42d7-9b43-479e6caf66f9 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:43:25 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] VM Started (Lifecycle Event)
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0d985ff2-2410-4143-aebb-774781c0ee17 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0d985ff2-2410-4143-aebb-774781c0ee17 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:25 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:43:26 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 26 08:43:26 user nova-compute[73104]: INFO nova.compute.manager [None req-414c94b1-b4f7-4ba6-b298-e0e88d443dfc tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Updating instance to original state: 'active'
Aug 26 08:43:26 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-0d985ff2-2410-4143-aebb-774781c0ee17 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:43:26 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-0d985ff2-2410-4143-aebb-774781c0ee17 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:43:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0d985ff2-2410-4143-aebb-774781c0ee17 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:26 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-0d985ff2-2410-4143-aebb-774781c0ee17 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Deleted allocations for instance 13200b79-17a6-4c18-87da-653311946a04
Aug 26 08:43:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0d985ff2-2410-4143-aebb-774781c0ee17 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "13200b79-17a6-4c18-87da-653311946a04" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.895s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQwKznaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:43:36 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:43:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:43:36 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:43:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:43:36 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:43:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd43ced4-1094-4d22-b36e-3986a50307a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:43:36 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d739afd-bae4-4cba-83dc-745b078b7278]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b] added
Aug 26 08:43:36 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ac4e76-86ae-4b52-b2df-ed1a53edc687]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e549cd5f-5ef3-4cd0-823f-6b6cc8241ab9]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SQwKznaC {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SQwKznaC" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ab2e69-5778-4573-9800-9533bff188f8]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SQwKznaC'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.040s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[481dcc06-bac5-4826-be96-ac3cf67fb280]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58b2f7c-18e8-4368-aca3-542728874e18]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:43:36 user nova-compute[73104]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:43:36 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:43:36 user nova-compute[73104]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:43:36 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb5bd75-44f9-4271-b8cf-429816aed1da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b, portal: 172.16.0.220,3260]
Aug 26 08:43:36 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b, portal: 172.16.0.220,3260] successful.
Aug 26 08:43:36 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de66f90-19d6-4097-8c68-be3979f7c095]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfb2a2a-6f53-43c9-a0c8-8c9f5906fca7]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:43:36 user nova-compute[73104]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:43:36 user nova-compute[73104]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b (non-flash)
Aug 26 08:43:36 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:43:36 user nova-compute[73104]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:43:36 user nova-compute[73104]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b (non-flash)
Aug 26 08:43:36 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e87bad-7064-4828-911e-ee9a057bbf0d]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:43:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQwKznaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:43:37 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:43:37 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '23734313435613162', 'path': '/dev/sdd'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:43:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734313435613162', 'path': '/dev/sdd'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:43:37 user nova-compute[73104]: DEBUG nova.objects.instance [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Lazy-loading 'flavor' on Instance uuid 3963cffc-9397-45ca-bf80-198b219beb4f {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:43:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 08:43:37 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:43:37 user nova-compute[73104]:   <source dev="/dev/sdd"/>
Aug 26 08:43:37 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:43:37 user nova-compute[73104]:   <serial>6642f875-ee85-40d1-b6ac-1829f915ea1b</serial>
Aug 26 08:43:37 user nova-compute[73104]: </disk>
Aug 26 08:43:37 user nova-compute[73104]:  {{(pid=73104) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 08:43:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-18ffe03d-8ba4-4224-a559-cbb6af0e2ac1 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "94de2062-7017-44fe-8df0-0a3cd63d5498" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-18ffe03d-8ba4-4224-a559-cbb6af0e2ac1 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-18ffe03d-8ba4-4224-a559-cbb6af0e2ac1 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-18ffe03d-8ba4-4224-a559-cbb6af0e2ac1 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-18ffe03d-8ba4-4224-a559-cbb6af0e2ac1 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:37 user nova-compute[73104]: INFO nova.compute.manager [None req-18ffe03d-8ba4-4224-a559-cbb6af0e2ac1 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Terminating instance
Aug 26 08:43:37 user nova-compute[73104]: DEBUG nova.compute.manager [None req-18ffe03d-8ba4-4224-a559-cbb6af0e2ac1 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 08:43:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:43:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:43:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] No VIF found with MAC fa:16:3e:3d:be:58, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:43:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2dce5f34-77b4-4b12-9f19-250c47cf1498 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Lock "3963cffc-9397-45ca-bf80-198b219beb4f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.893s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:38 user nova-compute[73104]: DEBUG nova.compute.manager [req-94e433a2-c0eb-454a-be14-078efc10b181 req-b7d46b8a-7ac6-4acb-8a92-1cdd29c31575 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Received event network-vif-unplugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:43:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-94e433a2-c0eb-454a-be14-078efc10b181 req-b7d46b8a-7ac6-4acb-8a92-1cdd29c31575 service nova] Acquiring lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-94e433a2-c0eb-454a-be14-078efc10b181 req-b7d46b8a-7ac6-4acb-8a92-1cdd29c31575 service nova] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-94e433a2-c0eb-454a-be14-078efc10b181 req-b7d46b8a-7ac6-4acb-8a92-1cdd29c31575 service nova] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:38 user nova-compute[73104]: DEBUG nova.compute.manager [req-94e433a2-c0eb-454a-be14-078efc10b181 req-b7d46b8a-7ac6-4acb-8a92-1cdd29c31575 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] No waiting events found dispatching network-vif-unplugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:43:38 user nova-compute[73104]: DEBUG nova.compute.manager [req-94e433a2-c0eb-454a-be14-078efc10b181 req-b7d46b8a-7ac6-4acb-8a92-1cdd29c31575 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Received event network-vif-unplugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:43:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:38 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Instance destroyed successfully.
Aug 26 08:43:38 user nova-compute[73104]: DEBUG nova.objects.instance [None req-18ffe03d-8ba4-4224-a559-cbb6af0e2ac1 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lazy-loading 'resources' on Instance uuid 94de2062-7017-44fe-8df0-0a3cd63d5498 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:43:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-18ffe03d-8ba4-4224-a559-cbb6af0e2ac1 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T08:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-123632046',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-123632046',id=3,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPi19fyJwWFBGW+j/nwVTdr8vlXHUgdkMaN5yhtSAh87HkLJ/UmDNji3VEqtFmHeRNmvggGbQx0WylavGyvgQRZOyai6wn1O5pmvdVkCKfZS5FYzwTtABxlMMyHIP1kb8A==',key_name='tempest-keypair-1165821836',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:41:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='770daa2e8b274a9b828e489c1573ced4',ramdisk_id='',reservation_id='r-2y3651sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2062858766',owner_user_name='tempest-AttachVolumeShelveTestJSON-2062858766-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:41:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db3ae37701df47a5b35026fe3857bc51',uuid=94de2062-7017-44fe-8df0-0a3cd63d5498,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "address": "fa:16:3e:65:0d:e0", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a3e387d-f6", "ovs_interfaceid": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:43:38 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-18ffe03d-8ba4-4224-a559-cbb6af0e2ac1 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Converting VIF {"id": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "address": "fa:16:3e:65:0d:e0", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a3e387d-f6", "ovs_interfaceid": "4a3e387d-f638-43fc-bdef-4c0b608d29d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:43:38 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-18ffe03d-8ba4-4224-a559-cbb6af0e2ac1 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:0d:e0,bridge_name='br-int',has_traffic_filtering=True,id=4a3e387d-f638-43fc-bdef-4c0b608d29d4,network=Network(38f7ec35-12eb-46fe-a425-51ee854d804d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a3e387d-f6') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:43:38 user nova-compute[73104]: DEBUG os_vif [None req-18ffe03d-8ba4-4224-a559-cbb6af0e2ac1 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:0d:e0,bridge_name='br-int',has_traffic_filtering=True,id=4a3e387d-f638-43fc-bdef-4c0b608d29d4,network=Network(38f7ec35-12eb-46fe-a425-51ee854d804d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a3e387d-f6') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:43:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a3e387d-f6, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:43:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:43:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:38 user nova-compute[73104]: INFO os_vif [None req-18ffe03d-8ba4-4224-a559-cbb6af0e2ac1 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:0d:e0,bridge_name='br-int',has_traffic_filtering=True,id=4a3e387d-f638-43fc-bdef-4c0b608d29d4,network=Network(38f7ec35-12eb-46fe-a425-51ee854d804d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a3e387d-f6')
Aug 26 08:43:38 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-18ffe03d-8ba4-4224-a559-cbb6af0e2ac1 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Deleting instance files /opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498_del
Aug 26 08:43:38 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-18ffe03d-8ba4-4224-a559-cbb6af0e2ac1 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Deletion of /opt/stack/data/nova/instances/94de2062-7017-44fe-8df0-0a3cd63d5498_del complete
Aug 26 08:43:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:38 user nova-compute[73104]: INFO nova.compute.manager [None req-18ffe03d-8ba4-4224-a559-cbb6af0e2ac1 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Took 1.02 seconds to destroy the instance on the hypervisor.
Aug 26 08:43:38 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-18ffe03d-8ba4-4224-a559-cbb6af0e2ac1 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 08:43:38 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 08:43:38 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 08:43:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:39 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693039404.5715532, 13200b79-17a6-4c18-87da-653311946a04 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:43:39 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 13200b79-17a6-4c18-87da-653311946a04] VM Stopped (Lifecycle Event)
Aug 26 08:43:39 user nova-compute[73104]: DEBUG nova.compute.manager [None req-7df580be-dd17-4164-a94b-e0f3f4065eca None None] [instance: 13200b79-17a6-4c18-87da-653311946a04] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:43:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Acquiring lock "3963cffc-9397-45ca-bf80-198b219beb4f" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Lock "3963cffc-9397-45ca-bf80-198b219beb4f" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:39 user nova-compute[73104]: DEBUG os_brick.utils [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:43:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:39 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[589291cc-c3bd-4f8c-8a93-8189e7196bec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:39 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f89f22a-cebc-4e56-941c-0a8d862b90d9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:39 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bbc97b-4ea6-42ab-8b85-df9ef9f96c5b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:39 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d0f3f4-3dff-408e-a244-70ed698ff896]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:43:39 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:43:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:43:39 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:43:39 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b34938c-7bd3-461f-9f0a-81abaab2396d]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:39 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:43:39 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:43:39 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:43:39 user nova-compute[73104]: DEBUG os_brick.utils [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:43:39 user nova-compute[73104]: INFO nova.compute.manager [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Swapping volume 6642f875-ee85-40d1-b6ac-1829f915ea1b for 497551ed-3d44-4806-b062-80ac79fa9d65
Aug 26 08:43:40 user nova-compute[73104]: DEBUG nova.compute.manager [req-16972bca-5c29-48f6-afe3-d8489a4ed76b req-af55ae1d-5dec-423d-8155-f27c81cb33bc service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Received event network-vif-plugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:43:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-16972bca-5c29-48f6-afe3-d8489a4ed76b req-af55ae1d-5dec-423d-8155-f27c81cb33bc service nova] Acquiring lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-16972bca-5c29-48f6-afe3-d8489a4ed76b req-af55ae1d-5dec-423d-8155-f27c81cb33bc service nova] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-16972bca-5c29-48f6-afe3-d8489a4ed76b req-af55ae1d-5dec-423d-8155-f27c81cb33bc service nova] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:40 user nova-compute[73104]: DEBUG nova.compute.manager [req-16972bca-5c29-48f6-afe3-d8489a4ed76b req-af55ae1d-5dec-423d-8155-f27c81cb33bc service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] No waiting events found dispatching network-vif-plugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:43:40 user nova-compute[73104]: WARNING nova.compute.manager [req-16972bca-5c29-48f6-afe3-d8489a4ed76b req-af55ae1d-5dec-423d-8155-f27c81cb33bc service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Received unexpected event network-vif-plugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 for instance with vm_state active and task_state deleting.
Aug 26 08:43:40 user nova-compute[73104]: DEBUG nova.compute.manager [req-16972bca-5c29-48f6-afe3-d8489a4ed76b req-af55ae1d-5dec-423d-8155-f27c81cb33bc service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Received event network-vif-plugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:43:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-16972bca-5c29-48f6-afe3-d8489a4ed76b req-af55ae1d-5dec-423d-8155-f27c81cb33bc service nova] Acquiring lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-16972bca-5c29-48f6-afe3-d8489a4ed76b req-af55ae1d-5dec-423d-8155-f27c81cb33bc service nova] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-16972bca-5c29-48f6-afe3-d8489a4ed76b req-af55ae1d-5dec-423d-8155-f27c81cb33bc service nova] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:40 user nova-compute[73104]: DEBUG nova.compute.manager [req-16972bca-5c29-48f6-afe3-d8489a4ed76b req-af55ae1d-5dec-423d-8155-f27c81cb33bc service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] No waiting events found dispatching network-vif-plugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:43:40 user nova-compute[73104]: WARNING nova.compute.manager [req-16972bca-5c29-48f6-afe3-d8489a4ed76b req-af55ae1d-5dec-423d-8155-f27c81cb33bc service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Received unexpected event network-vif-plugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 for instance with vm_state active and task_state deleting.
Aug 26 08:43:40 user nova-compute[73104]: DEBUG nova.compute.manager [req-16972bca-5c29-48f6-afe3-d8489a4ed76b req-af55ae1d-5dec-423d-8155-f27c81cb33bc service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Received event network-vif-plugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:43:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-16972bca-5c29-48f6-afe3-d8489a4ed76b req-af55ae1d-5dec-423d-8155-f27c81cb33bc service nova] Acquiring lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-16972bca-5c29-48f6-afe3-d8489a4ed76b req-af55ae1d-5dec-423d-8155-f27c81cb33bc service nova] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-16972bca-5c29-48f6-afe3-d8489a4ed76b req-af55ae1d-5dec-423d-8155-f27c81cb33bc service nova] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:40 user nova-compute[73104]: DEBUG nova.compute.manager [req-16972bca-5c29-48f6-afe3-d8489a4ed76b req-af55ae1d-5dec-423d-8155-f27c81cb33bc service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] No waiting events found dispatching network-vif-plugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:43:40 user nova-compute[73104]: WARNING nova.compute.manager [req-16972bca-5c29-48f6-afe3-d8489a4ed76b req-af55ae1d-5dec-423d-8155-f27c81cb33bc service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Received unexpected event network-vif-plugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 for instance with vm_state active and task_state deleting.
Aug 26 08:43:40 user nova-compute[73104]: DEBUG nova.compute.manager [req-16972bca-5c29-48f6-afe3-d8489a4ed76b req-af55ae1d-5dec-423d-8155-f27c81cb33bc service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Received event network-vif-unplugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:43:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-16972bca-5c29-48f6-afe3-d8489a4ed76b req-af55ae1d-5dec-423d-8155-f27c81cb33bc service nova] Acquiring lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-16972bca-5c29-48f6-afe3-d8489a4ed76b req-af55ae1d-5dec-423d-8155-f27c81cb33bc service nova] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-16972bca-5c29-48f6-afe3-d8489a4ed76b req-af55ae1d-5dec-423d-8155-f27c81cb33bc service nova] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:40 user nova-compute[73104]: DEBUG nova.compute.manager [req-16972bca-5c29-48f6-afe3-d8489a4ed76b req-af55ae1d-5dec-423d-8155-f27c81cb33bc service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] No waiting events found dispatching network-vif-unplugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:43:40 user nova-compute[73104]: DEBUG nova.compute.manager [req-16972bca-5c29-48f6-afe3-d8489a4ed76b req-af55ae1d-5dec-423d-8155-f27c81cb33bc service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Received event network-vif-unplugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:43:40 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:43:40 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Took 1.80 seconds to deallocate network for instance.
Aug 26 08:43:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-18ffe03d-8ba4-4224-a559-cbb6af0e2ac1 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-18ffe03d-8ba4-4224-a559-cbb6af0e2ac1 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:41 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-18ffe03d-8ba4-4224-a559-cbb6af0e2ac1 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:43:41 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-18ffe03d-8ba4-4224-a559-cbb6af0e2ac1 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:43:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-18ffe03d-8ba4-4224-a559-cbb6af0e2ac1 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:41 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-18ffe03d-8ba4-4224-a559-cbb6af0e2ac1 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Deleted allocations for instance 94de2062-7017-44fe-8df0-0a3cd63d5498
Aug 26 08:43:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-18ffe03d-8ba4-4224-a559-cbb6af0e2ac1 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.465s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:42 user nova-compute[73104]: DEBUG nova.compute.manager [req-70af8177-b79f-454b-baaf-a97141b71266 req-c28864ea-586a-4f50-b7b3-45077d3e8214 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Received event network-vif-plugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:43:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-70af8177-b79f-454b-baaf-a97141b71266 req-c28864ea-586a-4f50-b7b3-45077d3e8214 service nova] Acquiring lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-70af8177-b79f-454b-baaf-a97141b71266 req-c28864ea-586a-4f50-b7b3-45077d3e8214 service nova] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-70af8177-b79f-454b-baaf-a97141b71266 req-c28864ea-586a-4f50-b7b3-45077d3e8214 service nova] Lock "94de2062-7017-44fe-8df0-0a3cd63d5498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:42 user nova-compute[73104]: DEBUG nova.compute.manager [req-70af8177-b79f-454b-baaf-a97141b71266 req-c28864ea-586a-4f50-b7b3-45077d3e8214 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] No waiting events found dispatching network-vif-plugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:43:42 user nova-compute[73104]: WARNING nova.compute.manager [req-70af8177-b79f-454b-baaf-a97141b71266 req-c28864ea-586a-4f50-b7b3-45077d3e8214 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Received unexpected event network-vif-plugged-4a3e387d-f638-43fc-bdef-4c0b608d29d4 for instance with vm_state deleted and task_state None.
Aug 26 08:43:42 user nova-compute[73104]: DEBUG nova.compute.manager [req-70af8177-b79f-454b-baaf-a97141b71266 req-c28864ea-586a-4f50-b7b3-45077d3e8214 service nova] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Received event network-vif-deleted-4a3e387d-f638-43fc-bdef-4c0b608d29d4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:43:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:46 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:43:47 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:43:47 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 08:43:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-385c6d93-907d-42d7-9b43-479e6caf66f9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:43:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-385c6d93-907d-42d7-9b43-479e6caf66f9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:43:47 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 08:43:49 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Updating instance_info_cache with network_info: [{"id": "d4692900-c165-487d-9847-383fcf1d2270", "address": "fa:16:3e:b9:37:34", "network": {"id": "9aad8a32-d93f-45ef-be53-f84cebd194b1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2017537149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc8c266ecf8444919a4a2ed73b784b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4692900-c1", "ovs_interfaceid": "d4692900-c165-487d-9847-383fcf1d2270", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:43:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-385c6d93-907d-42d7-9b43-479e6caf66f9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:43:49 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 08:43:49 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:43:49 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:43:49 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 08:43:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:49 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:43:49 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:43:49 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:43:50 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:43:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:50 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 08:43:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:50 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:43:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3963cffc-9397-45ca-bf80-198b219beb4f/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3963cffc-9397-45ca-bf80-198b219beb4f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3963cffc-9397-45ca-bf80-198b219beb4f/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3963cffc-9397-45ca-bf80-198b219beb4f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:51 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:43:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fbf9f0-c459-4d24-b0ff-b25281378f52/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fbf9f0-c459-4d24-b0ff-b25281378f52/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fbf9f0-c459-4d24-b0ff-b25281378f52/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fbf9f0-c459-4d24-b0ff-b25281378f52/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG nova.compute.manager [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oyciCmDx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3963cffc-9397-45ca-bf80-198b219beb4f', 'attached_at': '', 'detached_at': '', 'volume_id': '497551ed-3d44-4806-b062-80ac79fa9d65', 'serial': '497551ed-3d44-4806-b062-80ac79fa9d65'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQwKznaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '3963cffc-9397-45ca-bf80-198b219beb4f', 'attached_at': '', 'detached_at': '', 'volume_id': '6642f875-ee85-40d1-b6ac-1829f915ea1b', 'serial'} {{(pid=73104) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oyciCmDx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:43:52 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:43:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:43:52 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:43:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:43:52 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1cfb66-85c9-4d25-80c0-c5f50a575f4b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:43:52 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73c5702-48b0-4b73-b2c2-d114eb7a04a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65] added
Aug 26 08:43:52 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd53966-e08d-4b97-b246-512228a744dc]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[334f5271-5b38-43c8-9842-bcd323d5572d]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oyciCmDx {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oyciCmDx" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[333ae391-dd15-48a4-8e1a-40d3d36e9bb1]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oyciCmDx'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[328bd12e-a805-4f61-8a11-62299cde099c]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b13427-af1f-4be8-9906-028df79bd178]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:43:52 user nova-compute[73104]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:43:52 user nova-compute[73104]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b (non-flash)
Aug 26 08:43:52 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:43:52 user nova-compute[73104]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:43:52 user nova-compute[73104]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b (non-flash)
Aug 26 08:43:52 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab8db20-60b0-48cd-9df7-87b34116458a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65, portal: 172.16.0.220,3260]
Aug 26 08:43:52 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65, portal: 172.16.0.220,3260] successful.
Aug 26 08:43:52 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a309f9-9dab-42f6-bf25-ac67ea70c7bb]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d380795d-2fd1-4043-839c-7b8e70294368]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:43:52 user nova-compute[73104]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:43:52 user nova-compute[73104]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b (non-flash)
Aug 26 08:43:52 user nova-compute[73104]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 (non-flash)
Aug 26 08:43:52 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:43:52 user nova-compute[73104]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:43:52 user nova-compute[73104]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b (non-flash)
Aug 26 08:43:52 user nova-compute[73104]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 (non-flash)
Aug 26 08:43:52 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cca6615-5707-4f31-bc2d-955eadaede2e]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: None {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e36b3e72-eb6b-4634-be82-af7ceeacb2f8 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Acquiring lock "93244bcd-34be-46f3-85e6-87bb5e69888d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e36b3e72-eb6b-4634-be82-af7ceeacb2f8 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "93244bcd-34be-46f3-85e6-87bb5e69888d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e36b3e72-eb6b-4634-be82-af7ceeacb2f8 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Acquiring lock "93244bcd-34be-46f3-85e6-87bb5e69888d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e36b3e72-eb6b-4634-be82-af7ceeacb2f8 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "93244bcd-34be-46f3-85e6-87bb5e69888d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e36b3e72-eb6b-4634-be82-af7ceeacb2f8 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "93244bcd-34be-46f3-85e6-87bb5e69888d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:52 user nova-compute[73104]: INFO nova.compute.manager [None req-e36b3e72-eb6b-4634-be82-af7ceeacb2f8 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Terminating instance
Aug 26 08:43:52 user nova-compute[73104]: DEBUG nova.compute.manager [None req-e36b3e72-eb6b-4634-be82-af7ceeacb2f8 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 08:43:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:53 user nova-compute[73104]: DEBUG nova.compute.manager [req-c2640532-7971-4515-90cb-0e698ee07603 req-34f965d5-08b4-441c-bc75-0be8be85d805 service nova] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Received event network-vif-unplugged-af8b0ae5-581c-4096-98de-4442fe942572 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:43:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c2640532-7971-4515-90cb-0e698ee07603 req-34f965d5-08b4-441c-bc75-0be8be85d805 service nova] Acquiring lock "93244bcd-34be-46f3-85e6-87bb5e69888d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c2640532-7971-4515-90cb-0e698ee07603 req-34f965d5-08b4-441c-bc75-0be8be85d805 service nova] Lock "93244bcd-34be-46f3-85e6-87bb5e69888d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c2640532-7971-4515-90cb-0e698ee07603 req-34f965d5-08b4-441c-bc75-0be8be85d805 service nova] Lock "93244bcd-34be-46f3-85e6-87bb5e69888d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:53 user nova-compute[73104]: DEBUG nova.compute.manager [req-c2640532-7971-4515-90cb-0e698ee07603 req-34f965d5-08b4-441c-bc75-0be8be85d805 service nova] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] No waiting events found dispatching network-vif-unplugged-af8b0ae5-581c-4096-98de-4442fe942572 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:43:53 user nova-compute[73104]: DEBUG nova.compute.manager [req-c2640532-7971-4515-90cb-0e698ee07603 req-34f965d5-08b4-441c-bc75-0be8be85d805 service nova] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Received event network-vif-unplugged-af8b0ae5-581c-4096-98de-4442fe942572 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:43:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oyciCmDx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.969s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] <== connect_volume: return (1970ms) {'type': 'block', 'scsi_wwn': '26332346236623331', 'path': '/dev/sde'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332346236623331', 'path': '/dev/sde'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693039418.7945633, 94de2062-7017-44fe-8df0-0a3cd63d5498 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:43:54 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] VM Stopped (Lifecycle Event)
Aug 26 08:43:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:43:54 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:43:54 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:43:54 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=7273MB free_disk=24.536819458007812GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:54 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Instance destroyed successfully.
Aug 26 08:43:54 user nova-compute[73104]: DEBUG nova.objects.instance [None req-e36b3e72-eb6b-4634-be82-af7ceeacb2f8 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lazy-loading 'resources' on Instance uuid 93244bcd-34be-46f3-85e6-87bb5e69888d {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG nova.compute.manager [None req-0a09b005-710b-4255-a5fe-98366b62747e None None] [instance: 94de2062-7017-44fe-8df0-0a3cd63d5498] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG nova.objects.instance [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Lazy-loading 'flavor' on Instance uuid 3963cffc-9397-45ca-bf80-198b219beb4f {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-e36b3e72-eb6b-4634-be82-af7ceeacb2f8 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:37:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1547126579',display_name='tempest-VolumesAdminNegativeTest-server-1547126579',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1547126579',id=7,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmUvowBy17O/E9fJcG7qnd87vsTeKHup7cw1MYZ+PRv7BvCdLVqhgBK9Acm341Ypc0U7HBA/GwF1qLAZDs86VZN2zZkIwBCTvQqjNmNiOpTkOROt8e4uwbmnUJHLISQRg==',key_name='tempest-keypair-1074283344',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:37:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef6f6e226b23400481b2ad063356bc06',ramdisk_id='',reservation_id='r-xqm417tn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-933148822',owner_user_name='tempest-VolumesAdminNegativeTest-933148822-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:37:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5653cc2733b44477957b797143a854f6',uuid=93244bcd-34be-46f3-85e6-87bb5e69888d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af8b0ae5-581c-4096-98de-4442fe942572", "address": "fa:16:3e:d5:84:96", "network": {"id": "58299b40-db54-4ba9-b4aa-8a40f0c2c2d4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-295087397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef6f6e226b23400481b2ad063356bc06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8b0ae5-58", "ovs_interfaceid": "af8b0ae5-581c-4096-98de-4442fe942572", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-e36b3e72-eb6b-4634-be82-af7ceeacb2f8 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Converting VIF {"id": "af8b0ae5-581c-4096-98de-4442fe942572", "address": "fa:16:3e:d5:84:96", "network": {"id": "58299b40-db54-4ba9-b4aa-8a40f0c2c2d4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-295087397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef6f6e226b23400481b2ad063356bc06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf8b0ae5-58", "ovs_interfaceid": "af8b0ae5-581c-4096-98de-4442fe942572", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-e36b3e72-eb6b-4634-be82-af7ceeacb2f8 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:84:96,bridge_name='br-int',has_traffic_filtering=True,id=af8b0ae5-581c-4096-98de-4442fe942572,network=Network(58299b40-db54-4ba9-b4aa-8a40f0c2c2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8b0ae5-58') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG os_vif [None req-e36b3e72-eb6b-4634-be82-af7ceeacb2f8 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:84:96,bridge_name='br-int',has_traffic_filtering=True,id=af8b0ae5-581c-4096-98de-4442fe942572,network=Network(58299b40-db54-4ba9-b4aa-8a40f0c2c2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8b0ae5-58') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf8b0ae5-58, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:43:54 user nova-compute[73104]: INFO os_vif [None req-e36b3e72-eb6b-4634-be82-af7ceeacb2f8 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:84:96,bridge_name='br-int',has_traffic_filtering=True,id=af8b0ae5-581c-4096-98de-4442fe942572,network=Network(58299b40-db54-4ba9-b4aa-8a40f0c2c2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf8b0ae5-58')
Aug 26 08:43:54 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-e36b3e72-eb6b-4634-be82-af7ceeacb2f8 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Deleting instance files /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d_del
Aug 26 08:43:54 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-e36b3e72-eb6b-4634-be82-af7ceeacb2f8 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Deletion of /opt/stack/data/nova/instances/93244bcd-34be-46f3-85e6-87bb5e69888d_del complete
Aug 26 08:43:54 user nova-compute[73104]: INFO nova.compute.manager [None req-e36b3e72-eb6b-4634-be82-af7ceeacb2f8 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Took 1.42 seconds to destroy the instance on the hypervisor.
Aug 26 08:43:54 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-e36b3e72-eb6b-4634-be82-af7ceeacb2f8 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance dcec7631-b94f-4dbf-b85d-e8ad9c6396b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 93244bcd-34be-46f3-85e6-87bb5e69888d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 7095c1e6-3825-47d2-8b63-5755fab42b49 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 385c6d93-907d-42d7-9b43-479e6caf66f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 3963cffc-9397-45ca-bf80-198b219beb4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance b5e1f82c-5675-4c37-8ba2-44e6a341a576 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 24fbf9f0-c459-4d24-b0ff-b25281378f52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 3cf85d2f-de0d-4e9b-a534-98c799ae8db9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73104) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 08:43:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.565s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:55 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] COPY block job progress, current cursor: 92274688 final cursor: 1073741824 {{(pid=73104) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 08:43:55 user nova-compute[73104]: DEBUG nova.compute.manager [req-5db758f0-a306-45b7-a5f4-6bc7f550ed40 req-e1db90bb-aaab-429c-9862-a3031cd63e59 service nova] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Received event network-vif-plugged-af8b0ae5-581c-4096-98de-4442fe942572 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:43:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5db758f0-a306-45b7-a5f4-6bc7f550ed40 req-e1db90bb-aaab-429c-9862-a3031cd63e59 service nova] Acquiring lock "93244bcd-34be-46f3-85e6-87bb5e69888d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5db758f0-a306-45b7-a5f4-6bc7f550ed40 req-e1db90bb-aaab-429c-9862-a3031cd63e59 service nova] Lock "93244bcd-34be-46f3-85e6-87bb5e69888d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5db758f0-a306-45b7-a5f4-6bc7f550ed40 req-e1db90bb-aaab-429c-9862-a3031cd63e59 service nova] Lock "93244bcd-34be-46f3-85e6-87bb5e69888d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:55 user nova-compute[73104]: DEBUG nova.compute.manager [req-5db758f0-a306-45b7-a5f4-6bc7f550ed40 req-e1db90bb-aaab-429c-9862-a3031cd63e59 service nova] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] No waiting events found dispatching network-vif-plugged-af8b0ae5-581c-4096-98de-4442fe942572 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:43:55 user nova-compute[73104]: WARNING nova.compute.manager [req-5db758f0-a306-45b7-a5f4-6bc7f550ed40 req-e1db90bb-aaab-429c-9862-a3031cd63e59 service nova] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Received unexpected event network-vif-plugged-af8b0ae5-581c-4096-98de-4442fe942572 for instance with vm_state active and task_state deleting.
Aug 26 08:43:55 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:43:55 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Took 1.36 seconds to deallocate network for instance.
Aug 26 08:43:55 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:43:55 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] COPY block job progress, current cursor: 265289728 final cursor: 1073741824 {{(pid=73104) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 08:43:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e36b3e72-eb6b-4634-be82-af7ceeacb2f8 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:43:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e36b3e72-eb6b-4634-be82-af7ceeacb2f8 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:43:56 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-e36b3e72-eb6b-4634-be82-af7ceeacb2f8 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:43:56 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-e36b3e72-eb6b-4634-be82-af7ceeacb2f8 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:43:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e36b3e72-eb6b-4634-be82-af7ceeacb2f8 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] COPY block job progress, current cursor: 384827392 final cursor: 1073741824 {{(pid=73104) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 08:43:56 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-e36b3e72-eb6b-4634-be82-af7ceeacb2f8 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Deleted allocations for instance 93244bcd-34be-46f3-85e6-87bb5e69888d
Aug 26 08:43:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e36b3e72-eb6b-4634-be82-af7ceeacb2f8 tempest-VolumesAdminNegativeTest-933148822 tempest-VolumesAdminNegativeTest-933148822-project-member] Lock "93244bcd-34be-46f3-85e6-87bb5e69888d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.505s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:43:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] COPY block job progress, current cursor: 529530880 final cursor: 1073741824 {{(pid=73104) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 08:43:57 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] COPY block job progress, current cursor: 684720128 final cursor: 1073741824 {{(pid=73104) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 08:43:57 user nova-compute[73104]: DEBUG nova.compute.manager [req-00c1839a-20e2-416b-aad0-c96fb45ea89c req-074f7d0a-2ad2-4ae2-8fb3-384acf35b855 service nova] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Received event network-vif-deleted-af8b0ae5-581c-4096-98de-4442fe942572 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:43:57 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] COPY block job progress, current cursor: 867172352 final cursor: 1073741824 {{(pid=73104) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 08:43:58 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] COPY block job progress, current cursor: 1016070144 final cursor: 1073741824 {{(pid=73104) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 08:43:58 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73104) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 08:43:58 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:43:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQwKznaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:43:58 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:43:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:43:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:43:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:43:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:58 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb90c2a-f6db-421c-bf9e-f45b6131df11]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:58 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73af692-8e72-45e5-9351-eed47edb7527]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:43:58 user nova-compute[73104]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:43:58 user nova-compute[73104]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b (non-flash)
Aug 26 08:43:58 user nova-compute[73104]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 (non-flash)
Aug 26 08:43:58 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:43:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:43:58 user nova-compute[73104]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:43:58 user nova-compute[73104]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b (non-flash)
Aug 26 08:43:58 user nova-compute[73104]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 (non-flash)
Aug 26 08:43:58 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b4796050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b'): ({'sdd'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Removing single pathed devices sdd {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[209eed32-ad7b-4f16-ab28-b884bf322a98]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b5f7db-91dc-430e-ae13-5e1e2da223cc]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Flushing IO for device /dev/sdd {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4eeb13-8aec-413a-ad2f-6a846650e1b5]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fadc401-5a00-4b95-90cc-4d0d41687dc4]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] SCSI volumes sdd have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceba1b83-ed5b-421a-b39f-d226f253317e]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d01bba4-c9b3-472f-90fe-7861ec50354a]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b, portal: 172.16.0.220,3260]
Aug 26 08:43:59 user nova-compute[73104]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b, portal: 172.16.0.220,3260] successful.
Aug 26 08:43:59 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66bcd75-2851-4b39-8d50-19b2001bbbed]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] <== disconnect_volume: return (328ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG nova.compute.manager [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oyciCmDx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '3963cffc-9397-45ca-bf80-198b219beb4f', 'attached_at': '', 'detached_at': '', 'volume_id': '497551ed-3d44-4806-b062-80ac79fa9d65', 'serial'} {{(pid=73104) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG nova.compute.manager [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] swap_volume: removing Cinder connection for volume 6642f875-ee85-40d1-b6ac-1829f915ea1b {{(pid=73104) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG nova.compute.manager [req-1be85dd3-3a63-4c72-b3ce-507f73f781a6 req-84686d13-72b2-451a-9abc-c78094e258db service nova] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Received event network-changed-3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG nova.compute.manager [req-1be85dd3-3a63-4c72-b3ce-507f73f781a6 req-84686d13-72b2-451a-9abc-c78094e258db service nova] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Refreshing instance network info cache due to event network-changed-3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1be85dd3-3a63-4c72-b3ce-507f73f781a6 req-84686d13-72b2-451a-9abc-c78094e258db service nova] Acquiring lock "refresh_cache-b5e1f82c-5675-4c37-8ba2-44e6a341a576" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1be85dd3-3a63-4c72-b3ce-507f73f781a6 req-84686d13-72b2-451a-9abc-c78094e258db service nova] Acquired lock "refresh_cache-b5e1f82c-5675-4c37-8ba2-44e6a341a576" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:43:59 user nova-compute[73104]: DEBUG nova.network.neutron [req-1be85dd3-3a63-4c72-b3ce-507f73f781a6 req-84686d13-72b2-451a-9abc-c78094e258db service nova] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Refreshing network info cache for port 3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:44:00 user nova-compute[73104]: DEBUG nova.network.neutron [req-1be85dd3-3a63-4c72-b3ce-507f73f781a6 req-84686d13-72b2-451a-9abc-c78094e258db service nova] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Updated VIF entry in instance network info cache for port 3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:44:00 user nova-compute[73104]: DEBUG nova.network.neutron [req-1be85dd3-3a63-4c72-b3ce-507f73f781a6 req-84686d13-72b2-451a-9abc-c78094e258db service nova] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Updating instance_info_cache with network_info: [{"id": "3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96", "address": "fa:16:3e:c0:56:86", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3913bdf7-1f", "ovs_interfaceid": "3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:44:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1be85dd3-3a63-4c72-b3ce-507f73f781a6 req-84686d13-72b2-451a-9abc-c78094e258db service nova] Releasing lock "refresh_cache-b5e1f82c-5675-4c37-8ba2-44e6a341a576" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:44:00 user nova-compute[73104]: DEBUG nova.compute.manager [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] swap_volume: Updating volume 6642f875-ee85-40d1-b6ac-1829f915ea1b BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "oyciCmDx", "auth_password": "HB40eQrUVykzga", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "497551ed-3d44-4806-b062-80ac79fa9d65"}, "status": "reserved", "instance": "3963cffc-9397-45ca-bf80-198b219beb4f", "attached_at": "", "detached_at": "", "volume_id": "497551ed-3d44-4806-b062-80ac79fa9d65", "serial": "497551ed-3d44-4806-b062-80ac79fa9d65"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '497551ed-3d44-4806-b062-80ac79fa9d65', 'no_device': None, 'attachment_id': '90692672-d04e-41a6-87e6-134a53379d26'} {{(pid=73104) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 26 08:44:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fbb2df2c-8768-4b86-8c57-d5ef16793603 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Lock "3963cffc-9397-45ca-bf80-198b219beb4f" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 20.584s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:44:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Acquiring lock "3963cffc-9397-45ca-bf80-198b219beb4f" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:44:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Lock "3963cffc-9397-45ca-bf80-198b219beb4f" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:44:01 user nova-compute[73104]: DEBUG os_brick.utils [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:44:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:01 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7719ddc-19c7-491c-be03-dcd8946c8220]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:44:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:01 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5520f35c-758a-4d8a-99ff-1090f4d496dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:44:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:02 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9390749b-371b-48d8-b57d-e4ca169cda0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:44:02 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8a80ba-a0b3-4db0-b64f-bbf52cb15428]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:44:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:44:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:44:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:44:02 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:44:02 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f0348f-7112-4abe-97eb-59d468d3c0bc]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:44:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:44:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:44:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:44:02 user nova-compute[73104]: DEBUG os_brick.utils [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:44:02 user nova-compute[73104]: INFO nova.compute.manager [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Swapping volume 497551ed-3d44-4806-b062-80ac79fa9d65 for 6642f875-ee85-40d1-b6ac-1829f915ea1b
Aug 26 08:44:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:09 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693039433.8028975, 93244bcd-34be-46f3-85e6-87bb5e69888d => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:44:09 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] VM Stopped (Lifecycle Event)
Aug 26 08:44:09 user nova-compute[73104]: DEBUG nova.compute.manager [None req-6a7580c2-a5cb-4a17-a74f-87047d176efb None None] [instance: 93244bcd-34be-46f3-85e6-87bb5e69888d] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:44:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG nova.compute.manager [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQwKznaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3963cffc-9397-45ca-bf80-198b219beb4f', 'attached_at': '', 'detached_at': '', 'volume_id': '6642f875-ee85-40d1-b6ac-1829f915ea1b', 'serial': '6642f875-ee85-40d1-b6ac-1829f915ea1b'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oyciCmDx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '497551ed-3d44-4806-b062-80ac79fa9d65'}, 'status': 'reserved', 'instance': '3963cffc-9397-45ca-bf80-198b219beb4f', 'attached_at': '', 'detached_at': '', 'volume_id': '497551ed-3d44-4806-b062-80ac79fa9d65', 'serial'} {{(pid=73104) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQwKznaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:44:13 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:44:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:44:13 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:44:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:44:13 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:44:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38784f6-234b-401b-9ad2-3fe6e9105c3c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:44:13 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6952d02b-0245-40de-9962-84a297a6d251]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b] added
Aug 26 08:44:13 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b93faa-8eab-4816-8adf-efa1ca7eb1ee]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0289e94-304b-49c8-ac5d-f096efaaff3f]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SQwKznaC {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SQwKznaC" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2576dfaf-a126-4af2-ab3b-6f4a1aec844f]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SQwKznaC'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b16888-7e3f-4e53-9095-82b006a6db30]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d422fdfe-6ac9-49d8-8e42-b11c41c40710]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:44:13 user nova-compute[73104]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:44:13 user nova-compute[73104]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 (non-flash)
Aug 26 08:44:13 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:44:13 user nova-compute[73104]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:44:13 user nova-compute[73104]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 (non-flash)
Aug 26 08:44:13 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6411380-02fa-48b5-a191-d727d721e682]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b, portal: 172.16.0.220,3260]
Aug 26 08:44:13 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b, portal: 172.16.0.220,3260] successful.
Aug 26 08:44:13 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a869c0-d51b-49f5-9b08-8aaa22fb35e9]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8d629d-2973-42da-b04f-6096e6b7f211]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:44:13 user nova-compute[73104]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:44:13 user nova-compute[73104]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 (non-flash)
Aug 26 08:44:13 user nova-compute[73104]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b (non-flash)
Aug 26 08:44:13 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:44:13 user nova-compute[73104]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:44:13 user nova-compute[73104]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 (non-flash)
Aug 26 08:44:13 user nova-compute[73104]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b (non-flash)
Aug 26 08:44:13 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[100c36b9-31a7-4719-9290-57a3b9f60d77]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:44:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQwKznaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:44:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:44:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:44:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23734313435613162', 'path': '/dev/sdd'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:44:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734313435613162', 'path': '/dev/sdd'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:44:14 user nova-compute[73104]: DEBUG nova.objects.instance [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Lazy-loading 'flavor' on Instance uuid 3963cffc-9397-45ca-bf80-198b219beb4f {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:44:15 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73104) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 08:44:15 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] COPY block job progress, current cursor: 127926272 final cursor: 1073741824 {{(pid=73104) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 08:44:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] COPY block job progress, current cursor: 268435456 final cursor: 1073741824 {{(pid=73104) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 08:44:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] COPY block job progress, current cursor: 466616320 final cursor: 1073741824 {{(pid=73104) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 08:44:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] COPY block job progress, current cursor: 650117120 final cursor: 1073741824 {{(pid=73104) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 08:44:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] COPY block job progress, current cursor: 827326464 final cursor: 1073741824 {{(pid=73104) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] COPY block job progress, current cursor: 1007681536 final cursor: 1073741824 {{(pid=73104) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG nova.compute.manager [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:44:18 user nova-compute[73104]: INFO nova.compute.claims [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Claim successful on node user
Aug 26 08:44:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73104) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oyciCmDx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '497551ed-3d44-4806-b062-80ac79fa9d65'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:44:18 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:44:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e336f7b0-ff6f-4432-bf5d-4c0187d10f2f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69413a0-0e02-4bb8-b5d8-b520f69881ae]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:44:18 user nova-compute[73104]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:44:18 user nova-compute[73104]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 (non-flash)
Aug 26 08:44:18 user nova-compute[73104]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b (non-flash)
Aug 26 08:44:18 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:44:18 user nova-compute[73104]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:44:18 user nova-compute[73104]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 (non-flash)
Aug 26 08:44:18 user nova-compute[73104]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b (non-flash)
Aug 26 08:44:18 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0c468a3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65'): ({'sde'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Removing single pathed devices sde {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f813c8-d883-45c9-a817-746a3b355f4a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe381da-0f85-4069-aa19-0a11eac52ac9]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Flushing IO for device /dev/sde {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6459e643-9b38-4783-9fb7-9893fd44d273]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG nova.compute.manager [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[40da1993-7d0e-4c80-b473-b0cd7b42807b]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] SCSI volumes sde have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccba421-9d38-44d9-b31c-4420891d5dcf]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG nova.compute.manager [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG nova.network.neutron [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:44:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:18 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:44:19 user nova-compute[73104]: DEBUG nova.compute.manager [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a70cdaf-bae6-4324-b576-df44ee80f242]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65, portal: 172.16.0.220,3260]
Aug 26 08:44:19 user nova-compute[73104]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65, portal: 172.16.0.220,3260] successful.
Aug 26 08:44:19 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:497551ed-3d44-4806-b062-80ac79fa9d65 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3cafd8-ddc7-442a-8d70-8b9de3df279b]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] <== disconnect_volume: return (319ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG nova.policy [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '062587ed00ae457889f884346c99e11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad68e5623014e2fb3f10ba92d388291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG nova.compute.manager [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQwKznaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '3963cffc-9397-45ca-bf80-198b219beb4f', 'attached_at': '', 'detached_at': '', 'volume_id': '6642f875-ee85-40d1-b6ac-1829f915ea1b', 'serial'} {{(pid=73104) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG nova.compute.manager [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] swap_volume: removing Cinder connection for volume 497551ed-3d44-4806-b062-80ac79fa9d65 {{(pid=73104) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG nova.compute.manager [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:44:19 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Creating image(s)
Aug 26 08:44:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "/opt/stack/data/nova/instances/86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "/opt/stack/data/nova/instances/86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "/opt/stack/data/nova/instances/86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.179s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.179s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d/disk 1073741824" returned: 0 in 0.055s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.187s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Checking if we can resize image /opt/stack/data/nova/instances/86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG nova.network.neutron [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Successfully created port: 4d938630-3013-4a42-b02d-cb0dd75e436c {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Cannot resize image /opt/stack/data/nova/instances/86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Ensure instance console log exists: /opt/stack/data/nova/instances/86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:44:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:44:20 user nova-compute[73104]: DEBUG nova.network.neutron [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Successfully updated port: 4d938630-3013-4a42-b02d-cb0dd75e436c {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:44:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "refresh_cache-86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:44:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquired lock "refresh_cache-86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:44:20 user nova-compute[73104]: DEBUG nova.network.neutron [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:44:20 user nova-compute[73104]: DEBUG nova.compute.manager [req-1b9d78a5-76ef-4eff-8974-13ed21a8cfc5 req-32a9f6d8-a018-4eac-a7ce-9019491486b4 service nova] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Received event network-changed-4d938630-3013-4a42-b02d-cb0dd75e436c {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:44:20 user nova-compute[73104]: DEBUG nova.compute.manager [req-1b9d78a5-76ef-4eff-8974-13ed21a8cfc5 req-32a9f6d8-a018-4eac-a7ce-9019491486b4 service nova] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Refreshing instance network info cache due to event network-changed-4d938630-3013-4a42-b02d-cb0dd75e436c. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:44:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1b9d78a5-76ef-4eff-8974-13ed21a8cfc5 req-32a9f6d8-a018-4eac-a7ce-9019491486b4 service nova] Acquiring lock "refresh_cache-86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:44:20 user nova-compute[73104]: DEBUG nova.network.neutron [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG nova.network.neutron [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Updating instance_info_cache with network_info: [{"id": "4d938630-3013-4a42-b02d-cb0dd75e436c", "address": "fa:16:3e:85:52:72", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d938630-30", "ovs_interfaceid": "4d938630-3013-4a42-b02d-cb0dd75e436c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Releasing lock "refresh_cache-86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG nova.compute.manager [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Instance network_info: |[{"id": "4d938630-3013-4a42-b02d-cb0dd75e436c", "address": "fa:16:3e:85:52:72", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d938630-30", "ovs_interfaceid": "4d938630-3013-4a42-b02d-cb0dd75e436c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1b9d78a5-76ef-4eff-8974-13ed21a8cfc5 req-32a9f6d8-a018-4eac-a7ce-9019491486b4 service nova] Acquired lock "refresh_cache-86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG nova.network.neutron [req-1b9d78a5-76ef-4eff-8974-13ed21a8cfc5 req-32a9f6d8-a018-4eac-a7ce-9019491486b4 service nova] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Refreshing network info cache for port 4d938630-3013-4a42-b02d-cb0dd75e436c {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Start _get_guest_xml network_info=[{"id": "4d938630-3013-4a42-b02d-cb0dd75e436c", "address": "fa:16:3e:85:52:72", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d938630-30", "ovs_interfaceid": "4d938630-3013-4a42-b02d-cb0dd75e436c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:44:21 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:44:21 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:44:21 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:44:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1780275581',display_name='tempest-AttachVolumeNegativeTest-server-1780275581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1780275581',id=20,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgj4uvLx2A21c08F1Gnl9TAK5U6ns7CaL7smxkSfZmqaFNkDJnUeDaNWRuIkWKx0zvA/dfKabuyFLCIGAivIJrDPX1I/S3T9ksh5Ceu7mTvEb51E4WsFHwHvG0RPgiaow==',key_name='tempest-keypair-1724422424',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ad68e5623014e2fb3f10ba92d388291',ramdisk_id='',reservation_id='r-6yv35ugc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1286694855',owner_user_name='tempest-AttachVolumeNegativeTest-1286694855-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:44:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='062587ed00ae457889f884346c99e11b',uuid=86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d938630-3013-4a42-b02d-cb0dd75e436c", "address": "fa:16:3e:85:52:72", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d938630-30", "ovs_interfaceid": "4d938630-3013-4a42-b02d-cb0dd75e436c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Converting VIF {"id": "4d938630-3013-4a42-b02d-cb0dd75e436c", "address": "fa:16:3e:85:52:72", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d938630-30", "ovs_interfaceid": "4d938630-3013-4a42-b02d-cb0dd75e436c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:52:72,bridge_name='br-int',has_traffic_filtering=True,id=4d938630-3013-4a42-b02d-cb0dd75e436c,network=Network(ea6c6ce0-85a4-40db-96e2-ca078887ab66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d938630-30') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG nova.objects.instance [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lazy-loading 'pci_devices' on Instance uuid 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:44:21 user nova-compute[73104]:   <uuid>86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d</uuid>
Aug 26 08:44:21 user nova-compute[73104]:   <name>instance-00000014</name>
Aug 26 08:44:21 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:44:21 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:44:21 user nova-compute[73104]:   <metadata>
Aug 26 08:44:21 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:44:21 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:44:21 user nova-compute[73104]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1780275581</nova:name>
Aug 26 08:44:21 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:44:21</nova:creationTime>
Aug 26 08:44:21 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:44:21 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:44:21 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:44:21 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:44:21 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:44:21 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:44:21 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:44:21 user nova-compute[73104]:       <nova:owner>
Aug 26 08:44:21 user nova-compute[73104]:         <nova:user uuid="062587ed00ae457889f884346c99e11b">tempest-AttachVolumeNegativeTest-1286694855-project-member</nova:user>
Aug 26 08:44:21 user nova-compute[73104]:         <nova:project uuid="4ad68e5623014e2fb3f10ba92d388291">tempest-AttachVolumeNegativeTest-1286694855</nova:project>
Aug 26 08:44:21 user nova-compute[73104]:       </nova:owner>
Aug 26 08:44:21 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:44:21 user nova-compute[73104]:       <nova:ports>
Aug 26 08:44:21 user nova-compute[73104]:         <nova:port uuid="4d938630-3013-4a42-b02d-cb0dd75e436c">
Aug 26 08:44:21 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 08:44:21 user nova-compute[73104]:         </nova:port>
Aug 26 08:44:21 user nova-compute[73104]:       </nova:ports>
Aug 26 08:44:21 user nova-compute[73104]:     </nova:instance>
Aug 26 08:44:21 user nova-compute[73104]:   </metadata>
Aug 26 08:44:21 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:44:21 user nova-compute[73104]:     <system>
Aug 26 08:44:21 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:44:21 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:44:21 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:44:21 user nova-compute[73104]:       <entry name="serial">86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d</entry>
Aug 26 08:44:21 user nova-compute[73104]:       <entry name="uuid">86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d</entry>
Aug 26 08:44:21 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:44:21 user nova-compute[73104]:     </system>
Aug 26 08:44:21 user nova-compute[73104]:   </sysinfo>
Aug 26 08:44:21 user nova-compute[73104]:   <os>
Aug 26 08:44:21 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:44:21 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:44:21 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:44:21 user nova-compute[73104]:   </os>
Aug 26 08:44:21 user nova-compute[73104]:   <features>
Aug 26 08:44:21 user nova-compute[73104]:     <acpi/>
Aug 26 08:44:21 user nova-compute[73104]:     <apic/>
Aug 26 08:44:21 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:44:21 user nova-compute[73104]:   </features>
Aug 26 08:44:21 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:44:21 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:44:21 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:44:21 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:44:21 user nova-compute[73104]:   </clock>
Aug 26 08:44:21 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:44:21 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:44:21 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:44:21 user nova-compute[73104]:   </cpu>
Aug 26 08:44:21 user nova-compute[73104]:   <devices>
Aug 26 08:44:21 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:44:21 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:44:21 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d/disk"/>
Aug 26 08:44:21 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:44:21 user nova-compute[73104]:     </disk>
Aug 26 08:44:21 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:44:21 user nova-compute[73104]:       <mac address="fa:16:3e:85:52:72"/>
Aug 26 08:44:21 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:44:21 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:44:21 user nova-compute[73104]:       <target dev="tap4d938630-30"/>
Aug 26 08:44:21 user nova-compute[73104]:     </interface>
Aug 26 08:44:21 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:44:21 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d/console.log" append="off"/>
Aug 26 08:44:21 user nova-compute[73104]:     </serial>
Aug 26 08:44:21 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:44:21 user nova-compute[73104]:     <video>
Aug 26 08:44:21 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:44:21 user nova-compute[73104]:     </video>
Aug 26 08:44:21 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:44:21 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:44:21 user nova-compute[73104]:     </rng>
Aug 26 08:44:21 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:44:21 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:44:21 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:44:21 user nova-compute[73104]:     </memballoon>
Aug 26 08:44:21 user nova-compute[73104]:   </devices>
Aug 26 08:44:21 user nova-compute[73104]: </domain>
Aug 26 08:44:21 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:44:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1780275581',display_name='tempest-AttachVolumeNegativeTest-server-1780275581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1780275581',id=20,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgj4uvLx2A21c08F1Gnl9TAK5U6ns7CaL7smxkSfZmqaFNkDJnUeDaNWRuIkWKx0zvA/dfKabuyFLCIGAivIJrDPX1I/S3T9ksh5Ceu7mTvEb51E4WsFHwHvG0RPgiaow==',key_name='tempest-keypair-1724422424',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ad68e5623014e2fb3f10ba92d388291',ramdisk_id='',reservation_id='r-6yv35ugc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1286694855',owner_user_name='tempest-AttachVolumeNegativeTest-1286694855-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:44:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='062587ed00ae457889f884346c99e11b',uuid=86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d938630-3013-4a42-b02d-cb0dd75e436c", "address": "fa:16:3e:85:52:72", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d938630-30", "ovs_interfaceid": "4d938630-3013-4a42-b02d-cb0dd75e436c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Converting VIF {"id": "4d938630-3013-4a42-b02d-cb0dd75e436c", "address": "fa:16:3e:85:52:72", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d938630-30", "ovs_interfaceid": "4d938630-3013-4a42-b02d-cb0dd75e436c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:52:72,bridge_name='br-int',has_traffic_filtering=True,id=4d938630-3013-4a42-b02d-cb0dd75e436c,network=Network(ea6c6ce0-85a4-40db-96e2-ca078887ab66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d938630-30') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG os_vif [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:52:72,bridge_name='br-int',has_traffic_filtering=True,id=4d938630-3013-4a42-b02d-cb0dd75e436c,network=Network(ea6c6ce0-85a4-40db-96e2-ca078887ab66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d938630-30') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d938630-30, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4d938630-30, col_values=(('external_ids', {'iface-id': '4d938630-3013-4a42-b02d-cb0dd75e436c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:52:72', 'vm-uuid': '86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:21 user nova-compute[73104]: INFO os_vif [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:52:72,bridge_name='br-int',has_traffic_filtering=True,id=4d938630-3013-4a42-b02d-cb0dd75e436c,network=Network(ea6c6ce0-85a4-40db-96e2-ca078887ab66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d938630-30')
Aug 26 08:44:21 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] No VIF found with MAC fa:16:3e:85:52:72, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG nova.network.neutron [req-1b9d78a5-76ef-4eff-8974-13ed21a8cfc5 req-32a9f6d8-a018-4eac-a7ce-9019491486b4 service nova] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Updated VIF entry in instance network info cache for port 4d938630-3013-4a42-b02d-cb0dd75e436c. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG nova.network.neutron [req-1b9d78a5-76ef-4eff-8974-13ed21a8cfc5 req-32a9f6d8-a018-4eac-a7ce-9019491486b4 service nova] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Updating instance_info_cache with network_info: [{"id": "4d938630-3013-4a42-b02d-cb0dd75e436c", "address": "fa:16:3e:85:52:72", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d938630-30", "ovs_interfaceid": "4d938630-3013-4a42-b02d-cb0dd75e436c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:44:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1b9d78a5-76ef-4eff-8974-13ed21a8cfc5 req-32a9f6d8-a018-4eac-a7ce-9019491486b4 service nova] Releasing lock "refresh_cache-86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:44:22 user nova-compute[73104]: DEBUG nova.compute.manager [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] swap_volume: Updating volume 497551ed-3d44-4806-b062-80ac79fa9d65 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "SQwKznaC", "auth_password": "LtAHCKqXjGzdnM", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "6642f875-ee85-40d1-b6ac-1829f915ea1b"}, "status": "reserved", "instance": "3963cffc-9397-45ca-bf80-198b219beb4f", "attached_at": "", "detached_at": "", "volume_id": "6642f875-ee85-40d1-b6ac-1829f915ea1b", "serial": "6642f875-ee85-40d1-b6ac-1829f915ea1b"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '6642f875-ee85-40d1-b6ac-1829f915ea1b', 'no_device': None, 'attachment_id': '986166fc-64a1-42a6-a040-5aaecf24701e'} {{(pid=73104) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 26 08:44:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8c7bfdc2-8f3d-4a34-b553-d26aa2694135 tempest-TestVolumeSwap-428829281 tempest-TestVolumeSwap-428829281-project-admin] Lock "3963cffc-9397-45ca-bf80-198b219beb4f" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 20.373s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:44:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:22 user nova-compute[73104]: DEBUG nova.compute.manager [req-b638402b-397c-44a9-9f8f-53cab44de7d7 req-f2b226f1-262e-4021-96c7-be6c641f7a8a service nova] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Received event network-vif-plugged-4d938630-3013-4a42-b02d-cb0dd75e436c {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:44:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b638402b-397c-44a9-9f8f-53cab44de7d7 req-f2b226f1-262e-4021-96c7-be6c641f7a8a service nova] Acquiring lock "86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:44:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b638402b-397c-44a9-9f8f-53cab44de7d7 req-f2b226f1-262e-4021-96c7-be6c641f7a8a service nova] Lock "86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:44:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b638402b-397c-44a9-9f8f-53cab44de7d7 req-f2b226f1-262e-4021-96c7-be6c641f7a8a service nova] Lock "86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:44:22 user nova-compute[73104]: DEBUG nova.compute.manager [req-b638402b-397c-44a9-9f8f-53cab44de7d7 req-f2b226f1-262e-4021-96c7-be6c641f7a8a service nova] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] No waiting events found dispatching network-vif-plugged-4d938630-3013-4a42-b02d-cb0dd75e436c {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:44:22 user nova-compute[73104]: WARNING nova.compute.manager [req-b638402b-397c-44a9-9f8f-53cab44de7d7 req-f2b226f1-262e-4021-96c7-be6c641f7a8a service nova] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Received unexpected event network-vif-plugged-4d938630-3013-4a42-b02d-cb0dd75e436c for instance with vm_state building and task_state spawning.
Aug 26 08:44:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-f923a67d-dac3-45c4-a2c6-f85e43fd3956 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Acquiring lock "3963cffc-9397-45ca-bf80-198b219beb4f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:44:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-f923a67d-dac3-45c4-a2c6-f85e43fd3956 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Lock "3963cffc-9397-45ca-bf80-198b219beb4f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:44:23 user nova-compute[73104]: INFO nova.compute.manager [None req-f923a67d-dac3-45c4-a2c6-f85e43fd3956 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Detaching volume 6642f875-ee85-40d1-b6ac-1829f915ea1b
Aug 26 08:44:23 user nova-compute[73104]: INFO nova.virt.block_device [None req-f923a67d-dac3-45c4-a2c6-f85e43fd3956 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Attempting to driver detach volume 6642f875-ee85-40d1-b6ac-1829f915ea1b from mountpoint /dev/vdb
Aug 26 08:44:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-f923a67d-dac3-45c4-a2c6-f85e43fd3956 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Attempting to detach device vdb from instance 3963cffc-9397-45ca-bf80-198b219beb4f from the persistent domain config. {{(pid=73104) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 08:44:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-f923a67d-dac3-45c4-a2c6-f85e43fd3956 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:44:23 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:44:23 user nova-compute[73104]:   <source dev="/dev/sdd"/>
Aug 26 08:44:23 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:44:23 user nova-compute[73104]:   <serial>6642f875-ee85-40d1-b6ac-1829f915ea1b</serial>
Aug 26 08:44:23 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 08:44:23 user nova-compute[73104]: </disk>
Aug 26 08:44:23 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:44:23 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-f923a67d-dac3-45c4-a2c6-f85e43fd3956 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Successfully detached device vdb from instance 3963cffc-9397-45ca-bf80-198b219beb4f from the persistent domain config.
Aug 26 08:44:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-f923a67d-dac3-45c4-a2c6-f85e43fd3956 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3963cffc-9397-45ca-bf80-198b219beb4f from the live domain config. {{(pid=73104) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 08:44:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-f923a67d-dac3-45c4-a2c6-f85e43fd3956 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:44:23 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:44:23 user nova-compute[73104]:   <source dev="/dev/sdd"/>
Aug 26 08:44:23 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:44:23 user nova-compute[73104]:   <serial>6642f875-ee85-40d1-b6ac-1829f915ea1b</serial>
Aug 26 08:44:23 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 08:44:23 user nova-compute[73104]: </disk>
Aug 26 08:44:23 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:44:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Received event <DeviceRemovedEvent: 1693039464.251691, 3963cffc-9397-45ca-bf80-198b219beb4f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73104) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-f923a67d-dac3-45c4-a2c6-f85e43fd3956 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3963cffc-9397-45ca-bf80-198b219beb4f {{(pid=73104) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 08:44:24 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-f923a67d-dac3-45c4-a2c6-f85e43fd3956 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Successfully detached device vdb from instance 3963cffc-9397-45ca-bf80-198b219beb4f from the live domain config.
Aug 26 08:44:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f923a67d-dac3-45c4-a2c6-f85e43fd3956 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-f923a67d-dac3-45c4-a2c6-f85e43fd3956 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQwKznaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': '6642f875-ee85-40d1-b6ac-1829f915ea1b'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:44:24 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-f923a67d-dac3-45c4-a2c6-f85e43fd3956 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:44:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-f923a67d-dac3-45c4-a2c6-f85e43fd3956 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-f923a67d-dac3-45c4-a2c6-f85e43fd3956 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-f923a67d-dac3-45c4-a2c6-f85e43fd3956 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1d5245-b080-4398-957e-69278c643350]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0022e715-4137-4f31-977c-45a9817c67fb]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-f923a67d-dac3-45c4-a2c6-f85e43fd3956 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:44:24 user nova-compute[73104]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:44:24 user nova-compute[73104]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b (non-flash)
Aug 26 08:44:24 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-f923a67d-dac3-45c4-a2c6-f85e43fd3956 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:44:24 user nova-compute[73104]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:44:24 user nova-compute[73104]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b (non-flash)
Aug 26 08:44:24 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-f923a67d-dac3-45c4-a2c6-f85e43fd3956 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0cc06b6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b'): ({'sdd'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-f923a67d-dac3-45c4-a2c6-f85e43fd3956 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Removing single pathed devices sdd {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dca1463-fba6-4e01-8e62-6d39e4e2408d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa2adc6-e5f3-4b56-b311-df239b5ebf1b]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-f923a67d-dac3-45c4-a2c6-f85e43fd3956 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Flushing IO for device /dev/sdd {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8f60ae-57ac-4a96-baef-dd5735cfef8a]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-f923a67d-dac3-45c4-a2c6-f85e43fd3956 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccbb9c7-3c3a-4807-abc4-e4617819d255]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-f923a67d-dac3-45c4-a2c6-f85e43fd3956 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-f923a67d-dac3-45c4-a2c6-f85e43fd3956 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] SCSI volumes sdd have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-f923a67d-dac3-45c4-a2c6-f85e43fd3956 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c48d981-eda4-4b30-9b8e-75b0bcfcbcb6]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-f923a67d-dac3-45c4-a2c6-f85e43fd3956 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d15a2f7-d4b7-484e-90a4-fcb045cab75f]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-f923a67d-dac3-45c4-a2c6-f85e43fd3956 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b, portal: 172.16.0.220,3260]
Aug 26 08:44:24 user nova-compute[73104]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b, portal: 172.16.0.220,3260] successful.
Aug 26 08:44:24 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6642f875-ee85-40d1-b6ac-1829f915ea1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3105703-6315-4d8b-982f-4f00794db7f3]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-f923a67d-dac3-45c4-a2c6-f85e43fd3956 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-f923a67d-dac3-45c4-a2c6-f85e43fd3956 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-f923a67d-dac3-45c4-a2c6-f85e43fd3956 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] <== disconnect_volume: return (278ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f923a67d-dac3-45c4-a2c6-f85e43fd3956 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039464.67894, 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:44:24 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] VM Resumed (Lifecycle Event)
Aug 26 08:44:24 user nova-compute[73104]: DEBUG nova.compute.manager [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:44:24 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Instance spawned successfully.
Aug 26 08:44:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:44:24 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:44:24 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039464.6806655, 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:44:24 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] VM Started (Lifecycle Event)
Aug 26 08:44:24 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:44:24 user nova-compute[73104]: INFO nova.compute.manager [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Took 5.65 seconds to spawn the instance on the hypervisor.
Aug 26 08:44:24 user nova-compute[73104]: DEBUG nova.compute.manager [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:44:24 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:44:24 user nova-compute[73104]: DEBUG nova.compute.manager [req-7efbfb84-29d2-4e72-85d2-3c80a671b5d1 req-9e5fbb2e-eecc-4431-b85a-8f9e88d25b37 service nova] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Received event network-vif-plugged-4d938630-3013-4a42-b02d-cb0dd75e436c {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-7efbfb84-29d2-4e72-85d2-3c80a671b5d1 req-9e5fbb2e-eecc-4431-b85a-8f9e88d25b37 service nova] Acquiring lock "86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-7efbfb84-29d2-4e72-85d2-3c80a671b5d1 req-9e5fbb2e-eecc-4431-b85a-8f9e88d25b37 service nova] Lock "86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-7efbfb84-29d2-4e72-85d2-3c80a671b5d1 req-9e5fbb2e-eecc-4431-b85a-8f9e88d25b37 service nova] Lock "86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:44:24 user nova-compute[73104]: DEBUG nova.compute.manager [req-7efbfb84-29d2-4e72-85d2-3c80a671b5d1 req-9e5fbb2e-eecc-4431-b85a-8f9e88d25b37 service nova] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] No waiting events found dispatching network-vif-plugged-4d938630-3013-4a42-b02d-cb0dd75e436c {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:44:24 user nova-compute[73104]: WARNING nova.compute.manager [req-7efbfb84-29d2-4e72-85d2-3c80a671b5d1 req-9e5fbb2e-eecc-4431-b85a-8f9e88d25b37 service nova] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Received unexpected event network-vif-plugged-4d938630-3013-4a42-b02d-cb0dd75e436c for instance with vm_state building and task_state spawning.
Aug 26 08:44:24 user nova-compute[73104]: INFO nova.compute.manager [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Took 6.45 seconds to build instance.
Aug 26 08:44:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a6049db4-3249-47af-9735-e6f4135ba0fa tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.536s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:44:26 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:31 user nova-compute[73104]: DEBUG nova.objects.instance [None req-f923a67d-dac3-45c4-a2c6-f85e43fd3956 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Lazy-loading 'flavor' on Instance uuid 3963cffc-9397-45ca-bf80-198b219beb4f {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:44:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-f923a67d-dac3-45c4-a2c6-f85e43fd3956 tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Lock "3963cffc-9397-45ca-bf80-198b219beb4f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.975s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:44:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:44:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:44:32 user nova-compute[73104]: DEBUG nova.compute.manager [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:44:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:44:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:44:32 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:44:32 user nova-compute[73104]: INFO nova.compute.claims [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Claim successful on node user
Aug 26 08:44:32 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:44:32 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:44:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:44:32 user nova-compute[73104]: DEBUG nova.compute.manager [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:44:32 user nova-compute[73104]: DEBUG nova.compute.manager [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:44:32 user nova-compute[73104]: DEBUG nova.network.neutron [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:44:32 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:44:32 user nova-compute[73104]: DEBUG nova.compute.manager [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:44:32 user nova-compute[73104]: DEBUG nova.policy [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db3ae37701df47a5b35026fe3857bc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770daa2e8b274a9b828e489c1573ced4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:44:32 user nova-compute[73104]: DEBUG nova.compute.manager [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:44:32 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:44:32 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Creating image(s)
Aug 26 08:44:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:44:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "/opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:44:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "/opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:44:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.191s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:44:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:44:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.185s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk 1073741824" returned: 0 in 0.059s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:44:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.182s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:33 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 08:44:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:33 user nova-compute[73104]: DEBUG nova.network.neutron [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Successfully created port: cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:44:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:33 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Cannot resize image /opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 08:44:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:44:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Ensure instance console log exists: /opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:44:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:44:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:44:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:44:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.network.neutron [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Successfully updated port: cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "refresh_cache-c3b4c644-f7f3-4304-b732-9f43cfeac2bb" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquired lock "refresh_cache-c3b4c644-f7f3-4304-b732-9f43cfeac2bb" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.network.neutron [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.compute.manager [req-d0a5a959-fe7d-40b0-920f-ef600e440167 req-ecfbb2d5-6b0c-4869-bf8a-62f65bdce548 service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Received event network-changed-cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.compute.manager [req-d0a5a959-fe7d-40b0-920f-ef600e440167 req-ecfbb2d5-6b0c-4869-bf8a-62f65bdce548 service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Refreshing instance network info cache due to event network-changed-cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d0a5a959-fe7d-40b0-920f-ef600e440167 req-ecfbb2d5-6b0c-4869-bf8a-62f65bdce548 service nova] Acquiring lock "refresh_cache-c3b4c644-f7f3-4304-b732-9f43cfeac2bb" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.network.neutron [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.network.neutron [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Updating instance_info_cache with network_info: [{"id": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "address": "fa:16:3e:4c:c9:02", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc2c1a60-58", "ovs_interfaceid": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Releasing lock "refresh_cache-c3b4c644-f7f3-4304-b732-9f43cfeac2bb" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.compute.manager [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Instance network_info: |[{"id": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "address": "fa:16:3e:4c:c9:02", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc2c1a60-58", "ovs_interfaceid": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d0a5a959-fe7d-40b0-920f-ef600e440167 req-ecfbb2d5-6b0c-4869-bf8a-62f65bdce548 service nova] Acquired lock "refresh_cache-c3b4c644-f7f3-4304-b732-9f43cfeac2bb" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.network.neutron [req-d0a5a959-fe7d-40b0-920f-ef600e440167 req-ecfbb2d5-6b0c-4869-bf8a-62f65bdce548 service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Refreshing network info cache for port cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Start _get_guest_xml network_info=[{"id": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "address": "fa:16:3e:4c:c9:02", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc2c1a60-58", "ovs_interfaceid": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:44:34 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:44:34 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:44:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-516733243',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-516733243',id=21,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/7E5NQLF0ppBSnaA5b97ACZ8aWxUr5RccERUW17fZtRLsaJRhM0S8cb6rnetzLx3STt8VOP73OPi/ha6ToIlMMPvS1XIkwRhm3xKLaXSSyF1T2XJJ2lMAfE/pUPfKxGA==',key_name='tempest-keypair-1461483520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='770daa2e8b274a9b828e489c1573ced4',ramdisk_id='',reservation_id='r-7sybpznn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2062858766',owner_user_name='tempest-AttachVolumeShelveTestJSON-2062858766-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:44:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db3ae37701df47a5b35026fe3857bc51',uuid=c3b4c644-f7f3-4304-b732-9f43cfeac2bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "address": "fa:16:3e:4c:c9:02", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc2c1a60-58", "ovs_interfaceid": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Converting VIF {"id": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "address": "fa:16:3e:4c:c9:02", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc2c1a60-58", "ovs_interfaceid": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c9:02,bridge_name='br-int',has_traffic_filtering=True,id=cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03,network=Network(38f7ec35-12eb-46fe-a425-51ee854d804d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc2c1a60-58') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.objects.instance [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lazy-loading 'pci_devices' on Instance uuid c3b4c644-f7f3-4304-b732-9f43cfeac2bb {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:44:34 user nova-compute[73104]:   <uuid>c3b4c644-f7f3-4304-b732-9f43cfeac2bb</uuid>
Aug 26 08:44:34 user nova-compute[73104]:   <name>instance-00000015</name>
Aug 26 08:44:34 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:44:34 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:44:34 user nova-compute[73104]:   <metadata>
Aug 26 08:44:34 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:44:34 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:44:34 user nova-compute[73104]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-516733243</nova:name>
Aug 26 08:44:34 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:44:34</nova:creationTime>
Aug 26 08:44:34 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:44:34 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:44:34 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:44:34 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:44:34 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:44:34 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:44:34 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:44:34 user nova-compute[73104]:       <nova:owner>
Aug 26 08:44:34 user nova-compute[73104]:         <nova:user uuid="db3ae37701df47a5b35026fe3857bc51">tempest-AttachVolumeShelveTestJSON-2062858766-project-member</nova:user>
Aug 26 08:44:34 user nova-compute[73104]:         <nova:project uuid="770daa2e8b274a9b828e489c1573ced4">tempest-AttachVolumeShelveTestJSON-2062858766</nova:project>
Aug 26 08:44:34 user nova-compute[73104]:       </nova:owner>
Aug 26 08:44:34 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:44:34 user nova-compute[73104]:       <nova:ports>
Aug 26 08:44:34 user nova-compute[73104]:         <nova:port uuid="cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03">
Aug 26 08:44:34 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 08:44:34 user nova-compute[73104]:         </nova:port>
Aug 26 08:44:34 user nova-compute[73104]:       </nova:ports>
Aug 26 08:44:34 user nova-compute[73104]:     </nova:instance>
Aug 26 08:44:34 user nova-compute[73104]:   </metadata>
Aug 26 08:44:34 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:44:34 user nova-compute[73104]:     <system>
Aug 26 08:44:34 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:44:34 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:44:34 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:44:34 user nova-compute[73104]:       <entry name="serial">c3b4c644-f7f3-4304-b732-9f43cfeac2bb</entry>
Aug 26 08:44:34 user nova-compute[73104]:       <entry name="uuid">c3b4c644-f7f3-4304-b732-9f43cfeac2bb</entry>
Aug 26 08:44:34 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:44:34 user nova-compute[73104]:     </system>
Aug 26 08:44:34 user nova-compute[73104]:   </sysinfo>
Aug 26 08:44:34 user nova-compute[73104]:   <os>
Aug 26 08:44:34 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:44:34 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:44:34 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:44:34 user nova-compute[73104]:   </os>
Aug 26 08:44:34 user nova-compute[73104]:   <features>
Aug 26 08:44:34 user nova-compute[73104]:     <acpi/>
Aug 26 08:44:34 user nova-compute[73104]:     <apic/>
Aug 26 08:44:34 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:44:34 user nova-compute[73104]:   </features>
Aug 26 08:44:34 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:44:34 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:44:34 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:44:34 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:44:34 user nova-compute[73104]:   </clock>
Aug 26 08:44:34 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:44:34 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:44:34 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:44:34 user nova-compute[73104]:   </cpu>
Aug 26 08:44:34 user nova-compute[73104]:   <devices>
Aug 26 08:44:34 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:44:34 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:44:34 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk"/>
Aug 26 08:44:34 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:44:34 user nova-compute[73104]:     </disk>
Aug 26 08:44:34 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:44:34 user nova-compute[73104]:       <mac address="fa:16:3e:4c:c9:02"/>
Aug 26 08:44:34 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:44:34 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:44:34 user nova-compute[73104]:       <target dev="tapcc2c1a60-58"/>
Aug 26 08:44:34 user nova-compute[73104]:     </interface>
Aug 26 08:44:34 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:44:34 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/console.log" append="off"/>
Aug 26 08:44:34 user nova-compute[73104]:     </serial>
Aug 26 08:44:34 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:44:34 user nova-compute[73104]:     <video>
Aug 26 08:44:34 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:44:34 user nova-compute[73104]:     </video>
Aug 26 08:44:34 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:44:34 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:44:34 user nova-compute[73104]:     </rng>
Aug 26 08:44:34 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:44:34 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:44:34 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:44:34 user nova-compute[73104]:     </memballoon>
Aug 26 08:44:34 user nova-compute[73104]:   </devices>
Aug 26 08:44:34 user nova-compute[73104]: </domain>
Aug 26 08:44:34 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:44:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-516733243',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-516733243',id=21,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/7E5NQLF0ppBSnaA5b97ACZ8aWxUr5RccERUW17fZtRLsaJRhM0S8cb6rnetzLx3STt8VOP73OPi/ha6ToIlMMPvS1XIkwRhm3xKLaXSSyF1T2XJJ2lMAfE/pUPfKxGA==',key_name='tempest-keypair-1461483520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='770daa2e8b274a9b828e489c1573ced4',ramdisk_id='',reservation_id='r-7sybpznn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2062858766',owner_user_name='tempest-AttachVolumeShelveTestJSON-2062858766-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:44:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db3ae37701df47a5b35026fe3857bc51',uuid=c3b4c644-f7f3-4304-b732-9f43cfeac2bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "address": "fa:16:3e:4c:c9:02", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc2c1a60-58", "ovs_interfaceid": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Converting VIF {"id": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "address": "fa:16:3e:4c:c9:02", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc2c1a60-58", "ovs_interfaceid": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c9:02,bridge_name='br-int',has_traffic_filtering=True,id=cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03,network=Network(38f7ec35-12eb-46fe-a425-51ee854d804d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc2c1a60-58') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG os_vif [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c9:02,bridge_name='br-int',has_traffic_filtering=True,id=cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03,network=Network(38f7ec35-12eb-46fe-a425-51ee854d804d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc2c1a60-58') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc2c1a60-58, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcc2c1a60-58, col_values=(('external_ids', {'iface-id': 'cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:c9:02', 'vm-uuid': 'c3b4c644-f7f3-4304-b732-9f43cfeac2bb'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:34 user nova-compute[73104]: INFO os_vif [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c9:02,bridge_name='br-int',has_traffic_filtering=True,id=cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03,network=Network(38f7ec35-12eb-46fe-a425-51ee854d804d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc2c1a60-58')
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:44:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] No VIF found with MAC fa:16:3e:4c:c9:02, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:44:35 user nova-compute[73104]: DEBUG nova.network.neutron [req-d0a5a959-fe7d-40b0-920f-ef600e440167 req-ecfbb2d5-6b0c-4869-bf8a-62f65bdce548 service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Updated VIF entry in instance network info cache for port cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:44:35 user nova-compute[73104]: DEBUG nova.network.neutron [req-d0a5a959-fe7d-40b0-920f-ef600e440167 req-ecfbb2d5-6b0c-4869-bf8a-62f65bdce548 service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Updating instance_info_cache with network_info: [{"id": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "address": "fa:16:3e:4c:c9:02", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc2c1a60-58", "ovs_interfaceid": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:44:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d0a5a959-fe7d-40b0-920f-ef600e440167 req-ecfbb2d5-6b0c-4869-bf8a-62f65bdce548 service nova] Releasing lock "refresh_cache-c3b4c644-f7f3-4304-b732-9f43cfeac2bb" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:44:36 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:36 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:36 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:36 user nova-compute[73104]: DEBUG nova.compute.manager [req-26b46b69-b1b9-4bc5-b0c2-3512b4099691 req-dc90fb22-e43b-491c-bc78-a15819b10c86 service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Received event network-vif-plugged-cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:44:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-26b46b69-b1b9-4bc5-b0c2-3512b4099691 req-dc90fb22-e43b-491c-bc78-a15819b10c86 service nova] Acquiring lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:44:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-26b46b69-b1b9-4bc5-b0c2-3512b4099691 req-dc90fb22-e43b-491c-bc78-a15819b10c86 service nova] Lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:44:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-26b46b69-b1b9-4bc5-b0c2-3512b4099691 req-dc90fb22-e43b-491c-bc78-a15819b10c86 service nova] Lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:44:36 user nova-compute[73104]: DEBUG nova.compute.manager [req-26b46b69-b1b9-4bc5-b0c2-3512b4099691 req-dc90fb22-e43b-491c-bc78-a15819b10c86 service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] No waiting events found dispatching network-vif-plugged-cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:44:36 user nova-compute[73104]: WARNING nova.compute.manager [req-26b46b69-b1b9-4bc5-b0c2-3512b4099691 req-dc90fb22-e43b-491c-bc78-a15819b10c86 service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Received unexpected event network-vif-plugged-cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 for instance with vm_state building and task_state spawning.
Aug 26 08:44:36 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:36 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:36 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:38 user nova-compute[73104]: DEBUG nova.compute.manager [req-7544982a-542e-4977-9a52-e3f8d1df0ad7 req-ddb2f017-4d50-46f2-a245-c56ae224c626 service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Received event network-vif-plugged-cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:44:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-7544982a-542e-4977-9a52-e3f8d1df0ad7 req-ddb2f017-4d50-46f2-a245-c56ae224c626 service nova] Acquiring lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:44:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-7544982a-542e-4977-9a52-e3f8d1df0ad7 req-ddb2f017-4d50-46f2-a245-c56ae224c626 service nova] Lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:44:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-7544982a-542e-4977-9a52-e3f8d1df0ad7 req-ddb2f017-4d50-46f2-a245-c56ae224c626 service nova] Lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:44:38 user nova-compute[73104]: DEBUG nova.compute.manager [req-7544982a-542e-4977-9a52-e3f8d1df0ad7 req-ddb2f017-4d50-46f2-a245-c56ae224c626 service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] No waiting events found dispatching network-vif-plugged-cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:44:38 user nova-compute[73104]: WARNING nova.compute.manager [req-7544982a-542e-4977-9a52-e3f8d1df0ad7 req-ddb2f017-4d50-46f2-a245-c56ae224c626 service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Received unexpected event network-vif-plugged-cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 for instance with vm_state building and task_state spawning.
Aug 26 08:44:38 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039478.7525184, c3b4c644-f7f3-4304-b732-9f43cfeac2bb => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:44:38 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] VM Resumed (Lifecycle Event)
Aug 26 08:44:38 user nova-compute[73104]: DEBUG nova.compute.manager [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:44:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:44:38 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Instance spawned successfully.
Aug 26 08:44:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:44:38 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:44:38 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:44:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:44:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:44:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:44:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:44:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:44:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:44:38 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:44:38 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039478.7538283, c3b4c644-f7f3-4304-b732-9f43cfeac2bb => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:44:38 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] VM Started (Lifecycle Event)
Aug 26 08:44:38 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:44:38 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:44:38 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:44:38 user nova-compute[73104]: INFO nova.compute.manager [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Took 6.08 seconds to spawn the instance on the hypervisor.
Aug 26 08:44:38 user nova-compute[73104]: DEBUG nova.compute.manager [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:44:38 user nova-compute[73104]: INFO nova.compute.manager [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Took 6.78 seconds to build instance.
Aug 26 08:44:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8435716d-0be3-4299-8480-fa38d1703739 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.875s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:44:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:48 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:44:48 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:44:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:49 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:44:49 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 08:44:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-7095c1e6-3825-47d2-8b63-5755fab42b49" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:44:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-7095c1e6-3825-47d2-8b63-5755fab42b49" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:44:49 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 08:44:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:49 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Updating instance_info_cache with network_info: [{"id": "85d806c2-eef6-493b-96cc-f04d9580652d", "address": "fa:16:3e:6e:38:0c", "network": {"id": "ef7a15d0-8aa7-47da-948d-c0f35a723f6f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-316051521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0807a5c94bea4801bd80bbcdef223a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d806c2-ee", "ovs_interfaceid": "85d806c2-eef6-493b-96cc-f04d9580652d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:44:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-7095c1e6-3825-47d2-8b63-5755fab42b49" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:44:49 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 08:44:49 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:44:49 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:44:49 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:44:49 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 08:44:51 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:51 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:44:51 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:44:52 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:44:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:44:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:44:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:44:52 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 08:44:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:44:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3963cffc-9397-45ca-bf80-198b219beb4f/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3963cffc-9397-45ca-bf80-198b219beb4f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3963cffc-9397-45ca-bf80-198b219beb4f/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3963cffc-9397-45ca-bf80-198b219beb4f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fbf9f0-c459-4d24-b0ff-b25281378f52/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fbf9f0-c459-4d24-b0ff-b25281378f52/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fbf9f0-c459-4d24-b0ff-b25281378f52/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fbf9f0-c459-4d24-b0ff-b25281378f52/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:54 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:44:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:56 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:44:56 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:44:56 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=7352MB free_disk=24.496353149414062GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 08:44:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:44:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:44:56 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance dcec7631-b94f-4dbf-b85d-e8ad9c6396b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:44:56 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 7095c1e6-3825-47d2-8b63-5755fab42b49 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:44:56 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 385c6d93-907d-42d7-9b43-479e6caf66f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:44:56 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 3963cffc-9397-45ca-bf80-198b219beb4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:44:56 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance b5e1f82c-5675-4c37-8ba2-44e6a341a576 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:44:56 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 24fbf9f0-c459-4d24-b0ff-b25281378f52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:44:56 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 3cf85d2f-de0d-4e9b-a534-98c799ae8db9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:44:56 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:44:56 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance c3b4c644-f7f3-4304-b732-9f43cfeac2bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:44:56 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 08:44:56 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 08:44:56 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:44:56 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:44:56 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 08:44:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.435s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:44:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:58 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:44:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:59 user nova-compute[73104]: DEBUG nova.compute.manager [None req-b42d4088-6896-4ba2-93e3-18edc056e215 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:44:59 user nova-compute[73104]: INFO nova.compute.manager [None req-b42d4088-6896-4ba2-93e3-18edc056e215 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] instance snapshotting
Aug 26 08:44:59 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-b42d4088-6896-4ba2-93e3-18edc056e215 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Beginning live snapshot process
Aug 26 08:44:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-b42d4088-6896-4ba2-93e3-18edc056e215 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json -f qcow2 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-b42d4088-6896-4ba2-93e3-18edc056e215 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json -f qcow2" returned: 0 in 0.220s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-b42d4088-6896-4ba2-93e3-18edc056e215 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json -f qcow2 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:44:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:44:59 user nova-compute[73104]: DEBUG nova.compute.manager [req-fd09ae9a-fee5-41e5-9c6d-1e97ff2e39de req-9a2e21ba-95f1-45d7-8370-19e4f02b52b1 service nova] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Received event network-changed-693629a9-d0ad-4257-8160-901fccb6f3fd {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:44:59 user nova-compute[73104]: DEBUG nova.compute.manager [req-fd09ae9a-fee5-41e5-9c6d-1e97ff2e39de req-9a2e21ba-95f1-45d7-8370-19e4f02b52b1 service nova] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Refreshing instance network info cache due to event network-changed-693629a9-d0ad-4257-8160-901fccb6f3fd. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:44:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-fd09ae9a-fee5-41e5-9c6d-1e97ff2e39de req-9a2e21ba-95f1-45d7-8370-19e4f02b52b1 service nova] Acquiring lock "refresh_cache-24fbf9f0-c459-4d24-b0ff-b25281378f52" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:44:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-fd09ae9a-fee5-41e5-9c6d-1e97ff2e39de req-9a2e21ba-95f1-45d7-8370-19e4f02b52b1 service nova] Acquired lock "refresh_cache-24fbf9f0-c459-4d24-b0ff-b25281378f52" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:44:59 user nova-compute[73104]: DEBUG nova.network.neutron [req-fd09ae9a-fee5-41e5-9c6d-1e97ff2e39de req-9a2e21ba-95f1-45d7-8370-19e4f02b52b1 service nova] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Refreshing network info cache for port 693629a9-d0ad-4257-8160-901fccb6f3fd {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:44:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-b42d4088-6896-4ba2-93e3-18edc056e215 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json -f qcow2" returned: 0 in 0.196s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:44:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-b42d4088-6896-4ba2-93e3-18edc056e215 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-b42d4088-6896-4ba2-93e3-18edc056e215 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.168s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-b42d4088-6896-4ba2-93e3-18edc056e215 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnxqt4wmr/cd8a0899fc214e899f9319d273ece609.delta 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-b42d4088-6896-4ba2-93e3-18edc056e215 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnxqt4wmr/cd8a0899fc214e899f9319d273ece609.delta 1073741824" returned: 0 in 0.056s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:00 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-b42d4088-6896-4ba2-93e3-18edc056e215 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 08:45:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Acquiring lock "24fbf9f0-c459-4d24-b0ff-b25281378f52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "24fbf9f0-c459-4d24-b0ff-b25281378f52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:00 user nova-compute[73104]: DEBUG nova.objects.instance [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lazy-loading 'flavor' on Instance uuid 24fbf9f0-c459-4d24-b0ff-b25281378f52 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:45:00 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Ignoring supplied device name: /dev/vdb
Aug 26 08:45:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "24fbf9f0-c459-4d24-b0ff-b25281378f52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Acquiring lock "24fbf9f0-c459-4d24-b0ff-b25281378f52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "24fbf9f0-c459-4d24-b0ff-b25281378f52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:00 user nova-compute[73104]: INFO nova.compute.manager [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Attaching volume d135f05c-eb85-4439-b321-b61fd9a0e0e2 to /dev/vdb
Aug 26 08:45:00 user nova-compute[73104]: DEBUG os_brick.utils [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:45:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:00 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[952d7be2-c21d-476b-bb29-d0baa02fe953]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:00 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85b9a4a-3e4c-4301-abb7-2419fb24ca0f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:00 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[09dbe4f0-6aea-43ba-8aff-57ad8ba1de41]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:00 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[86349f4f-063d-495e-a5a1-91a695d93b05]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:45:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:45:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:45:00 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:45:00 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b875fb7-d8b2-4637-979f-ef946cfbc963]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:45:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:45:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:45:00 user nova-compute[73104]: DEBUG os_brick.utils [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:45:00 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Updating existing volume attachment record: eff2dcfb-2199-450c-81cf-0e19bbfe270e {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 08:45:00 user nova-compute[73104]: DEBUG nova.network.neutron [req-fd09ae9a-fee5-41e5-9c6d-1e97ff2e39de req-9a2e21ba-95f1-45d7-8370-19e4f02b52b1 service nova] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Updated VIF entry in instance network info cache for port 693629a9-d0ad-4257-8160-901fccb6f3fd. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:45:00 user nova-compute[73104]: DEBUG nova.network.neutron [req-fd09ae9a-fee5-41e5-9c6d-1e97ff2e39de req-9a2e21ba-95f1-45d7-8370-19e4f02b52b1 service nova] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Updating instance_info_cache with network_info: [{"id": "693629a9-d0ad-4257-8160-901fccb6f3fd", "address": "fa:16:3e:02:20:11", "network": {"id": "84dc5f73-5b46-4788-8e58-69d57f2f089f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-856831086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbb61cb896e4b3cbbdc04d82df1cea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693629a9-d0", "ovs_interfaceid": "693629a9-d0ad-4257-8160-901fccb6f3fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:45:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-fd09ae9a-fee5-41e5-9c6d-1e97ff2e39de req-9a2e21ba-95f1-45d7-8370-19e4f02b52b1 service nova] Releasing lock "refresh_cache-24fbf9f0-c459-4d24-b0ff-b25281378f52" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:45:00 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-b42d4088-6896-4ba2-93e3-18edc056e215 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] COPY block job progress, current cursor: 65536 final cursor: 75497472 {{(pid=73104) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 08:45:01 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-b42d4088-6896-4ba2-93e3-18edc056e215 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73104) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 08:45:01 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-b42d4088-6896-4ba2-93e3-18edc056e215 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 08:45:01 user nova-compute[73104]: DEBUG nova.privsep.utils [None req-b42d4088-6896-4ba2-93e3-18edc056e215 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73104) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 08:45:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-b42d4088-6896-4ba2-93e3-18edc056e215 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnxqt4wmr/cd8a0899fc214e899f9319d273ece609.delta /opt/stack/data/nova/instances/snapshots/tmpnxqt4wmr/cd8a0899fc214e899f9319d273ece609 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-b42d4088-6896-4ba2-93e3-18edc056e215 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnxqt4wmr/cd8a0899fc214e899f9319d273ece609.delta /opt/stack/data/nova/instances/snapshots/tmpnxqt4wmr/cd8a0899fc214e899f9319d273ece609" returned: 0 in 0.581s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:02 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-b42d4088-6896-4ba2-93e3-18edc056e215 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Snapshot extracted, beginning image upload
Aug 26 08:45:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Acquiring lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:03 user nova-compute[73104]: DEBUG nova.compute.manager [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:45:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:03 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:45:03 user nova-compute[73104]: INFO nova.compute.claims [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Claim successful on node user
Aug 26 08:45:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:04 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:45:04 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:45:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:04 user nova-compute[73104]: DEBUG nova.compute.manager [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:45:04 user nova-compute[73104]: DEBUG nova.compute.manager [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:45:04 user nova-compute[73104]: DEBUG nova.network.neutron [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:45:04 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:45:04 user nova-compute[73104]: DEBUG nova.compute.manager [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:45:04 user nova-compute[73104]: DEBUG nova.policy [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b62f9580b597480eb0a775a160dadba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '994053e8d737440f8cb22f048a3c1873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:45:04 user nova-compute[73104]: DEBUG nova.compute.manager [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:45:04 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:45:04 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Creating image(s)
Aug 26 08:45:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Acquiring lock "/opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "/opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "/opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.235s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.206s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk 1073741824" returned: 0 in 0.057s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.185s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:05 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Checking if we can resize image /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 08:45:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:05 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-b42d4088-6896-4ba2-93e3-18edc056e215 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Snapshot image upload complete
Aug 26 08:45:05 user nova-compute[73104]: INFO nova.compute.manager [None req-b42d4088-6896-4ba2-93e3-18edc056e215 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Took 6.11 seconds to snapshot the instance on the hypervisor.
Aug 26 08:45:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:05 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Cannot resize image /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 08:45:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:45:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Ensure instance console log exists: /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:45:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:05 user nova-compute[73104]: DEBUG nova.network.neutron [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Successfully created port: af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.network.neutron [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Successfully updated port: af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Acquiring lock "refresh_cache-02665c70-cf75-44ba-9d90-eb9e5f12e0b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Acquired lock "refresh_cache-02665c70-cf75-44ba-9d90-eb9e5f12e0b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.network.neutron [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.compute.manager [req-173c9b44-2645-45e5-a0fd-3ceaea9d3864 req-6a0d37c6-e7c3-4954-9ffc-14aa3c457c91 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received event network-changed-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.compute.manager [req-173c9b44-2645-45e5-a0fd-3ceaea9d3864 req-6a0d37c6-e7c3-4954-9ffc-14aa3c457c91 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Refreshing instance network info cache due to event network-changed-af4b7f02-03f5-492b-9d27-4d7e5523b423. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-173c9b44-2645-45e5-a0fd-3ceaea9d3864 req-6a0d37c6-e7c3-4954-9ffc-14aa3c457c91 service nova] Acquiring lock "refresh_cache-02665c70-cf75-44ba-9d90-eb9e5f12e0b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.network.neutron [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.network.neutron [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Updating instance_info_cache with network_info: [{"id": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "address": "fa:16:3e:d9:91:54", "network": {"id": "d09a6d6b-0c92-4bc3-a691-0aa3911d756e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1480336812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "994053e8d737440f8cb22f048a3c1873", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4b7f02-03", "ovs_interfaceid": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Releasing lock "refresh_cache-02665c70-cf75-44ba-9d90-eb9e5f12e0b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.compute.manager [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Instance network_info: |[{"id": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "address": "fa:16:3e:d9:91:54", "network": {"id": "d09a6d6b-0c92-4bc3-a691-0aa3911d756e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1480336812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "994053e8d737440f8cb22f048a3c1873", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4b7f02-03", "ovs_interfaceid": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-173c9b44-2645-45e5-a0fd-3ceaea9d3864 req-6a0d37c6-e7c3-4954-9ffc-14aa3c457c91 service nova] Acquired lock "refresh_cache-02665c70-cf75-44ba-9d90-eb9e5f12e0b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.network.neutron [req-173c9b44-2645-45e5-a0fd-3ceaea9d3864 req-6a0d37c6-e7c3-4954-9ffc-14aa3c457c91 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Refreshing network info cache for port af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Start _get_guest_xml network_info=[{"id": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "address": "fa:16:3e:d9:91:54", "network": {"id": "d09a6d6b-0c92-4bc3-a691-0aa3911d756e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1480336812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "994053e8d737440f8cb22f048a3c1873", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4b7f02-03", "ovs_interfaceid": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:45:06 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:45:06 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:45:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-173756414',display_name='tempest-ServerStableDeviceRescueTest-server-173756414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-173756414',id=22,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDA0D9deqQAjrCLJd7vYB9eHa6xBscEdhGpQZkcJVmul30WTV05uYFTJHfePlsMdjM8/w/MauXZ8IM+tEsl3F9Wrd1BEMVqInSiZ7zedxOHCI2tOBe+m4M5LA+fV7gmJQ==',key_name='tempest-keypair-1663477319',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='994053e8d737440f8cb22f048a3c1873',ramdisk_id='',reservation_id='r-1a4hiypw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1186902489',owner_user_name='tempest-ServerStableDeviceRescueTest-1186902489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:45:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b62f9580b597480eb0a775a160dadba4',uuid=02665c70-cf75-44ba-9d90-eb9e5f12e0b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "address": "fa:16:3e:d9:91:54", "network": {"id": "d09a6d6b-0c92-4bc3-a691-0aa3911d756e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1480336812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "994053e8d737440f8cb22f048a3c1873", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4b7f02-03", "ovs_interfaceid": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Converting VIF {"id": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "address": "fa:16:3e:d9:91:54", "network": {"id": "d09a6d6b-0c92-4bc3-a691-0aa3911d756e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1480336812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "994053e8d737440f8cb22f048a3c1873", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4b7f02-03", "ovs_interfaceid": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:91:54,bridge_name='br-int',has_traffic_filtering=True,id=af4b7f02-03f5-492b-9d27-4d7e5523b423,network=Network(d09a6d6b-0c92-4bc3-a691-0aa3911d756e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4b7f02-03') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.objects.instance [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lazy-loading 'pci_devices' on Instance uuid 02665c70-cf75-44ba-9d90-eb9e5f12e0b7 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:45:06 user nova-compute[73104]:   <uuid>02665c70-cf75-44ba-9d90-eb9e5f12e0b7</uuid>
Aug 26 08:45:06 user nova-compute[73104]:   <name>instance-00000016</name>
Aug 26 08:45:06 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:45:06 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:45:06 user nova-compute[73104]:   <metadata>
Aug 26 08:45:06 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:45:06 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:45:06 user nova-compute[73104]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-173756414</nova:name>
Aug 26 08:45:06 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:45:06</nova:creationTime>
Aug 26 08:45:06 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:45:06 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:45:06 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:45:06 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:45:06 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:45:06 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:45:06 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:45:06 user nova-compute[73104]:       <nova:owner>
Aug 26 08:45:06 user nova-compute[73104]:         <nova:user uuid="b62f9580b597480eb0a775a160dadba4">tempest-ServerStableDeviceRescueTest-1186902489-project-member</nova:user>
Aug 26 08:45:06 user nova-compute[73104]:         <nova:project uuid="994053e8d737440f8cb22f048a3c1873">tempest-ServerStableDeviceRescueTest-1186902489</nova:project>
Aug 26 08:45:06 user nova-compute[73104]:       </nova:owner>
Aug 26 08:45:06 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:45:06 user nova-compute[73104]:       <nova:ports>
Aug 26 08:45:06 user nova-compute[73104]:         <nova:port uuid="af4b7f02-03f5-492b-9d27-4d7e5523b423">
Aug 26 08:45:06 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 08:45:06 user nova-compute[73104]:         </nova:port>
Aug 26 08:45:06 user nova-compute[73104]:       </nova:ports>
Aug 26 08:45:06 user nova-compute[73104]:     </nova:instance>
Aug 26 08:45:06 user nova-compute[73104]:   </metadata>
Aug 26 08:45:06 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:45:06 user nova-compute[73104]:     <system>
Aug 26 08:45:06 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:45:06 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:45:06 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:45:06 user nova-compute[73104]:       <entry name="serial">02665c70-cf75-44ba-9d90-eb9e5f12e0b7</entry>
Aug 26 08:45:06 user nova-compute[73104]:       <entry name="uuid">02665c70-cf75-44ba-9d90-eb9e5f12e0b7</entry>
Aug 26 08:45:06 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:45:06 user nova-compute[73104]:     </system>
Aug 26 08:45:06 user nova-compute[73104]:   </sysinfo>
Aug 26 08:45:06 user nova-compute[73104]:   <os>
Aug 26 08:45:06 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:45:06 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:45:06 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:45:06 user nova-compute[73104]:   </os>
Aug 26 08:45:06 user nova-compute[73104]:   <features>
Aug 26 08:45:06 user nova-compute[73104]:     <acpi/>
Aug 26 08:45:06 user nova-compute[73104]:     <apic/>
Aug 26 08:45:06 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:45:06 user nova-compute[73104]:   </features>
Aug 26 08:45:06 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:45:06 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:45:06 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:45:06 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:45:06 user nova-compute[73104]:   </clock>
Aug 26 08:45:06 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:45:06 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:45:06 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:45:06 user nova-compute[73104]:   </cpu>
Aug 26 08:45:06 user nova-compute[73104]:   <devices>
Aug 26 08:45:06 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:45:06 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:45:06 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk"/>
Aug 26 08:45:06 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:45:06 user nova-compute[73104]:     </disk>
Aug 26 08:45:06 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:45:06 user nova-compute[73104]:       <mac address="fa:16:3e:d9:91:54"/>
Aug 26 08:45:06 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:45:06 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:45:06 user nova-compute[73104]:       <target dev="tapaf4b7f02-03"/>
Aug 26 08:45:06 user nova-compute[73104]:     </interface>
Aug 26 08:45:06 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:45:06 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/console.log" append="off"/>
Aug 26 08:45:06 user nova-compute[73104]:     </serial>
Aug 26 08:45:06 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:45:06 user nova-compute[73104]:     <video>
Aug 26 08:45:06 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:45:06 user nova-compute[73104]:     </video>
Aug 26 08:45:06 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:45:06 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:45:06 user nova-compute[73104]:     </rng>
Aug 26 08:45:06 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:45:06 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:45:06 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:45:06 user nova-compute[73104]:     </memballoon>
Aug 26 08:45:06 user nova-compute[73104]:   </devices>
Aug 26 08:45:06 user nova-compute[73104]: </domain>
Aug 26 08:45:06 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:45:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-173756414',display_name='tempest-ServerStableDeviceRescueTest-server-173756414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-173756414',id=22,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDA0D9deqQAjrCLJd7vYB9eHa6xBscEdhGpQZkcJVmul30WTV05uYFTJHfePlsMdjM8/w/MauXZ8IM+tEsl3F9Wrd1BEMVqInSiZ7zedxOHCI2tOBe+m4M5LA+fV7gmJQ==',key_name='tempest-keypair-1663477319',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='994053e8d737440f8cb22f048a3c1873',ramdisk_id='',reservation_id='r-1a4hiypw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1186902489',owner_user_name='tempest-ServerStableDeviceRescueTest-1186902489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:45:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b62f9580b597480eb0a775a160dadba4',uuid=02665c70-cf75-44ba-9d90-eb9e5f12e0b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "address": "fa:16:3e:d9:91:54", "network": {"id": "d09a6d6b-0c92-4bc3-a691-0aa3911d756e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1480336812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "994053e8d737440f8cb22f048a3c1873", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4b7f02-03", "ovs_interfaceid": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Converting VIF {"id": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "address": "fa:16:3e:d9:91:54", "network": {"id": "d09a6d6b-0c92-4bc3-a691-0aa3911d756e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1480336812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "994053e8d737440f8cb22f048a3c1873", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4b7f02-03", "ovs_interfaceid": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:91:54,bridge_name='br-int',has_traffic_filtering=True,id=af4b7f02-03f5-492b-9d27-4d7e5523b423,network=Network(d09a6d6b-0c92-4bc3-a691-0aa3911d756e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4b7f02-03') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG os_vif [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:91:54,bridge_name='br-int',has_traffic_filtering=True,id=af4b7f02-03f5-492b-9d27-4d7e5523b423,network=Network(d09a6d6b-0c92-4bc3-a691-0aa3911d756e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4b7f02-03') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf4b7f02-03, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaf4b7f02-03, col_values=(('external_ids', {'iface-id': 'af4b7f02-03f5-492b-9d27-4d7e5523b423', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:91:54', 'vm-uuid': '02665c70-cf75-44ba-9d90-eb9e5f12e0b7'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:06 user nova-compute[73104]: INFO os_vif [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:91:54,bridge_name='br-int',has_traffic_filtering=True,id=af4b7f02-03f5-492b-9d27-4d7e5523b423,network=Network(d09a6d6b-0c92-4bc3-a691-0aa3911d756e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4b7f02-03')
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:45:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] No VIF found with MAC fa:16:3e:d9:91:54, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:45:07 user nova-compute[73104]: DEBUG nova.network.neutron [req-173c9b44-2645-45e5-a0fd-3ceaea9d3864 req-6a0d37c6-e7c3-4954-9ffc-14aa3c457c91 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Updated VIF entry in instance network info cache for port af4b7f02-03f5-492b-9d27-4d7e5523b423. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:45:07 user nova-compute[73104]: DEBUG nova.network.neutron [req-173c9b44-2645-45e5-a0fd-3ceaea9d3864 req-6a0d37c6-e7c3-4954-9ffc-14aa3c457c91 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Updating instance_info_cache with network_info: [{"id": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "address": "fa:16:3e:d9:91:54", "network": {"id": "d09a6d6b-0c92-4bc3-a691-0aa3911d756e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1480336812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "994053e8d737440f8cb22f048a3c1873", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4b7f02-03", "ovs_interfaceid": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:45:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-173c9b44-2645-45e5-a0fd-3ceaea9d3864 req-6a0d37c6-e7c3-4954-9ffc-14aa3c457c91 service nova] Releasing lock "refresh_cache-02665c70-cf75-44ba-9d90-eb9e5f12e0b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:45:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:08 user nova-compute[73104]: DEBUG nova.compute.manager [req-12ea09c4-176d-44ca-936b-2cbfeaf76e3e req-0db73e1c-101c-4415-94e2-14c63d916536 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received event network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:45:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-12ea09c4-176d-44ca-936b-2cbfeaf76e3e req-0db73e1c-101c-4415-94e2-14c63d916536 service nova] Acquiring lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-12ea09c4-176d-44ca-936b-2cbfeaf76e3e req-0db73e1c-101c-4415-94e2-14c63d916536 service nova] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-12ea09c4-176d-44ca-936b-2cbfeaf76e3e req-0db73e1c-101c-4415-94e2-14c63d916536 service nova] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:08 user nova-compute[73104]: DEBUG nova.compute.manager [req-12ea09c4-176d-44ca-936b-2cbfeaf76e3e req-0db73e1c-101c-4415-94e2-14c63d916536 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] No waiting events found dispatching network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:45:08 user nova-compute[73104]: WARNING nova.compute.manager [req-12ea09c4-176d-44ca-936b-2cbfeaf76e3e req-0db73e1c-101c-4415-94e2-14c63d916536 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received unexpected event network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 for instance with vm_state building and task_state spawning.
Aug 26 08:45:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Acquiring lock "7095c1e6-3825-47d2-8b63-5755fab42b49" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lock "7095c1e6-3825-47d2-8b63-5755fab42b49" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Acquiring lock "7095c1e6-3825-47d2-8b63-5755fab42b49-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lock "7095c1e6-3825-47d2-8b63-5755fab42b49-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lock "7095c1e6-3825-47d2-8b63-5755fab42b49-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:09 user nova-compute[73104]: INFO nova.compute.manager [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Terminating instance
Aug 26 08:45:09 user nova-compute[73104]: DEBUG nova.compute.manager [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG nova.compute.manager [req-c7784363-7863-4f11-9cff-d6489a7e66dc req-d187b73d-6dc5-406a-8786-6d6ea570a4b6 service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Received event network-vif-unplugged-85d806c2-eef6-493b-96cc-f04d9580652d {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c7784363-7863-4f11-9cff-d6489a7e66dc req-d187b73d-6dc5-406a-8786-6d6ea570a4b6 service nova] Acquiring lock "7095c1e6-3825-47d2-8b63-5755fab42b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c7784363-7863-4f11-9cff-d6489a7e66dc req-d187b73d-6dc5-406a-8786-6d6ea570a4b6 service nova] Lock "7095c1e6-3825-47d2-8b63-5755fab42b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c7784363-7863-4f11-9cff-d6489a7e66dc req-d187b73d-6dc5-406a-8786-6d6ea570a4b6 service nova] Lock "7095c1e6-3825-47d2-8b63-5755fab42b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG nova.compute.manager [req-c7784363-7863-4f11-9cff-d6489a7e66dc req-d187b73d-6dc5-406a-8786-6d6ea570a4b6 service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] No waiting events found dispatching network-vif-unplugged-85d806c2-eef6-493b-96cc-f04d9580652d {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG nova.compute.manager [req-c7784363-7863-4f11-9cff-d6489a7e66dc req-d187b73d-6dc5-406a-8786-6d6ea570a4b6 service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Received event network-vif-unplugged-85d806c2-eef6-493b-96cc-f04d9580652d for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:45:09 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Instance destroyed successfully.
Aug 26 08:45:09 user nova-compute[73104]: DEBUG nova.objects.instance [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lazy-loading 'resources' on Instance uuid 7095c1e6-3825-47d2-8b63-5755fab42b49 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T08:40:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1673391366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-485571378',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQRWVfsHBZ4hwdnYVLV5KlTz2Udh43BAhKR/jPOsxlxB/zEqEPc/lSYHzxwVfxX1lYbHxyjeV2oVVw1oFmsH/PJOpMAeQtZFJzj3QYTjDVApGkX3vb+qjI9Jl0kVdHhdQ==',key_name='tempest-keypair-247954255',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:43:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0807a5c94bea4801bd80bbcdef223a57',ramdisk_id='',reservation_id='r-0gki1p05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1626526271',owner_user_name='tempest-ServerActionsV293TestJSON-1626526271-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:43:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc49fb86f3ad4cc0930f0048701225d5',uuid=7095c1e6-3825-47d2-8b63-5755fab42b49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85d806c2-eef6-493b-96cc-f04d9580652d", "address": "fa:16:3e:6e:38:0c", "network": {"id": "ef7a15d0-8aa7-47da-948d-c0f35a723f6f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-316051521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0807a5c94bea4801bd80bbcdef223a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d806c2-ee", "ovs_interfaceid": "85d806c2-eef6-493b-96cc-f04d9580652d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Converting VIF {"id": "85d806c2-eef6-493b-96cc-f04d9580652d", "address": "fa:16:3e:6e:38:0c", "network": {"id": "ef7a15d0-8aa7-47da-948d-c0f35a723f6f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-316051521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0807a5c94bea4801bd80bbcdef223a57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d806c2-ee", "ovs_interfaceid": "85d806c2-eef6-493b-96cc-f04d9580652d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:38:0c,bridge_name='br-int',has_traffic_filtering=True,id=85d806c2-eef6-493b-96cc-f04d9580652d,network=Network(ef7a15d0-8aa7-47da-948d-c0f35a723f6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85d806c2-ee') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG os_vif [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:38:0c,bridge_name='br-int',has_traffic_filtering=True,id=85d806c2-eef6-493b-96cc-f04d9580652d,network=Network(ef7a15d0-8aa7-47da-948d-c0f35a723f6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85d806c2-ee') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85d806c2-ee, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:45:09 user nova-compute[73104]: INFO os_vif [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:38:0c,bridge_name='br-int',has_traffic_filtering=True,id=85d806c2-eef6-493b-96cc-f04d9580652d,network=Network(ef7a15d0-8aa7-47da-948d-c0f35a723f6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85d806c2-ee')
Aug 26 08:45:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'weZcSxGo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:45:09 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:45:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba1d866-804a-4016-a5d3-45fb747f01d4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d19b26d-5baf-448c-8bd5-39b3149c5e63]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:45:09 user nova-compute[73104]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:45:09 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 (non-flash)
Aug 26 08:45:09 user nova-compute[73104]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:45:09 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b4797f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207'): ({'sdb'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Removing single pathed devices sdb {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6665dc6b-aae9-415c-a350-54a9cd27aa73]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a13d55a-fcd6-4df0-94c3-d03d77eee5e3]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Flushing IO for device /dev/sdb {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca821ea5-6de6-41a7-8b0a-4e16c2caa88e]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:45:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1328bb2-4948-4031-9439-c0b183e833d2]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOf51c55f7-b9b8f511f0ef79b1', '/dev/disk/by-id/scsi-26239623866353131', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f51c55f7') {{(pid=84263) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca513b7-8d7a-41e9-89b7-0a074acaeca9]: (4, None) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d730c01-3837-4f88-9c35-56e963edf069]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c70d47-807d-457a-a2b3-9953359d8db4]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207, portal: 172.16.0.220,3260]
Aug 26 08:45:10 user nova-compute[73104]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207, portal: 172.16.0.220,3260] successful.
Aug 26 08:45:10 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1752f0e-7e98-4f66-8c11-e5bb3410c207 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[84eb957a-c3cc-40be-a2bb-3a397df25977]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] <== disconnect_volume: return (298ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:45:10 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Deleting instance files /opt/stack/data/nova/instances/7095c1e6-3825-47d2-8b63-5755fab42b49_del
Aug 26 08:45:10 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Deletion of /opt/stack/data/nova/instances/7095c1e6-3825-47d2-8b63-5755fab42b49_del complete
Aug 26 08:45:10 user nova-compute[73104]: INFO nova.compute.manager [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 26 08:45:10 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039510.4346983, 02665c70-cf75-44ba-9d90-eb9e5f12e0b7 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:45:10 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] VM Resumed (Lifecycle Event)
Aug 26 08:45:10 user nova-compute[73104]: DEBUG nova.compute.manager [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:45:10 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Instance spawned successfully.
Aug 26 08:45:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:45:10 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:45:10 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039510.4379234, 02665c70-cf75-44ba-9d90-eb9e5f12e0b7 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:45:10 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] VM Started (Lifecycle Event)
Aug 26 08:45:10 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:45:10 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:45:10 user nova-compute[73104]: DEBUG nova.compute.manager [req-3dda2d98-88e8-49a4-bfeb-4c66880d5620 req-58351b83-357b-4d78-87a3-42ad7a54c270 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received event network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3dda2d98-88e8-49a4-bfeb-4c66880d5620 req-58351b83-357b-4d78-87a3-42ad7a54c270 service nova] Acquiring lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3dda2d98-88e8-49a4-bfeb-4c66880d5620 req-58351b83-357b-4d78-87a3-42ad7a54c270 service nova] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3dda2d98-88e8-49a4-bfeb-4c66880d5620 req-58351b83-357b-4d78-87a3-42ad7a54c270 service nova] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:10 user nova-compute[73104]: DEBUG nova.compute.manager [req-3dda2d98-88e8-49a4-bfeb-4c66880d5620 req-58351b83-357b-4d78-87a3-42ad7a54c270 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] No waiting events found dispatching network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:45:10 user nova-compute[73104]: WARNING nova.compute.manager [req-3dda2d98-88e8-49a4-bfeb-4c66880d5620 req-58351b83-357b-4d78-87a3-42ad7a54c270 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received unexpected event network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 for instance with vm_state building and task_state spawning.
Aug 26 08:45:10 user nova-compute[73104]: INFO nova.compute.manager [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Took 6.13 seconds to spawn the instance on the hypervisor.
Aug 26 08:45:10 user nova-compute[73104]: DEBUG nova.compute.manager [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:45:10 user nova-compute[73104]: INFO nova.compute.manager [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Took 7.00 seconds to build instance.
Aug 26 08:45:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96326ebb-7dcb-4549-8be8-3429135d5b9a tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.233s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:11 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:45:11 user nova-compute[73104]: DEBUG nova.compute.manager [req-331e6ddf-c1df-4323-a99f-d5320afcfa04 req-506ea0d4-56e7-4997-aeb5-ca077a8f08a2 service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Received event network-vif-plugged-85d806c2-eef6-493b-96cc-f04d9580652d {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:45:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-331e6ddf-c1df-4323-a99f-d5320afcfa04 req-506ea0d4-56e7-4997-aeb5-ca077a8f08a2 service nova] Acquiring lock "7095c1e6-3825-47d2-8b63-5755fab42b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-331e6ddf-c1df-4323-a99f-d5320afcfa04 req-506ea0d4-56e7-4997-aeb5-ca077a8f08a2 service nova] Lock "7095c1e6-3825-47d2-8b63-5755fab42b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-331e6ddf-c1df-4323-a99f-d5320afcfa04 req-506ea0d4-56e7-4997-aeb5-ca077a8f08a2 service nova] Lock "7095c1e6-3825-47d2-8b63-5755fab42b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:11 user nova-compute[73104]: DEBUG nova.compute.manager [req-331e6ddf-c1df-4323-a99f-d5320afcfa04 req-506ea0d4-56e7-4997-aeb5-ca077a8f08a2 service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] No waiting events found dispatching network-vif-plugged-85d806c2-eef6-493b-96cc-f04d9580652d {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:45:11 user nova-compute[73104]: WARNING nova.compute.manager [req-331e6ddf-c1df-4323-a99f-d5320afcfa04 req-506ea0d4-56e7-4997-aeb5-ca077a8f08a2 service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Received unexpected event network-vif-plugged-85d806c2-eef6-493b-96cc-f04d9580652d for instance with vm_state active and task_state deleting.
Aug 26 08:45:11 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Took 1.16 seconds to deallocate network for instance.
Aug 26 08:45:12 user nova-compute[73104]: INFO nova.compute.manager [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Took 0.86 seconds to detach 1 volumes for instance.
Aug 26 08:45:12 user nova-compute[73104]: DEBUG nova.compute.manager [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Deleting volume: b1752f0e-7e98-4f66-8c11-e5bb3410c207 {{(pid=73104) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 08:45:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:12 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:45:12 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:45:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.419s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:12 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Deleted allocations for instance 7095c1e6-3825-47d2-8b63-5755fab42b49
Aug 26 08:45:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b7cd5e1e-f87c-492d-9ac8-c7d5fa9ba52f tempest-ServerActionsV293TestJSON-1626526271 tempest-ServerActionsV293TestJSON-1626526271-project-member] Lock "7095c1e6-3825-47d2-8b63-5755fab42b49" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.975s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG nova.compute.manager [req-85f99d7b-49e0-4672-bf8f-b5b4114b003e req-265a6373-9334-498a-ac63-a9ddf0fcf235 service nova] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Received event network-vif-deleted-85d806c2-eef6-493b-96cc-f04d9580652d {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJIeMLoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:45:13 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:45:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:45:13 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:45:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:45:13 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:45:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[375043c1-3296-4d8b-871a-aa6fb7546390]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:45:13 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[168f864a-6c56-43a9-916e-1ffa0fe8c0c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2] added
Aug 26 08:45:13 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48a092e-ee5c-40e5-97c5-391be48b87c5]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe7132b-d495-4a59-9128-16fbe4fd46a2]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XJIeMLoK {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XJIeMLoK" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce0d14e-49ac-4824-9047-3cfd1e3e412e]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XJIeMLoK'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd663ea3-4aad-4f40-93f4-8a1019f1db4d]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9cdf62-ded9-453d-a725-5d40f0893605]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:45:13 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:45:13 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46c393c-5491-4fe5-bb47-0e135c9ce139]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2, portal: 172.16.0.220,3260]
Aug 26 08:45:13 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2, portal: 172.16.0.220,3260] successful.
Aug 26 08:45:13 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad2076f-7392-4bd4-9124-860aa2e46696]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[903da394-cb20-4356-9477-220a83ec8572]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:45:13 user nova-compute[73104]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2 (non-flash)
Aug 26 08:45:13 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:45:13 user nova-compute[73104]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2 (non-flash)
Aug 26 08:45:13 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee31a11c-0826-418a-b8de-6987e191c1d3]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:45:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJIeMLoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:45:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-427eede1-546a-41b7-a0ab-488616b8be9c tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Acquiring lock "3963cffc-9397-45ca-bf80-198b219beb4f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-427eede1-546a-41b7-a0ab-488616b8be9c tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Lock "3963cffc-9397-45ca-bf80-198b219beb4f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.007s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-427eede1-546a-41b7-a0ab-488616b8be9c tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Acquiring lock "3963cffc-9397-45ca-bf80-198b219beb4f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-427eede1-546a-41b7-a0ab-488616b8be9c tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Lock "3963cffc-9397-45ca-bf80-198b219beb4f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-427eede1-546a-41b7-a0ab-488616b8be9c tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Lock "3963cffc-9397-45ca-bf80-198b219beb4f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.008s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:14 user nova-compute[73104]: INFO nova.compute.manager [None req-427eede1-546a-41b7-a0ab-488616b8be9c tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Terminating instance
Aug 26 08:45:14 user nova-compute[73104]: DEBUG nova.compute.manager [None req-427eede1-546a-41b7-a0ab-488616b8be9c tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 08:45:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:14 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Instance destroyed successfully.
Aug 26 08:45:14 user nova-compute[73104]: DEBUG nova.objects.instance [None req-427eede1-546a-41b7-a0ab-488616b8be9c tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Lazy-loading 'resources' on Instance uuid 3963cffc-9397-45ca-bf80-198b219beb4f {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:45:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:45:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '26465333233356463', 'path': '/dev/sdb'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:45:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465333233356463', 'path': '/dev/sdb'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:45:14 user nova-compute[73104]: DEBUG nova.objects.instance [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lazy-loading 'flavor' on Instance uuid 24fbf9f0-c459-4d24-b0ff-b25281378f52 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:45:15 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-427eede1-546a-41b7-a0ab-488616b8be9c tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:41:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2037228572',display_name='tempest-TestVolumeSwap-server-2037228572',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2037228572',id=16,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAA3lN2AlO1chEqq8KArWigcUlK2OSBTsHZMpZDObdNW4MtsQX590BY2Gvhz5KTg2i+1j0VSG/1X6obzX89xZxQSEISRcvqnhSfbzFkWjVjcEb2SJqlKcU+dt3yyolz3YQ==',key_name='tempest-keypair-1783390580',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:41:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04c9c6d04e234fe5a9665af6a8b63aea',ramdisk_id='',reservation_id='r-illaqena',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-182361514',owner_user_name='tempest-TestVolumeSwap-182361514-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:41:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ee750f3b67042aba0b417a77ac2b0a0',uuid=3963cffc-9397-45ca-bf80-198b219beb4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bdecf202-93ef-451c-af71-4683fe993589", "address": "fa:16:3e:3d:be:58", "network": {"id": "77cbe2e5-4ec7-4dff-a3b8-8fa7b46e5165", "bridge": "br-int", "label": "tempest-TestVolumeSwap-643731537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04c9c6d04e234fe5a9665af6a8b63aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdecf202-93", "ovs_interfaceid": "bdecf202-93ef-451c-af71-4683fe993589", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:45:15 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-427eede1-546a-41b7-a0ab-488616b8be9c tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Converting VIF {"id": "bdecf202-93ef-451c-af71-4683fe993589", "address": "fa:16:3e:3d:be:58", "network": {"id": "77cbe2e5-4ec7-4dff-a3b8-8fa7b46e5165", "bridge": "br-int", "label": "tempest-TestVolumeSwap-643731537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04c9c6d04e234fe5a9665af6a8b63aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdecf202-93", "ovs_interfaceid": "bdecf202-93ef-451c-af71-4683fe993589", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:45:15 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-427eede1-546a-41b7-a0ab-488616b8be9c tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:be:58,bridge_name='br-int',has_traffic_filtering=True,id=bdecf202-93ef-451c-af71-4683fe993589,network=Network(77cbe2e5-4ec7-4dff-a3b8-8fa7b46e5165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdecf202-93') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:45:15 user nova-compute[73104]: DEBUG os_vif [None req-427eede1-546a-41b7-a0ab-488616b8be9c tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:be:58,bridge_name='br-int',has_traffic_filtering=True,id=bdecf202-93ef-451c-af71-4683fe993589,network=Network(77cbe2e5-4ec7-4dff-a3b8-8fa7b46e5165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdecf202-93') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:45:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbdecf202-93, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:45:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:15 user nova-compute[73104]: INFO os_vif [None req-427eede1-546a-41b7-a0ab-488616b8be9c tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:be:58,bridge_name='br-int',has_traffic_filtering=True,id=bdecf202-93ef-451c-af71-4683fe993589,network=Network(77cbe2e5-4ec7-4dff-a3b8-8fa7b46e5165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdecf202-93')
Aug 26 08:45:15 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-427eede1-546a-41b7-a0ab-488616b8be9c tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Deleting instance files /opt/stack/data/nova/instances/3963cffc-9397-45ca-bf80-198b219beb4f_del
Aug 26 08:45:15 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-427eede1-546a-41b7-a0ab-488616b8be9c tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Deletion of /opt/stack/data/nova/instances/3963cffc-9397-45ca-bf80-198b219beb4f_del complete
Aug 26 08:45:15 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 08:45:15 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:45:15 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 08:45:15 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:45:15 user nova-compute[73104]:   <serial>d135f05c-eb85-4439-b321-b61fd9a0e0e2</serial>
Aug 26 08:45:15 user nova-compute[73104]: </disk>
Aug 26 08:45:15 user nova-compute[73104]:  {{(pid=73104) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 08:45:15 user nova-compute[73104]: INFO nova.compute.manager [None req-427eede1-546a-41b7-a0ab-488616b8be9c tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 26 08:45:15 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-427eede1-546a-41b7-a0ab-488616b8be9c tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 08:45:15 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 08:45:15 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 08:45:15 user nova-compute[73104]: DEBUG nova.compute.manager [req-72c17728-6a9c-4967-aa15-0778801727d7 req-9ff77806-3b96-410e-8a82-5450cf8a74f0 service nova] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Received event network-vif-unplugged-bdecf202-93ef-451c-af71-4683fe993589 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:45:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-72c17728-6a9c-4967-aa15-0778801727d7 req-9ff77806-3b96-410e-8a82-5450cf8a74f0 service nova] Acquiring lock "3963cffc-9397-45ca-bf80-198b219beb4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-72c17728-6a9c-4967-aa15-0778801727d7 req-9ff77806-3b96-410e-8a82-5450cf8a74f0 service nova] Lock "3963cffc-9397-45ca-bf80-198b219beb4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-72c17728-6a9c-4967-aa15-0778801727d7 req-9ff77806-3b96-410e-8a82-5450cf8a74f0 service nova] Lock "3963cffc-9397-45ca-bf80-198b219beb4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:15 user nova-compute[73104]: DEBUG nova.compute.manager [req-72c17728-6a9c-4967-aa15-0778801727d7 req-9ff77806-3b96-410e-8a82-5450cf8a74f0 service nova] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] No waiting events found dispatching network-vif-unplugged-bdecf202-93ef-451c-af71-4683fe993589 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:45:15 user nova-compute[73104]: DEBUG nova.compute.manager [req-72c17728-6a9c-4967-aa15-0778801727d7 req-9ff77806-3b96-410e-8a82-5450cf8a74f0 service nova] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Received event network-vif-unplugged-bdecf202-93ef-451c-af71-4683fe993589 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:45:15 user nova-compute[73104]: DEBUG nova.compute.manager [req-72c17728-6a9c-4967-aa15-0778801727d7 req-9ff77806-3b96-410e-8a82-5450cf8a74f0 service nova] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Received event network-vif-plugged-bdecf202-93ef-451c-af71-4683fe993589 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:45:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-72c17728-6a9c-4967-aa15-0778801727d7 req-9ff77806-3b96-410e-8a82-5450cf8a74f0 service nova] Acquiring lock "3963cffc-9397-45ca-bf80-198b219beb4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-72c17728-6a9c-4967-aa15-0778801727d7 req-9ff77806-3b96-410e-8a82-5450cf8a74f0 service nova] Lock "3963cffc-9397-45ca-bf80-198b219beb4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-72c17728-6a9c-4967-aa15-0778801727d7 req-9ff77806-3b96-410e-8a82-5450cf8a74f0 service nova] Lock "3963cffc-9397-45ca-bf80-198b219beb4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:15 user nova-compute[73104]: DEBUG nova.compute.manager [req-72c17728-6a9c-4967-aa15-0778801727d7 req-9ff77806-3b96-410e-8a82-5450cf8a74f0 service nova] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] No waiting events found dispatching network-vif-plugged-bdecf202-93ef-451c-af71-4683fe993589 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:45:15 user nova-compute[73104]: WARNING nova.compute.manager [req-72c17728-6a9c-4967-aa15-0778801727d7 req-9ff77806-3b96-410e-8a82-5450cf8a74f0 service nova] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Received unexpected event network-vif-plugged-bdecf202-93ef-451c-af71-4683fe993589 for instance with vm_state active and task_state deleting.
Aug 26 08:45:15 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:45:15 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:45:15 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] No VIF found with MAC fa:16:3e:02:20:11, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:45:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3ca712ef-a4b6-4e6f-95b5-3e4c9bd0f217 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "24fbf9f0-c459-4d24-b0ff-b25281378f52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.442s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:16 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:45:16 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Took 1.18 seconds to deallocate network for instance.
Aug 26 08:45:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-427eede1-546a-41b7-a0ab-488616b8be9c tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-427eede1-546a-41b7-a0ab-488616b8be9c tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:16 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-427eede1-546a-41b7-a0ab-488616b8be9c tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:45:16 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-427eede1-546a-41b7-a0ab-488616b8be9c tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:45:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-427eede1-546a-41b7-a0ab-488616b8be9c tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:16 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-427eede1-546a-41b7-a0ab-488616b8be9c tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Deleted allocations for instance 3963cffc-9397-45ca-bf80-198b219beb4f
Aug 26 08:45:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-427eede1-546a-41b7-a0ab-488616b8be9c tempest-TestVolumeSwap-182361514 tempest-TestVolumeSwap-182361514-project-member] Lock "3963cffc-9397-45ca-bf80-198b219beb4f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.671s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:17 user nova-compute[73104]: DEBUG nova.compute.manager [req-10e6747c-367f-4e42-942a-c8f5bb6741f0 req-ab91d95a-d90e-4f65-b7f9-3bb0594f3f80 service nova] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Received event network-vif-deleted-bdecf202-93ef-451c-af71-4683fe993589 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:45:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:24 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693039509.8080628, 7095c1e6-3825-47d2-8b63-5755fab42b49 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:45:24 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] VM Stopped (Lifecycle Event)
Aug 26 08:45:24 user nova-compute[73104]: DEBUG nova.compute.manager [None req-87980ddb-d116-4dbc-9a49-84807ffc496b None None] [instance: 7095c1e6-3825-47d2-8b63-5755fab42b49] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:45:25 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:29 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693039514.9822533, 3963cffc-9397-45ca-bf80-198b219beb4f => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:45:29 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] VM Stopped (Lifecycle Event)
Aug 26 08:45:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-2a9346f5-6ba7-4085-9b5d-51940da13aac None None] [instance: 3963cffc-9397-45ca-bf80-198b219beb4f] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:45:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:35 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:49 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:45:50 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:45:50 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:45:50 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 08:45:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-b5e1f82c-5675-4c37-8ba2-44e6a341a576" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:45:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-b5e1f82c-5675-4c37-8ba2-44e6a341a576" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:45:50 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 08:45:50 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Updating instance_info_cache with network_info: [{"id": "3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96", "address": "fa:16:3e:c0:56:86", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3913bdf7-1f", "ovs_interfaceid": "3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:45:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-b5e1f82c-5675-4c37-8ba2-44e6a341a576" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:45:50 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 08:45:50 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:45:50 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:45:50 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:45:50 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 08:45:51 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:45:51 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:52 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:45:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96317d43-1411-4921-b4ee-6b7421f102df tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Acquiring lock "dcec7631-b94f-4dbf-b85d-e8ad9c6396b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96317d43-1411-4921-b4ee-6b7421f102df tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lock "dcec7631-b94f-4dbf-b85d-e8ad9c6396b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96317d43-1411-4921-b4ee-6b7421f102df tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Acquiring lock "dcec7631-b94f-4dbf-b85d-e8ad9c6396b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96317d43-1411-4921-b4ee-6b7421f102df tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lock "dcec7631-b94f-4dbf-b85d-e8ad9c6396b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96317d43-1411-4921-b4ee-6b7421f102df tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lock "dcec7631-b94f-4dbf-b85d-e8ad9c6396b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:52 user nova-compute[73104]: INFO nova.compute.manager [None req-96317d43-1411-4921-b4ee-6b7421f102df tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Terminating instance
Aug 26 08:45:52 user nova-compute[73104]: DEBUG nova.compute.manager [None req-96317d43-1411-4921-b4ee-6b7421f102df tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 08:45:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:52 user nova-compute[73104]: DEBUG nova.compute.manager [req-9a28fa15-4061-4e7b-b0ac-fa78c0dabf44 req-e9edbab3-8c87-4483-87ee-5f69107501f5 service nova] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Received event network-vif-unplugged-be09acc4-f1a1-40a1-bfab-90b23ac8000c {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:45:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9a28fa15-4061-4e7b-b0ac-fa78c0dabf44 req-e9edbab3-8c87-4483-87ee-5f69107501f5 service nova] Acquiring lock "dcec7631-b94f-4dbf-b85d-e8ad9c6396b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9a28fa15-4061-4e7b-b0ac-fa78c0dabf44 req-e9edbab3-8c87-4483-87ee-5f69107501f5 service nova] Lock "dcec7631-b94f-4dbf-b85d-e8ad9c6396b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9a28fa15-4061-4e7b-b0ac-fa78c0dabf44 req-e9edbab3-8c87-4483-87ee-5f69107501f5 service nova] Lock "dcec7631-b94f-4dbf-b85d-e8ad9c6396b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:52 user nova-compute[73104]: DEBUG nova.compute.manager [req-9a28fa15-4061-4e7b-b0ac-fa78c0dabf44 req-e9edbab3-8c87-4483-87ee-5f69107501f5 service nova] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] No waiting events found dispatching network-vif-unplugged-be09acc4-f1a1-40a1-bfab-90b23ac8000c {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:45:52 user nova-compute[73104]: DEBUG nova.compute.manager [req-9a28fa15-4061-4e7b-b0ac-fa78c0dabf44 req-e9edbab3-8c87-4483-87ee-5f69107501f5 service nova] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Received event network-vif-unplugged-be09acc4-f1a1-40a1-bfab-90b23ac8000c for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:45:53 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:45:53 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Instance destroyed successfully.
Aug 26 08:45:53 user nova-compute[73104]: DEBUG nova.objects.instance [None req-96317d43-1411-4921-b4ee-6b7421f102df tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lazy-loading 'resources' on Instance uuid dcec7631-b94f-4dbf-b85d-e8ad9c6396b7 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:45:53 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-96317d43-1411-4921-b4ee-6b7421f102df tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:36:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1292953899',display_name='tempest-ServersNegativeTestJSON-server-1292953899',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1292953899',id=1,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:37:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35a0141c91ef45e4bf23a4b1cc4eb029',ramdisk_id='',reservation_id='r-1j366f9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1313163796',owner_user_name='tempest-ServersNegativeTestJSON-1313163796-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:37:06Z,user_data=None,user_id='d7ceab3a9cd7496fae6a08b9ea8cc513',uuid=dcec7631-b94f-4dbf-b85d-e8ad9c6396b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be09acc4-f1a1-40a1-bfab-90b23ac8000c", "address": "fa:16:3e:f0:64:0b", "network": {"id": "c6ce9852-f528-4ac1-aa7a-be833ed25137", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2003310403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a0141c91ef45e4bf23a4b1cc4eb029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe09acc4-f1", "ovs_interfaceid": "be09acc4-f1a1-40a1-bfab-90b23ac8000c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:45:53 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-96317d43-1411-4921-b4ee-6b7421f102df tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Converting VIF {"id": "be09acc4-f1a1-40a1-bfab-90b23ac8000c", "address": "fa:16:3e:f0:64:0b", "network": {"id": "c6ce9852-f528-4ac1-aa7a-be833ed25137", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2003310403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a0141c91ef45e4bf23a4b1cc4eb029", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe09acc4-f1", "ovs_interfaceid": "be09acc4-f1a1-40a1-bfab-90b23ac8000c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:45:53 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-96317d43-1411-4921-b4ee-6b7421f102df tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:64:0b,bridge_name='br-int',has_traffic_filtering=True,id=be09acc4-f1a1-40a1-bfab-90b23ac8000c,network=Network(c6ce9852-f528-4ac1-aa7a-be833ed25137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe09acc4-f1') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:45:53 user nova-compute[73104]: DEBUG os_vif [None req-96317d43-1411-4921-b4ee-6b7421f102df tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:64:0b,bridge_name='br-int',has_traffic_filtering=True,id=be09acc4-f1a1-40a1-bfab-90b23ac8000c,network=Network(c6ce9852-f528-4ac1-aa7a-be833ed25137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe09acc4-f1') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:45:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe09acc4-f1, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:45:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:45:53 user nova-compute[73104]: INFO os_vif [None req-96317d43-1411-4921-b4ee-6b7421f102df tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:64:0b,bridge_name='br-int',has_traffic_filtering=True,id=be09acc4-f1a1-40a1-bfab-90b23ac8000c,network=Network(c6ce9852-f528-4ac1-aa7a-be833ed25137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe09acc4-f1')
Aug 26 08:45:53 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-96317d43-1411-4921-b4ee-6b7421f102df tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Deleting instance files /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7_del
Aug 26 08:45:53 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-96317d43-1411-4921-b4ee-6b7421f102df tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Deletion of /opt/stack/data/nova/instances/dcec7631-b94f-4dbf-b85d-e8ad9c6396b7_del complete
Aug 26 08:45:53 user nova-compute[73104]: INFO nova.compute.manager [None req-96317d43-1411-4921-b4ee-6b7421f102df tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 26 08:45:53 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-96317d43-1411-4921-b4ee-6b7421f102df tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 08:45:53 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 08:45:53 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG nova.compute.manager [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:45:54 user nova-compute[73104]: INFO nova.compute.claims [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Claim successful on node user
Aug 26 08:45:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquiring lock "385c6d93-907d-42d7-9b43-479e6caf66f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquiring lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:54 user nova-compute[73104]: INFO nova.compute.manager [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Terminating instance
Aug 26 08:45:54 user nova-compute[73104]: DEBUG nova.compute.manager [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:45:54 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Took 1.14 seconds to deallocate network for instance.
Aug 26 08:45:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-0d929c0a-ce4d-4306-bbe9-37b7dcab5a36 req-259bf91a-5778-460c-8a22-152a87a6355c service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Received event network-vif-unplugged-d4692900-c165-487d-9847-383fcf1d2270 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0d929c0a-ce4d-4306-bbe9-37b7dcab5a36 req-259bf91a-5778-460c-8a22-152a87a6355c service nova] Acquiring lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0d929c0a-ce4d-4306-bbe9-37b7dcab5a36 req-259bf91a-5778-460c-8a22-152a87a6355c service nova] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0d929c0a-ce4d-4306-bbe9-37b7dcab5a36 req-259bf91a-5778-460c-8a22-152a87a6355c service nova] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-0d929c0a-ce4d-4306-bbe9-37b7dcab5a36 req-259bf91a-5778-460c-8a22-152a87a6355c service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] No waiting events found dispatching network-vif-unplugged-d4692900-c165-487d-9847-383fcf1d2270 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-0d929c0a-ce4d-4306-bbe9-37b7dcab5a36 req-259bf91a-5778-460c-8a22-152a87a6355c service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Received event network-vif-unplugged-d4692900-c165-487d-9847-383fcf1d2270 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96317d43-1411-4921-b4ee-6b7421f102df tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.546s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG nova.compute.manager [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.468s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96317d43-1411-4921-b4ee-6b7421f102df tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.075s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG nova.compute.manager [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG nova.network.neutron [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:45:54 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:45:54 user nova-compute[73104]: DEBUG nova.compute.manager [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-685ab5ab-a668-4fc9-ae77-a22220bbc43f req-ec2d0dd3-e2b1-4deb-99c7-e6c387849c10 service nova] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Received event network-vif-plugged-be09acc4-f1a1-40a1-bfab-90b23ac8000c {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-685ab5ab-a668-4fc9-ae77-a22220bbc43f req-ec2d0dd3-e2b1-4deb-99c7-e6c387849c10 service nova] Acquiring lock "dcec7631-b94f-4dbf-b85d-e8ad9c6396b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-685ab5ab-a668-4fc9-ae77-a22220bbc43f req-ec2d0dd3-e2b1-4deb-99c7-e6c387849c10 service nova] Lock "dcec7631-b94f-4dbf-b85d-e8ad9c6396b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-685ab5ab-a668-4fc9-ae77-a22220bbc43f req-ec2d0dd3-e2b1-4deb-99c7-e6c387849c10 service nova] Lock "dcec7631-b94f-4dbf-b85d-e8ad9c6396b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-685ab5ab-a668-4fc9-ae77-a22220bbc43f req-ec2d0dd3-e2b1-4deb-99c7-e6c387849c10 service nova] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] No waiting events found dispatching network-vif-plugged-be09acc4-f1a1-40a1-bfab-90b23ac8000c {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:45:54 user nova-compute[73104]: WARNING nova.compute.manager [req-685ab5ab-a668-4fc9-ae77-a22220bbc43f req-ec2d0dd3-e2b1-4deb-99c7-e6c387849c10 service nova] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Received unexpected event network-vif-plugged-be09acc4-f1a1-40a1-bfab-90b23ac8000c for instance with vm_state deleted and task_state None.
Aug 26 08:45:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-685ab5ab-a668-4fc9-ae77-a22220bbc43f req-ec2d0dd3-e2b1-4deb-99c7-e6c387849c10 service nova] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Received event network-vif-deleted-be09acc4-f1a1-40a1-bfab-90b23ac8000c {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG nova.policy [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '257343af54bd42b591e8874ef4ecf8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb864c0a34541dca00c6dbbcea17319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:45:54 user nova-compute[73104]: DEBUG nova.compute.manager [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:45:55 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Creating image(s)
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "/opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "/opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "/opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:55 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Instance destroyed successfully.
Aug 26 08:45:55 user nova-compute[73104]: DEBUG nova.objects.instance [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lazy-loading 'resources' on Instance uuid 385c6d93-907d-42d7-9b43-479e6caf66f9 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:37:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1752100953',display_name='tempest-ServerActionsTestOtherB-server-1752100953',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1752100953',id=5,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNCl9FBP9XyWyY8/M5Nn5mUzz1vqHS13H5r5WR3mIkiFM7rzl4Rl7e+CWZJ8183D5yYr3nZra0DCol7pvB/KJevg8WITrJ9KzKNvGMc/QWpgMb9Lbrm7qPNUJRloZ083Q==',key_name='tempest-keypair-1221674543',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:43:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc8c266ecf8444919a4a2ed73b784b53',ramdisk_id='',reservation_id='r-w3k6rkik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-905162429',owner_user_name='tempest-ServerActionsTestOtherB-905162429-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:43:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4e9fc4dcaaf4aa1aaa51245217b4ded',uuid=385c6d93-907d-42d7-9b43-479e6caf66f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4692900-c165-487d-9847-383fcf1d2270", "address": "fa:16:3e:b9:37:34", "network": {"id": "9aad8a32-d93f-45ef-be53-f84cebd194b1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2017537149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc8c266ecf8444919a4a2ed73b784b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4692900-c1", "ovs_interfaceid": "d4692900-c165-487d-9847-383fcf1d2270", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Converting VIF {"id": "d4692900-c165-487d-9847-383fcf1d2270", "address": "fa:16:3e:b9:37:34", "network": {"id": "9aad8a32-d93f-45ef-be53-f84cebd194b1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2017537149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc8c266ecf8444919a4a2ed73b784b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4692900-c1", "ovs_interfaceid": "d4692900-c165-487d-9847-383fcf1d2270", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:37:34,bridge_name='br-int',has_traffic_filtering=True,id=d4692900-c165-487d-9847-383fcf1d2270,network=Network(9aad8a32-d93f-45ef-be53-f84cebd194b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4692900-c1') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG os_vif [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:37:34,bridge_name='br-int',has_traffic_filtering=True,id=d4692900-c165-487d-9847-383fcf1d2270,network=Network(9aad8a32-d93f-45ef-be53-f84cebd194b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4692900-c1') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4692900-c1, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:45:55 user nova-compute[73104]: INFO os_vif [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:37:34,bridge_name='br-int',has_traffic_filtering=True,id=d4692900-c165-487d-9847-383fcf1d2270,network=Network(9aad8a32-d93f-45ef-be53-f84cebd194b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4692900-c1')
Aug 26 08:45:55 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEOqgAiB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:45:55 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:45:55 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4855806a-4586-4b7f-991b-6fdb019c307a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-96317d43-1411-4921-b4ee-6b7421f102df tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-96317d43-1411-4921-b4ee-6b7421f102df tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d43306d-eeab-493e-b301-53c5bc163a90]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:45:55 user nova-compute[73104]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2 (non-flash)
Aug 26 08:45:55 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 (non-flash)
Aug 26 08:45:55 user nova-compute[73104]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2 (non-flash)
Aug 26 08:45:55 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0c4228790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44'): ({'sdc'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Removing single pathed devices sdc {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.216s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0440f4bc-b840-445c-ae55-0d5bbc1ce502]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96317d43-1411-4921-b4ee-6b7421f102df tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.555s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ddf2e0-a521-4c71-98ad-e3cf8c654e94]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Flushing IO for device /dev/sdc {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:55 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-96317d43-1411-4921-b4ee-6b7421f102df tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Deleted allocations for instance dcec7631-b94f-4dbf-b85d-e8ad9c6396b7
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[de83f537-712b-4669-b433-8fb531c1b0d9]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.198s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01f9d51-746a-4de7-b99f-fc606e5bc708]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] SCSI volumes sdc have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk 1073741824" returned: 0 in 0.059s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d010f263-d2be-4439-997f-2d4af9ad188f]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96317d43-1411-4921-b4ee-6b7421f102df tempest-ServersNegativeTestJSON-1313163796 tempest-ServersNegativeTestJSON-1313163796-project-member] Lock "dcec7631-b94f-4dbf-b85d-e8ad9c6396b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.999s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[73488b00-4217-4145-bf06-7fa09f2d9960]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44, portal: 172.16.0.220,3260]
Aug 26 08:45:55 user nova-compute[73104]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44, portal: 172.16.0.220,3260] successful.
Aug 26 08:45:55 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00b98d5-a12a-4e06-bbd8-8b3bd3b0dc44 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1418e03c-d50f-46d8-b877-ddaddd9cf556]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.547s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] <== disconnect_volume: return (549ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:45:55 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Deleting instance files /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9_del
Aug 26 08:45:55 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Deletion of /opt/stack/data/nova/instances/385c6d93-907d-42d7-9b43-479e6caf66f9_del complete
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.204s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:55 user nova-compute[73104]: INFO nova.compute.manager [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Took 1.55 seconds to destroy the instance on the hypervisor.
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG nova.network.neutron [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Successfully created port: 68e8044e-0d86-4309-938c-f00d2c392440 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Cannot resize image /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Ensure instance console log exists: /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fbf9f0-c459-4d24-b0ff-b25281378f52/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fbf9f0-c459-4d24-b0ff-b25281378f52/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fbf9f0-c459-4d24-b0ff-b25281378f52/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:56 user nova-compute[73104]: DEBUG nova.network.neutron [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Successfully updated port: 68e8044e-0d86-4309-938c-f00d2c392440 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:45:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fbf9f0-c459-4d24-b0ff-b25281378f52/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:45:56 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Error from libvirt while getting description of instance-00000005: [Error Code 42] Domain not found: no domain with matching uuid '385c6d93-907d-42d7-9b43-479e6caf66f9' (instance-00000005): libvirt.libvirtError: Domain not found: no domain with matching uuid '385c6d93-907d-42d7-9b43-479e6caf66f9' (instance-00000005)
Aug 26 08:45:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "refresh_cache-b7f6e347-c1f3-4f56-86c4-3b28c4729964" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:45:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquired lock "refresh_cache-b7f6e347-c1f3-4f56-86c4-3b28c4729964" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:45:56 user nova-compute[73104]: DEBUG nova.network.neutron [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:45:56 user nova-compute[73104]: DEBUG nova.compute.manager [req-765a1be2-bf93-490a-9ec1-a492ea694439 req-3ed2b319-0a1d-4574-aab7-8eaa8b68f937 service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Received event network-vif-plugged-d4692900-c165-487d-9847-383fcf1d2270 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:45:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-765a1be2-bf93-490a-9ec1-a492ea694439 req-3ed2b319-0a1d-4574-aab7-8eaa8b68f937 service nova] Acquiring lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-765a1be2-bf93-490a-9ec1-a492ea694439 req-3ed2b319-0a1d-4574-aab7-8eaa8b68f937 service nova] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-765a1be2-bf93-490a-9ec1-a492ea694439 req-3ed2b319-0a1d-4574-aab7-8eaa8b68f937 service nova] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:56 user nova-compute[73104]: DEBUG nova.compute.manager [req-765a1be2-bf93-490a-9ec1-a492ea694439 req-3ed2b319-0a1d-4574-aab7-8eaa8b68f937 service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] No waiting events found dispatching network-vif-plugged-d4692900-c165-487d-9847-383fcf1d2270 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:45:56 user nova-compute[73104]: WARNING nova.compute.manager [req-765a1be2-bf93-490a-9ec1-a492ea694439 req-3ed2b319-0a1d-4574-aab7-8eaa8b68f937 service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Received unexpected event network-vif-plugged-d4692900-c165-487d-9847-383fcf1d2270 for instance with vm_state active and task_state deleting.
Aug 26 08:45:56 user nova-compute[73104]: DEBUG nova.network.neutron [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:45:56 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:45:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:56 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Took 1.11 seconds to deallocate network for instance.
Aug 26 08:45:57 user nova-compute[73104]: DEBUG nova.compute.manager [req-a1b5f855-9d48-4256-8f7d-8959ec0f4546 req-ed0347f4-c307-405e-a0b0-ff1d43ebb160 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Received event network-changed-68e8044e-0d86-4309-938c-f00d2c392440 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG nova.compute.manager [req-a1b5f855-9d48-4256-8f7d-8959ec0f4546 req-ed0347f4-c307-405e-a0b0-ff1d43ebb160 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Refreshing instance network info cache due to event network-changed-68e8044e-0d86-4309-938c-f00d2c392440. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a1b5f855-9d48-4256-8f7d-8959ec0f4546 req-ed0347f4-c307-405e-a0b0-ff1d43ebb160 service nova] Acquiring lock "refresh_cache-b7f6e347-c1f3-4f56-86c4-3b28c4729964" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG nova.network.neutron [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Updating instance_info_cache with network_info: [{"id": "68e8044e-0d86-4309-938c-f00d2c392440", "address": "fa:16:3e:8e:1c:6e", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68e8044e-0d", "ovs_interfaceid": "68e8044e-0d86-4309-938c-f00d2c392440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Releasing lock "refresh_cache-b7f6e347-c1f3-4f56-86c4-3b28c4729964" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG nova.compute.manager [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Instance network_info: |[{"id": "68e8044e-0d86-4309-938c-f00d2c392440", "address": "fa:16:3e:8e:1c:6e", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68e8044e-0d", "ovs_interfaceid": "68e8044e-0d86-4309-938c-f00d2c392440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a1b5f855-9d48-4256-8f7d-8959ec0f4546 req-ed0347f4-c307-405e-a0b0-ff1d43ebb160 service nova] Acquired lock "refresh_cache-b7f6e347-c1f3-4f56-86c4-3b28c4729964" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG nova.network.neutron [req-a1b5f855-9d48-4256-8f7d-8959ec0f4546 req-ed0347f4-c307-405e-a0b0-ff1d43ebb160 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Refreshing network info cache for port 68e8044e-0d86-4309-938c-f00d2c392440 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Start _get_guest_xml network_info=[{"id": "68e8044e-0d86-4309-938c-f00d2c392440", "address": "fa:16:3e:8e:1c:6e", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68e8044e-0d", "ovs_interfaceid": "68e8044e-0d86-4309-938c-f00d2c392440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:45:57 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:45:57 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:45:57 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:45:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-507169638',display_name='tempest-tempest.common.compute-instance-507169638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-507169638',id=23,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYLqMl8GpNjfNVCgo2H+2r4h7f+wltYEXzpCmKmElhA0DBXXS8OJ+jJMfreN4vSnENs3yu+UIcdrUm0f/2htkz5kCGsZ2tw03AkxIejr18INsy4zP7Li4asqVv0WIUqpw==',key_name='tempest-keypair-2115817653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efb864c0a34541dca00c6dbbcea17319',ramdisk_id='',reservation_id='r-p9meui0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1245661612',owner_user_name='tempest-ServerActionsTestOtherA-1245661612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:45:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='257343af54bd42b591e8874ef4ecf8dc',uuid=b7f6e347-c1f3-4f56-86c4-3b28c4729964,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68e8044e-0d86-4309-938c-f00d2c392440", "address": "fa:16:3e:8e:1c:6e", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68e8044e-0d", "ovs_interfaceid": "68e8044e-0d86-4309-938c-f00d2c392440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Converting VIF {"id": "68e8044e-0d86-4309-938c-f00d2c392440", "address": "fa:16:3e:8e:1c:6e", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68e8044e-0d", "ovs_interfaceid": "68e8044e-0d86-4309-938c-f00d2c392440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:1c:6e,bridge_name='br-int',has_traffic_filtering=True,id=68e8044e-0d86-4309-938c-f00d2c392440,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68e8044e-0d') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG nova.objects.instance [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lazy-loading 'pci_devices' on Instance uuid b7f6e347-c1f3-4f56-86c4-3b28c4729964 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:45:57 user nova-compute[73104]:   <uuid>b7f6e347-c1f3-4f56-86c4-3b28c4729964</uuid>
Aug 26 08:45:57 user nova-compute[73104]:   <name>instance-00000017</name>
Aug 26 08:45:57 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:45:57 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:45:57 user nova-compute[73104]:   <metadata>
Aug 26 08:45:57 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:45:57 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:45:57 user nova-compute[73104]:       <nova:name>tempest-tempest.common.compute-instance-507169638</nova:name>
Aug 26 08:45:57 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:45:57</nova:creationTime>
Aug 26 08:45:57 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:45:57 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:45:57 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:45:57 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:45:57 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:45:57 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:45:57 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:45:57 user nova-compute[73104]:       <nova:owner>
Aug 26 08:45:57 user nova-compute[73104]:         <nova:user uuid="257343af54bd42b591e8874ef4ecf8dc">tempest-ServerActionsTestOtherA-1245661612-project-member</nova:user>
Aug 26 08:45:57 user nova-compute[73104]:         <nova:project uuid="efb864c0a34541dca00c6dbbcea17319">tempest-ServerActionsTestOtherA-1245661612</nova:project>
Aug 26 08:45:57 user nova-compute[73104]:       </nova:owner>
Aug 26 08:45:57 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:45:57 user nova-compute[73104]:       <nova:ports>
Aug 26 08:45:57 user nova-compute[73104]:         <nova:port uuid="68e8044e-0d86-4309-938c-f00d2c392440">
Aug 26 08:45:57 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 08:45:57 user nova-compute[73104]:         </nova:port>
Aug 26 08:45:57 user nova-compute[73104]:       </nova:ports>
Aug 26 08:45:57 user nova-compute[73104]:     </nova:instance>
Aug 26 08:45:57 user nova-compute[73104]:   </metadata>
Aug 26 08:45:57 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:45:57 user nova-compute[73104]:     <system>
Aug 26 08:45:57 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:45:57 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:45:57 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:45:57 user nova-compute[73104]:       <entry name="serial">b7f6e347-c1f3-4f56-86c4-3b28c4729964</entry>
Aug 26 08:45:57 user nova-compute[73104]:       <entry name="uuid">b7f6e347-c1f3-4f56-86c4-3b28c4729964</entry>
Aug 26 08:45:57 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:45:57 user nova-compute[73104]:     </system>
Aug 26 08:45:57 user nova-compute[73104]:   </sysinfo>
Aug 26 08:45:57 user nova-compute[73104]:   <os>
Aug 26 08:45:57 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:45:57 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:45:57 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:45:57 user nova-compute[73104]:   </os>
Aug 26 08:45:57 user nova-compute[73104]:   <features>
Aug 26 08:45:57 user nova-compute[73104]:     <acpi/>
Aug 26 08:45:57 user nova-compute[73104]:     <apic/>
Aug 26 08:45:57 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:45:57 user nova-compute[73104]:   </features>
Aug 26 08:45:57 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:45:57 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:45:57 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:45:57 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:45:57 user nova-compute[73104]:   </clock>
Aug 26 08:45:57 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:45:57 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:45:57 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:45:57 user nova-compute[73104]:   </cpu>
Aug 26 08:45:57 user nova-compute[73104]:   <devices>
Aug 26 08:45:57 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:45:57 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:45:57 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk"/>
Aug 26 08:45:57 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:45:57 user nova-compute[73104]:     </disk>
Aug 26 08:45:57 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:45:57 user nova-compute[73104]:       <mac address="fa:16:3e:8e:1c:6e"/>
Aug 26 08:45:57 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:45:57 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:45:57 user nova-compute[73104]:       <target dev="tap68e8044e-0d"/>
Aug 26 08:45:57 user nova-compute[73104]:     </interface>
Aug 26 08:45:57 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:45:57 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/console.log" append="off"/>
Aug 26 08:45:57 user nova-compute[73104]:     </serial>
Aug 26 08:45:57 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:45:57 user nova-compute[73104]:     <video>
Aug 26 08:45:57 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:45:57 user nova-compute[73104]:     </video>
Aug 26 08:45:57 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:45:57 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:45:57 user nova-compute[73104]:     </rng>
Aug 26 08:45:57 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:45:57 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:45:57 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:45:57 user nova-compute[73104]:     </memballoon>
Aug 26 08:45:57 user nova-compute[73104]:   </devices>
Aug 26 08:45:57 user nova-compute[73104]: </domain>
Aug 26 08:45:57 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:45:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-507169638',display_name='tempest-tempest.common.compute-instance-507169638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-507169638',id=23,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYLqMl8GpNjfNVCgo2H+2r4h7f+wltYEXzpCmKmElhA0DBXXS8OJ+jJMfreN4vSnENs3yu+UIcdrUm0f/2htkz5kCGsZ2tw03AkxIejr18INsy4zP7Li4asqVv0WIUqpw==',key_name='tempest-keypair-2115817653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efb864c0a34541dca00c6dbbcea17319',ramdisk_id='',reservation_id='r-p9meui0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1245661612',owner_user_name='tempest-ServerActionsTestOtherA-1245661612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:45:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='257343af54bd42b591e8874ef4ecf8dc',uuid=b7f6e347-c1f3-4f56-86c4-3b28c4729964,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68e8044e-0d86-4309-938c-f00d2c392440", "address": "fa:16:3e:8e:1c:6e", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68e8044e-0d", "ovs_interfaceid": "68e8044e-0d86-4309-938c-f00d2c392440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Converting VIF {"id": "68e8044e-0d86-4309-938c-f00d2c392440", "address": "fa:16:3e:8e:1c:6e", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68e8044e-0d", "ovs_interfaceid": "68e8044e-0d86-4309-938c-f00d2c392440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:1c:6e,bridge_name='br-int',has_traffic_filtering=True,id=68e8044e-0d86-4309-938c-f00d2c392440,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68e8044e-0d') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG os_vif [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:1c:6e,bridge_name='br-int',has_traffic_filtering=True,id=68e8044e-0d86-4309-938c-f00d2c392440,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68e8044e-0d') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68e8044e-0d, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap68e8044e-0d, col_values=(('external_ids', {'iface-id': '68e8044e-0d86-4309-938c-f00d2c392440', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:1c:6e', 'vm-uuid': 'b7f6e347-c1f3-4f56-86c4-3b28c4729964'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:57 user nova-compute[73104]: INFO os_vif [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:1c:6e,bridge_name='br-int',has_traffic_filtering=True,id=68e8044e-0d86-4309-938c-f00d2c392440,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68e8044e-0d')
Aug 26 08:45:57 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] No VIF found with MAC fa:16:3e:8e:1c:6e, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG nova.network.neutron [req-a1b5f855-9d48-4256-8f7d-8959ec0f4546 req-ed0347f4-c307-405e-a0b0-ff1d43ebb160 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Updated VIF entry in instance network info cache for port 68e8044e-0d86-4309-938c-f00d2c392440. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG nova.network.neutron [req-a1b5f855-9d48-4256-8f7d-8959ec0f4546 req-ed0347f4-c307-405e-a0b0-ff1d43ebb160 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Updating instance_info_cache with network_info: [{"id": "68e8044e-0d86-4309-938c-f00d2c392440", "address": "fa:16:3e:8e:1c:6e", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68e8044e-0d", "ovs_interfaceid": "68e8044e-0d86-4309-938c-f00d2c392440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a1b5f855-9d48-4256-8f7d-8959ec0f4546 req-ed0347f4-c307-405e-a0b0-ff1d43ebb160 service nova] Releasing lock "refresh_cache-b7f6e347-c1f3-4f56-86c4-3b28c4729964" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:45:57 user nova-compute[73104]: INFO nova.compute.manager [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Took 0.85 seconds to detach 1 volumes for instance.
Aug 26 08:45:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:45:58 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:45:58 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:45:58 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=7766MB free_disk=24.461196899414062GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 08:45:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:58 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:45:58 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:45:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.698s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.219s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:58 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Deleted allocations for instance 385c6d93-907d-42d7-9b43-479e6caf66f9
Aug 26 08:45:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-07f91080-0ea4-456e-9b93-2612c137759a tempest-ServerActionsTestOtherB-905162429 tempest-ServerActionsTestOtherB-905162429-project-member] Lock "385c6d93-907d-42d7-9b43-479e6caf66f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.406s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:58 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance b5e1f82c-5675-4c37-8ba2-44e6a341a576 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:45:58 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 24fbf9f0-c459-4d24-b0ff-b25281378f52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:45:58 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 3cf85d2f-de0d-4e9b-a534-98c799ae8db9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:45:58 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:45:58 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance c3b4c644-f7f3-4304-b732-9f43cfeac2bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:45:58 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 02665c70-cf75-44ba-9d90-eb9e5f12e0b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:45:58 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance b7f6e347-c1f3-4f56-86c4-3b28c4729964 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:45:58 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 08:45:58 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 08:45:58 user nova-compute[73104]: DEBUG nova.compute.manager [req-0ebef101-8608-458c-b77b-2a87d5d72168 req-6d1e58d2-c25e-4a43-ae29-98f6dcacfd74 service nova] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Received event network-vif-deleted-d4692900-c165-487d-9847-383fcf1d2270 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:45:58 user nova-compute[73104]: DEBUG nova.compute.manager [req-19d9d55c-2ccc-430c-8465-19eb1e2bac42 req-3703417b-f6a9-4191-8e07-5f459cc4d115 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Received event network-vif-plugged-68e8044e-0d86-4309-938c-f00d2c392440 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:45:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-19d9d55c-2ccc-430c-8465-19eb1e2bac42 req-3703417b-f6a9-4191-8e07-5f459cc4d115 service nova] Acquiring lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:45:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-19d9d55c-2ccc-430c-8465-19eb1e2bac42 req-3703417b-f6a9-4191-8e07-5f459cc4d115 service nova] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:45:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-19d9d55c-2ccc-430c-8465-19eb1e2bac42 req-3703417b-f6a9-4191-8e07-5f459cc4d115 service nova] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:45:58 user nova-compute[73104]: DEBUG nova.compute.manager [req-19d9d55c-2ccc-430c-8465-19eb1e2bac42 req-3703417b-f6a9-4191-8e07-5f459cc4d115 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] No waiting events found dispatching network-vif-plugged-68e8044e-0d86-4309-938c-f00d2c392440 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:45:58 user nova-compute[73104]: WARNING nova.compute.manager [req-19d9d55c-2ccc-430c-8465-19eb1e2bac42 req-3703417b-f6a9-4191-8e07-5f459cc4d115 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Received unexpected event network-vif-plugged-68e8044e-0d86-4309-938c-f00d2c392440 for instance with vm_state building and task_state spawning.
Aug 26 08:45:58 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:45:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:45:58 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:45:58 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 08:45:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.449s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:46:00 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039560.8252642, b7f6e347-c1f3-4f56-86c4-3b28c4729964 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:46:00 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] VM Resumed (Lifecycle Event)
Aug 26 08:46:00 user nova-compute[73104]: DEBUG nova.compute.manager [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:46:00 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:46:00 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Instance spawned successfully.
Aug 26 08:46:00 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:46:00 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:46:00 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:46:00 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:46:00 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:46:00 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:46:00 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:46:00 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:46:00 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:46:00 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:46:00 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039560.8303945, b7f6e347-c1f3-4f56-86c4-3b28c4729964 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:46:00 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] VM Started (Lifecycle Event)
Aug 26 08:46:00 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:46:00 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:46:00 user nova-compute[73104]: DEBUG nova.compute.manager [req-2d8e011e-5461-4726-a340-bd3b033877ad req-a366ac87-b07d-417e-8954-d7ec4cbde8da service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Received event network-vif-plugged-68e8044e-0d86-4309-938c-f00d2c392440 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:46:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2d8e011e-5461-4726-a340-bd3b033877ad req-a366ac87-b07d-417e-8954-d7ec4cbde8da service nova] Acquiring lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:46:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2d8e011e-5461-4726-a340-bd3b033877ad req-a366ac87-b07d-417e-8954-d7ec4cbde8da service nova] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:46:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2d8e011e-5461-4726-a340-bd3b033877ad req-a366ac87-b07d-417e-8954-d7ec4cbde8da service nova] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:46:00 user nova-compute[73104]: DEBUG nova.compute.manager [req-2d8e011e-5461-4726-a340-bd3b033877ad req-a366ac87-b07d-417e-8954-d7ec4cbde8da service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] No waiting events found dispatching network-vif-plugged-68e8044e-0d86-4309-938c-f00d2c392440 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:46:00 user nova-compute[73104]: WARNING nova.compute.manager [req-2d8e011e-5461-4726-a340-bd3b033877ad req-a366ac87-b07d-417e-8954-d7ec4cbde8da service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Received unexpected event network-vif-plugged-68e8044e-0d86-4309-938c-f00d2c392440 for instance with vm_state building and task_state spawning.
Aug 26 08:46:01 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:46:01 user nova-compute[73104]: INFO nova.compute.manager [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Took 6.03 seconds to spawn the instance on the hypervisor.
Aug 26 08:46:01 user nova-compute[73104]: DEBUG nova.compute.manager [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:46:01 user nova-compute[73104]: INFO nova.compute.manager [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Took 6.99 seconds to build instance.
Aug 26 08:46:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-25476259-46a8-4cb6-87c9-bacda3610d36 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.117s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:46:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fd454fb5-f5b0-4989-ab85-7848ce25ef93 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Acquiring lock "24fbf9f0-c459-4d24-b0ff-b25281378f52" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fd454fb5-f5b0-4989-ab85-7848ce25ef93 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "24fbf9f0-c459-4d24-b0ff-b25281378f52" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:46:05 user nova-compute[73104]: INFO nova.compute.manager [None req-fd454fb5-f5b0-4989-ab85-7848ce25ef93 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Detaching volume d135f05c-eb85-4439-b321-b61fd9a0e0e2
Aug 26 08:46:05 user nova-compute[73104]: INFO nova.virt.block_device [None req-fd454fb5-f5b0-4989-ab85-7848ce25ef93 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Attempting to driver detach volume d135f05c-eb85-4439-b321-b61fd9a0e0e2 from mountpoint /dev/vdb
Aug 26 08:46:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Acquiring lock "24fbf9f0-c459-4d24-b0ff-b25281378f52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fd454fb5-f5b0-4989-ab85-7848ce25ef93 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Attempting to detach device vdb from instance 24fbf9f0-c459-4d24-b0ff-b25281378f52 from the persistent domain config. {{(pid=73104) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-fd454fb5-f5b0-4989-ab85-7848ce25ef93 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:46:05 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:46:05 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 08:46:05 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:46:05 user nova-compute[73104]:   <serial>d135f05c-eb85-4439-b321-b61fd9a0e0e2</serial>
Aug 26 08:46:05 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 08:46:05 user nova-compute[73104]: </disk>
Aug 26 08:46:05 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:46:05 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-fd454fb5-f5b0-4989-ab85-7848ce25ef93 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Successfully detached device vdb from instance 24fbf9f0-c459-4d24-b0ff-b25281378f52 from the persistent domain config.
Aug 26 08:46:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fd454fb5-f5b0-4989-ab85-7848ce25ef93 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 24fbf9f0-c459-4d24-b0ff-b25281378f52 from the live domain config. {{(pid=73104) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-fd454fb5-f5b0-4989-ab85-7848ce25ef93 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:46:05 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:46:05 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 08:46:05 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:46:05 user nova-compute[73104]:   <serial>d135f05c-eb85-4439-b321-b61fd9a0e0e2</serial>
Aug 26 08:46:05 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 08:46:05 user nova-compute[73104]: </disk>
Aug 26 08:46:05 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Received event <DeviceRemovedEvent: 1693039565.7936625, 24fbf9f0-c459-4d24-b0ff-b25281378f52 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73104) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fd454fb5-f5b0-4989-ab85-7848ce25ef93 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 24fbf9f0-c459-4d24-b0ff-b25281378f52 {{(pid=73104) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 08:46:05 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-fd454fb5-f5b0-4989-ab85-7848ce25ef93 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Successfully detached device vdb from instance 24fbf9f0-c459-4d24-b0ff-b25281378f52 from the live domain config.
Aug 26 08:46:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd454fb5-f5b0-4989-ab85-7848ce25ef93 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd454fb5-f5b0-4989-ab85-7848ce25ef93 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJIeMLoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:46:05 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-fd454fb5-f5b0-4989-ab85-7848ce25ef93 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:46:05 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-fd454fb5-f5b0-4989-ab85-7848ce25ef93 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-fd454fb5-f5b0-4989-ab85-7848ce25ef93 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd454fb5-f5b0-4989-ab85-7848ce25ef93 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad741ca5-cb72-4a68-ac5d-3c59dffa0eb2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1543731-75ae-4ac4-b451-3702e3accc57]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd454fb5-f5b0-4989-ab85-7848ce25ef93 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2 (non-flash)
Aug 26 08:46:05 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd454fb5-f5b0-4989-ab85-7848ce25ef93 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2 (non-flash)
Aug 26 08:46:05 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd454fb5-f5b0-4989-ab85-7848ce25ef93 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0cc296710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2'): ({'sdb'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-fd454fb5-f5b0-4989-ab85-7848ce25ef93 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Removing single pathed devices sdb {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf287b08-68dd-4ebf-84e6-31bb38244e55]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb8dd89-97dc-42f1-b702-20d01355f85d]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-fd454fb5-f5b0-4989-ab85-7848ce25ef93 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Flushing IO for device /dev/sdb {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cef18f-725d-47f9-8795-c8e68a104cbc]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-fd454fb5-f5b0-4989-ab85-7848ce25ef93 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[286297e7-1952-47de-b5ce-05df7c0b476a]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-fd454fb5-f5b0-4989-ab85-7848ce25ef93 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-fd454fb5-f5b0-4989-ab85-7848ce25ef93 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd454fb5-f5b0-4989-ab85-7848ce25ef93 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:46:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:06 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e886d5-c735-4972-97a5-a345f0b034f2]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:06 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd454fb5-f5b0-4989-ab85-7848ce25ef93 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:46:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.103s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:06 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39f68fc-780b-4bc8-966e-2a174c9129d4]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:06 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd454fb5-f5b0-4989-ab85-7848ce25ef93 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2, portal: 172.16.0.220,3260]
Aug 26 08:46:06 user nova-compute[73104]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2, portal: 172.16.0.220,3260] successful.
Aug 26 08:46:06 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:46:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:06 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ec76d7-089b-4bc5-b1ba-fe9c3de43449]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:06 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd454fb5-f5b0-4989-ab85-7848ce25ef93 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:46:06 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-fd454fb5-f5b0-4989-ab85-7848ce25ef93 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:46:06 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd454fb5-f5b0-4989-ab85-7848ce25ef93 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] <== disconnect_volume: return (330ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:46:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd454fb5-f5b0-4989-ab85-7848ce25ef93 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:46:06 user nova-compute[73104]: DEBUG nova.objects.instance [None req-fd454fb5-f5b0-4989-ab85-7848ce25ef93 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lazy-loading 'flavor' on Instance uuid 24fbf9f0-c459-4d24-b0ff-b25281378f52 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fd454fb5-f5b0-4989-ab85-7848ce25ef93 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "24fbf9f0-c459-4d24-b0ff-b25281378f52" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.884s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "24fbf9f0-c459-4d24-b0ff-b25281378f52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.731s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Acquiring lock "24fbf9f0-c459-4d24-b0ff-b25281378f52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "24fbf9f0-c459-4d24-b0ff-b25281378f52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "24fbf9f0-c459-4d24-b0ff-b25281378f52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:46:07 user nova-compute[73104]: INFO nova.compute.manager [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Terminating instance
Aug 26 08:46:07 user nova-compute[73104]: DEBUG nova.compute.manager [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG nova.compute.manager [req-9672af20-0326-4750-8593-a29f580dcc8b req-22d2787f-4980-4756-bb62-c3da9bc8f813 service nova] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Received event network-vif-unplugged-693629a9-d0ad-4257-8160-901fccb6f3fd {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9672af20-0326-4750-8593-a29f580dcc8b req-22d2787f-4980-4756-bb62-c3da9bc8f813 service nova] Acquiring lock "24fbf9f0-c459-4d24-b0ff-b25281378f52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9672af20-0326-4750-8593-a29f580dcc8b req-22d2787f-4980-4756-bb62-c3da9bc8f813 service nova] Lock "24fbf9f0-c459-4d24-b0ff-b25281378f52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9672af20-0326-4750-8593-a29f580dcc8b req-22d2787f-4980-4756-bb62-c3da9bc8f813 service nova] Lock "24fbf9f0-c459-4d24-b0ff-b25281378f52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG nova.compute.manager [req-9672af20-0326-4750-8593-a29f580dcc8b req-22d2787f-4980-4756-bb62-c3da9bc8f813 service nova] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] No waiting events found dispatching network-vif-unplugged-693629a9-d0ad-4257-8160-901fccb6f3fd {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG nova.compute.manager [req-9672af20-0326-4750-8593-a29f580dcc8b req-22d2787f-4980-4756-bb62-c3da9bc8f813 service nova] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Received event network-vif-unplugged-693629a9-d0ad-4257-8160-901fccb6f3fd for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:07 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Instance destroyed successfully.
Aug 26 08:46:07 user nova-compute[73104]: DEBUG nova.objects.instance [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lazy-loading 'resources' on Instance uuid 24fbf9f0-c459-4d24-b0ff-b25281378f52 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:43:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1467979521',display_name='tempest-VolumesSnapshotTestJSON-instance-1467979521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1467979521',id=18,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxVtrRSezPYPY+Gbqr1llM3nb4T8ykUog6/jBtBYtycYtt0mtjKKQ9GMlHhymtJJmEdnT+Vrqdkk5RhZF+X7yLO2Jp8jtESlA8tcTfvdepMrD3gg8sm41JWH5MMR1xxOw==',key_name='tempest-keypair-1570730096',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:43:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6cbb61cb896e4b3cbbdc04d82df1cea9',ramdisk_id='',reservation_id='r-v55gezhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1828823155',owner_user_name='tempest-VolumesSnapshotTestJSON-1828823155-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:43:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aca885fd82294677abf751087bcfc5e1',uuid=24fbf9f0-c459-4d24-b0ff-b25281378f52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "693629a9-d0ad-4257-8160-901fccb6f3fd", "address": "fa:16:3e:02:20:11", "network": {"id": "84dc5f73-5b46-4788-8e58-69d57f2f089f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-856831086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbb61cb896e4b3cbbdc04d82df1cea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693629a9-d0", "ovs_interfaceid": "693629a9-d0ad-4257-8160-901fccb6f3fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Converting VIF {"id": "693629a9-d0ad-4257-8160-901fccb6f3fd", "address": "fa:16:3e:02:20:11", "network": {"id": "84dc5f73-5b46-4788-8e58-69d57f2f089f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-856831086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbb61cb896e4b3cbbdc04d82df1cea9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693629a9-d0", "ovs_interfaceid": "693629a9-d0ad-4257-8160-901fccb6f3fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:20:11,bridge_name='br-int',has_traffic_filtering=True,id=693629a9-d0ad-4257-8160-901fccb6f3fd,network=Network(84dc5f73-5b46-4788-8e58-69d57f2f089f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693629a9-d0') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG os_vif [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:20:11,bridge_name='br-int',has_traffic_filtering=True,id=693629a9-d0ad-4257-8160-901fccb6f3fd,network=Network(84dc5f73-5b46-4788-8e58-69d57f2f089f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693629a9-d0') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap693629a9-d0, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:07 user nova-compute[73104]: INFO os_vif [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:20:11,bridge_name='br-int',has_traffic_filtering=True,id=693629a9-d0ad-4257-8160-901fccb6f3fd,network=Network(84dc5f73-5b46-4788-8e58-69d57f2f089f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693629a9-d0')
Aug 26 08:46:07 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJIeMLoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:46:07 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:46:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d135f05c-eb85-4439-b321-b61fd9a0e0e2', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[59017dc2-336e-4ce5-901a-61ed381096c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:07 user nova-compute[73104]: WARNING os_brick.initiator.connectors.iscsi [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 26 08:46:07 user nova-compute[73104]: 
Aug 26 08:46:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a5f9fc-a1f2-415c-88fa-58a4a5d9adc1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 08:46:07 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 08:46:07 user nova-compute[73104]:  {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:46:07 user nova-compute[73104]: WARNING os_brick.initiator.connectors.iscsi [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 08:46:07 user nova-compute[73104]: 
Aug 26 08:46:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0c418fd00>, {}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Disconnecting from: [] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.051s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] <== disconnect_volume: return (52ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:46:07 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:46:07 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Deleting instance files /opt/stack/data/nova/instances/24fbf9f0-c459-4d24-b0ff-b25281378f52_del
Aug 26 08:46:07 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Deletion of /opt/stack/data/nova/instances/24fbf9f0-c459-4d24-b0ff-b25281378f52_del complete
Aug 26 08:46:08 user nova-compute[73104]: INFO nova.compute.manager [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 26 08:46:08 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 08:46:08 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 08:46:08 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 08:46:08 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693039553.331767, dcec7631-b94f-4dbf-b85d-e8ad9c6396b7 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:46:08 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] VM Stopped (Lifecycle Event)
Aug 26 08:46:08 user nova-compute[73104]: DEBUG nova.compute.manager [None req-5bea18a9-5910-4695-9129-e65803d90a8a None None] [instance: dcec7631-b94f-4dbf-b85d-e8ad9c6396b7] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:46:08 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:46:08 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Took 0.84 seconds to deallocate network for instance.
Aug 26 08:46:08 user nova-compute[73104]: WARNING nova.volume.cinder [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Attachment eff2dcfb-2199-450c-81cf-0e19bbfe270e does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = eff2dcfb-2199-450c-81cf-0e19bbfe270e. (HTTP 404) (Request-ID: req-fd5097b5-f46e-46b4-b6f3-2c98a193d836)
Aug 26 08:46:08 user nova-compute[73104]: INFO nova.compute.manager [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Took 0.02 seconds to detach 1 volumes for instance.
Aug 26 08:46:08 user nova-compute[73104]: DEBUG nova.compute.manager [req-a0581a94-3e41-4ae4-9bcd-1b56f6146b20 req-c7237dc1-245f-4d7b-a6a1-8d313c8be554 service nova] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Received event network-vif-deleted-693629a9-d0ad-4257-8160-901fccb6f3fd {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:46:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:46:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:46:09 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:46:09 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:46:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:46:09 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Deleted allocations for instance 24fbf9f0-c459-4d24-b0ff-b25281378f52
Aug 26 08:46:09 user nova-compute[73104]: DEBUG nova.compute.manager [req-9d451c9a-d7d3-4479-b852-b8fb04dc5890 req-09641214-8b96-433f-9f05-158989908099 service nova] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Received event network-vif-plugged-693629a9-d0ad-4257-8160-901fccb6f3fd {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:46:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9d451c9a-d7d3-4479-b852-b8fb04dc5890 req-09641214-8b96-433f-9f05-158989908099 service nova] Acquiring lock "24fbf9f0-c459-4d24-b0ff-b25281378f52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:46:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9d451c9a-d7d3-4479-b852-b8fb04dc5890 req-09641214-8b96-433f-9f05-158989908099 service nova] Lock "24fbf9f0-c459-4d24-b0ff-b25281378f52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:46:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9d451c9a-d7d3-4479-b852-b8fb04dc5890 req-09641214-8b96-433f-9f05-158989908099 service nova] Lock "24fbf9f0-c459-4d24-b0ff-b25281378f52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:46:09 user nova-compute[73104]: DEBUG nova.compute.manager [req-9d451c9a-d7d3-4479-b852-b8fb04dc5890 req-09641214-8b96-433f-9f05-158989908099 service nova] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] No waiting events found dispatching network-vif-plugged-693629a9-d0ad-4257-8160-901fccb6f3fd {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:46:09 user nova-compute[73104]: WARNING nova.compute.manager [req-9d451c9a-d7d3-4479-b852-b8fb04dc5890 req-09641214-8b96-433f-9f05-158989908099 service nova] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Received unexpected event network-vif-plugged-693629a9-d0ad-4257-8160-901fccb6f3fd for instance with vm_state deleted and task_state None.
Aug 26 08:46:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-94b1f966-f531-493d-8383-f33a8caf4b88 tempest-VolumesSnapshotTestJSON-1828823155 tempest-VolumesSnapshotTestJSON-1828823155-project-member] Lock "24fbf9f0-c459-4d24-b0ff-b25281378f52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.380s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:46:10 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693039555.0324233, 385c6d93-907d-42d7-9b43-479e6caf66f9 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:46:10 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] VM Stopped (Lifecycle Event)
Aug 26 08:46:10 user nova-compute[73104]: DEBUG nova.compute.manager [None req-a2486d23-36d1-4bbc-bbef-7154951a5e21 None None] [instance: 385c6d93-907d-42d7-9b43-479e6caf66f9] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:46:11 user nova-compute[73104]: DEBUG nova.compute.manager [req-344dc768-aac7-45a9-81ec-1ef72fab5e1e req-437a207a-f135-4c48-b752-1943f219150d service nova] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Received event network-changed-4d938630-3013-4a42-b02d-cb0dd75e436c {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:46:11 user nova-compute[73104]: DEBUG nova.compute.manager [req-344dc768-aac7-45a9-81ec-1ef72fab5e1e req-437a207a-f135-4c48-b752-1943f219150d service nova] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Refreshing instance network info cache due to event network-changed-4d938630-3013-4a42-b02d-cb0dd75e436c. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:46:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-344dc768-aac7-45a9-81ec-1ef72fab5e1e req-437a207a-f135-4c48-b752-1943f219150d service nova] Acquiring lock "refresh_cache-86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:46:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-344dc768-aac7-45a9-81ec-1ef72fab5e1e req-437a207a-f135-4c48-b752-1943f219150d service nova] Acquired lock "refresh_cache-86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:46:11 user nova-compute[73104]: DEBUG nova.network.neutron [req-344dc768-aac7-45a9-81ec-1ef72fab5e1e req-437a207a-f135-4c48-b752-1943f219150d service nova] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Refreshing network info cache for port 4d938630-3013-4a42-b02d-cb0dd75e436c {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:46:11 user nova-compute[73104]: DEBUG nova.network.neutron [req-344dc768-aac7-45a9-81ec-1ef72fab5e1e req-437a207a-f135-4c48-b752-1943f219150d service nova] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Updated VIF entry in instance network info cache for port 4d938630-3013-4a42-b02d-cb0dd75e436c. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:46:11 user nova-compute[73104]: DEBUG nova.network.neutron [req-344dc768-aac7-45a9-81ec-1ef72fab5e1e req-437a207a-f135-4c48-b752-1943f219150d service nova] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Updating instance_info_cache with network_info: [{"id": "4d938630-3013-4a42-b02d-cb0dd75e436c", "address": "fa:16:3e:85:52:72", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d938630-30", "ovs_interfaceid": "4d938630-3013-4a42-b02d-cb0dd75e436c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:46:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-344dc768-aac7-45a9-81ec-1ef72fab5e1e req-437a207a-f135-4c48-b752-1943f219150d service nova] Releasing lock "refresh_cache-86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:46:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:46:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:46:14 user nova-compute[73104]: DEBUG nova.objects.instance [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lazy-loading 'flavor' on Instance uuid 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:46:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:46:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:46:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:46:15 user nova-compute[73104]: INFO nova.compute.manager [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Attaching volume beebe8d6-b4c2-4d2c-9279-2d606d195b47 to /dev/vdb
Aug 26 08:46:15 user nova-compute[73104]: DEBUG os_brick.utils [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:46:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:15 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a67b9a-0195-462a-bbc3-064a2d15d3fa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:15 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2962e589-7fc3-4e83-a034-c50b7894148d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:15 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6421e1-b377-4c56-842f-93833d8d96e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:15 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78ec25b-58e2-4b6f-bf5d-f015e35b0aa4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:46:15 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:46:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:46:15 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:46:15 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[694991d4-3843-433f-8ea4-274be8beb190]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:15 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:46:15 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:46:15 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:46:15 user nova-compute[73104]: DEBUG os_brick.utils [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:46:15 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Updating existing volume attachment record: 026d576b-6a94-475b-b83d-c30585f5667e {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 08:46:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:22 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693039567.8558505, 24fbf9f0-c459-4d24-b0ff-b25281378f52 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:46:22 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] VM Stopped (Lifecycle Event)
Aug 26 08:46:22 user nova-compute[73104]: DEBUG nova.compute.manager [None req-ff52dc5f-dadf-4531-abb7-a9d091750747 None None] [instance: 24fbf9f0-c459-4d24-b0ff-b25281378f52] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:46:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-5a4464d6-2c2e-4a24-9949-03de7e1698e4 req-5a68ca53-887d-483f-91da-fb5952dc3965 service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Received event network-changed-cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:46:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-5a4464d6-2c2e-4a24-9949-03de7e1698e4 req-5a68ca53-887d-483f-91da-fb5952dc3965 service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Refreshing instance network info cache due to event network-changed-cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:46:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5a4464d6-2c2e-4a24-9949-03de7e1698e4 req-5a68ca53-887d-483f-91da-fb5952dc3965 service nova] Acquiring lock "refresh_cache-c3b4c644-f7f3-4304-b732-9f43cfeac2bb" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:46:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5a4464d6-2c2e-4a24-9949-03de7e1698e4 req-5a68ca53-887d-483f-91da-fb5952dc3965 service nova] Acquired lock "refresh_cache-c3b4c644-f7f3-4304-b732-9f43cfeac2bb" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:46:23 user nova-compute[73104]: DEBUG nova.network.neutron [req-5a4464d6-2c2e-4a24-9949-03de7e1698e4 req-5a68ca53-887d-483f-91da-fb5952dc3965 service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Refreshing network info cache for port cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:46:23 user nova-compute[73104]: DEBUG nova.network.neutron [req-5a4464d6-2c2e-4a24-9949-03de7e1698e4 req-5a68ca53-887d-483f-91da-fb5952dc3965 service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Updated VIF entry in instance network info cache for port cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:46:23 user nova-compute[73104]: DEBUG nova.network.neutron [req-5a4464d6-2c2e-4a24-9949-03de7e1698e4 req-5a68ca53-887d-483f-91da-fb5952dc3965 service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Updating instance_info_cache with network_info: [{"id": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "address": "fa:16:3e:4c:c9:02", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc2c1a60-58", "ovs_interfaceid": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:46:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5a4464d6-2c2e-4a24-9949-03de7e1698e4 req-5a68ca53-887d-483f-91da-fb5952dc3965 service nova] Releasing lock "refresh_cache-c3b4c644-f7f3-4304-b732-9f43cfeac2bb" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:46:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PsbwJWkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:46:26 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:46:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:46:26 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:46:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:46:26 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:46:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7e654b-b50f-4349-9d89-d0bdd613ee89]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:46:26 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5122e28b-d278-4976-a2fb-16ec97203f67]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47] added
Aug 26 08:46:26 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b178b0ef-e9a7-4e31-970a-7ae0dd917acf]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d694df-c346-4e51-9ba5-8ad8fb704283]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PsbwJWkg {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PsbwJWkg" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c737e3c4-ba89-42b9-854f-6aacc10dcd3d]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PsbwJWkg'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e4f340-d771-4788-8871-5438e12b159e]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc74279-b44c-4e09-8388-50933eede3b8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 08:46:26 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 08:46:26 user nova-compute[73104]:  {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:46:26 user nova-compute[73104]: WARNING os_brick.initiator.connectors.iscsi [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 08:46:26 user nova-compute[73104]: 
Aug 26 08:46:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4b3a08-36ae-4606-b7b8-887e3582c2ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47, portal: 172.16.0.220,3260]
Aug 26 08:46:26 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47, portal: 172.16.0.220,3260] successful.
Aug 26 08:46:26 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[824b0d3a-a310-474b-b550-71bf838dffc6]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e41ba02-6842-4e9b-890b-aa0eeb3b3fb5]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47 (non-flash)
Aug 26 08:46:26 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47 (non-flash)
Aug 26 08:46:26 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b78281b-b68d-4548-9940-df932c429f55]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:26 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: None {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:46:27 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:46:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PsbwJWkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:46:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:46:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23664666330383536', 'path': '/dev/sdb'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:46:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664666330383536', 'path': '/dev/sdb'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:46:27 user nova-compute[73104]: DEBUG nova.objects.instance [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lazy-loading 'flavor' on Instance uuid 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:46:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 08:46:27 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:46:27 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 08:46:27 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:46:27 user nova-compute[73104]:   <serial>beebe8d6-b4c2-4d2c-9279-2d606d195b47</serial>
Aug 26 08:46:27 user nova-compute[73104]: </disk>
Aug 26 08:46:27 user nova-compute[73104]:  {{(pid=73104) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 08:46:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:46:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:46:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] No VIF found with MAC fa:16:3e:85:52:72, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:46:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fdc328e3-2a94-41d3-8976-10ad881e61f5 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.281s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:46:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c2564a7a-8034-4695-a822-e9d2e4aea3e2 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:46:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c2564a7a-8034-4695-a822-e9d2e4aea3e2 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:46:29 user nova-compute[73104]: INFO nova.compute.manager [None req-c2564a7a-8034-4695-a822-e9d2e4aea3e2 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Shelving
Aug 26 08:46:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7f0d1e27-f5fc-49f3-abe2-ae7ad63dbbd9 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:46:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7f0d1e27-f5fc-49f3-abe2-ae7ad63dbbd9 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:46:29 user nova-compute[73104]: INFO nova.compute.manager [None req-7f0d1e27-f5fc-49f3-abe2-ae7ad63dbbd9 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Detaching volume beebe8d6-b4c2-4d2c-9279-2d606d195b47
Aug 26 08:46:29 user nova-compute[73104]: INFO nova.virt.block_device [None req-7f0d1e27-f5fc-49f3-abe2-ae7ad63dbbd9 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Attempting to driver detach volume beebe8d6-b4c2-4d2c-9279-2d606d195b47 from mountpoint /dev/vdb
Aug 26 08:46:29 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-7f0d1e27-f5fc-49f3-abe2-ae7ad63dbbd9 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Attempting to detach device vdb from instance 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d from the persistent domain config. {{(pid=73104) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 08:46:29 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-7f0d1e27-f5fc-49f3-abe2-ae7ad63dbbd9 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:46:29 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:46:29 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 08:46:29 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:46:29 user nova-compute[73104]:   <serial>beebe8d6-b4c2-4d2c-9279-2d606d195b47</serial>
Aug 26 08:46:29 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 08:46:29 user nova-compute[73104]: </disk>
Aug 26 08:46:29 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:46:29 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-7f0d1e27-f5fc-49f3-abe2-ae7ad63dbbd9 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Successfully detached device vdb from instance 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d from the persistent domain config.
Aug 26 08:46:29 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-7f0d1e27-f5fc-49f3-abe2-ae7ad63dbbd9 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d from the live domain config. {{(pid=73104) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 08:46:29 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-7f0d1e27-f5fc-49f3-abe2-ae7ad63dbbd9 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:46:29 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:46:29 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 08:46:29 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:46:29 user nova-compute[73104]:   <serial>beebe8d6-b4c2-4d2c-9279-2d606d195b47</serial>
Aug 26 08:46:29 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 08:46:29 user nova-compute[73104]: </disk>
Aug 26 08:46:29 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:46:29 user nova-compute[73104]: DEBUG nova.compute.manager [req-32751f1d-6372-404a-b06b-968d3c111162 req-af367e06-63de-4e00-a2bd-0a526a39e6b0 service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Received event network-vif-unplugged-cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:46:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-32751f1d-6372-404a-b06b-968d3c111162 req-af367e06-63de-4e00-a2bd-0a526a39e6b0 service nova] Acquiring lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:46:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-32751f1d-6372-404a-b06b-968d3c111162 req-af367e06-63de-4e00-a2bd-0a526a39e6b0 service nova] Lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:46:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-32751f1d-6372-404a-b06b-968d3c111162 req-af367e06-63de-4e00-a2bd-0a526a39e6b0 service nova] Lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:46:29 user nova-compute[73104]: DEBUG nova.compute.manager [req-32751f1d-6372-404a-b06b-968d3c111162 req-af367e06-63de-4e00-a2bd-0a526a39e6b0 service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] No waiting events found dispatching network-vif-unplugged-cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:46:29 user nova-compute[73104]: WARNING nova.compute.manager [req-32751f1d-6372-404a-b06b-968d3c111162 req-af367e06-63de-4e00-a2bd-0a526a39e6b0 service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Received unexpected event network-vif-unplugged-cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 for instance with vm_state active and task_state shelving.
Aug 26 08:46:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Received event <DeviceRemovedEvent: 1693039590.5969129, 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73104) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-7f0d1e27-f5fc-49f3-abe2-ae7ad63dbbd9 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d {{(pid=73104) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 08:46:30 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-7f0d1e27-f5fc-49f3-abe2-ae7ad63dbbd9 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Successfully detached device vdb from instance 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d from the live domain config.
Aug 26 08:46:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f0d1e27-f5fc-49f3-abe2-ae7ad63dbbd9 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0d1e27-f5fc-49f3-abe2-ae7ad63dbbd9 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PsbwJWkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:46:30 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-7f0d1e27-f5fc-49f3-abe2-ae7ad63dbbd9 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:46:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-7f0d1e27-f5fc-49f3-abe2-ae7ad63dbbd9 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-7f0d1e27-f5fc-49f3-abe2-ae7ad63dbbd9 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0d1e27-f5fc-49f3-abe2-ae7ad63dbbd9 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:30 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Instance destroyed successfully.
Aug 26 08:46:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[530e8e9e-08c6-430b-b9c5-aba8e41470cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4969e57-37c3-4c64-a1e1-a9a1e62998b7]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0d1e27-f5fc-49f3-abe2-ae7ad63dbbd9 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47 (non-flash)
Aug 26 08:46:30 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0d1e27-f5fc-49f3-abe2-ae7ad63dbbd9 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47 (non-flash)
Aug 26 08:46:30 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0d1e27-f5fc-49f3-abe2-ae7ad63dbbd9 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0c4184790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47'): ({'sdb'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-7f0d1e27-f5fc-49f3-abe2-ae7ad63dbbd9 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Removing single pathed devices sdb {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:30 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-c2564a7a-8034-4695-a822-e9d2e4aea3e2 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Beginning cold snapshot process
Aug 26 08:46:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[549f8905-e7ce-47bc-895d-8ef1687bfa03]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af5fcf6-3d54-4f8f-b6c7-8bbc88859e55]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-7f0d1e27-f5fc-49f3-abe2-ae7ad63dbbd9 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Flushing IO for device /dev/sdb {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24cb47a-d725-4987-8b95-e1b073619f64]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-7f0d1e27-f5fc-49f3-abe2-ae7ad63dbbd9 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cd8f6c-59e0-43d0-8997-98042f5ccb61]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-7f0d1e27-f5fc-49f3-abe2-ae7ad63dbbd9 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-7f0d1e27-f5fc-49f3-abe2-ae7ad63dbbd9 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0d1e27-f5fc-49f3-abe2-ae7ad63dbbd9 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf87f3c6-d8d3-4af8-abf1-ec764df8db99]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0d1e27-f5fc-49f3-abe2-ae7ad63dbbd9 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG nova.privsep.utils [None req-c2564a7a-8034-4695-a822-e9d2e4aea3e2 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73104) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c2564a7a-8034-4695-a822-e9d2e4aea3e2 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk /opt/stack/data/nova/instances/snapshots/tmpm4ltx5f7/af3594a409a04c03bd5ab2053f7950b3 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8adc65b-60e3-4f81-a5c0-a4d65e43e7c0]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0d1e27-f5fc-49f3-abe2-ae7ad63dbbd9 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47, portal: 172.16.0.220,3260]
Aug 26 08:46:30 user nova-compute[73104]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47, portal: 172.16.0.220,3260] successful.
Aug 26 08:46:30 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beebe8d6-b4c2-4d2c-9279-2d606d195b47 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02b0e0f-50e7-4a64-9061-d27d85ec4366]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0d1e27-f5fc-49f3-abe2-ae7ad63dbbd9 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-7f0d1e27-f5fc-49f3-abe2-ae7ad63dbbd9 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0d1e27-f5fc-49f3-abe2-ae7ad63dbbd9 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] <== disconnect_volume: return (324ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:46:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f0d1e27-f5fc-49f3-abe2-ae7ad63dbbd9 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:46:31 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c2564a7a-8034-4695-a822-e9d2e4aea3e2 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk /opt/stack/data/nova/instances/snapshots/tmpm4ltx5f7/af3594a409a04c03bd5ab2053f7950b3" returned: 0 in 1.066s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:31 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-c2564a7a-8034-4695-a822-e9d2e4aea3e2 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Snapshot extracted, beginning image upload
Aug 26 08:46:31 user nova-compute[73104]: DEBUG nova.compute.manager [req-ad27ac64-26c2-4bb0-ab7b-2d5fbaa3e98a req-12bf6614-d5cb-4e46-9e2f-6260f3625fb3 service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Received event network-vif-plugged-cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:46:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ad27ac64-26c2-4bb0-ab7b-2d5fbaa3e98a req-12bf6614-d5cb-4e46-9e2f-6260f3625fb3 service nova] Acquiring lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:46:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ad27ac64-26c2-4bb0-ab7b-2d5fbaa3e98a req-12bf6614-d5cb-4e46-9e2f-6260f3625fb3 service nova] Lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:46:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ad27ac64-26c2-4bb0-ab7b-2d5fbaa3e98a req-12bf6614-d5cb-4e46-9e2f-6260f3625fb3 service nova] Lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:46:31 user nova-compute[73104]: DEBUG nova.compute.manager [req-ad27ac64-26c2-4bb0-ab7b-2d5fbaa3e98a req-12bf6614-d5cb-4e46-9e2f-6260f3625fb3 service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] No waiting events found dispatching network-vif-plugged-cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:46:31 user nova-compute[73104]: WARNING nova.compute.manager [req-ad27ac64-26c2-4bb0-ab7b-2d5fbaa3e98a req-12bf6614-d5cb-4e46-9e2f-6260f3625fb3 service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Received unexpected event network-vif-plugged-cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 for instance with vm_state active and task_state shelving_image_pending_upload.
Aug 26 08:46:32 user nova-compute[73104]: DEBUG nova.objects.instance [None req-7f0d1e27-f5fc-49f3-abe2-ae7ad63dbbd9 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lazy-loading 'flavor' on Instance uuid 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:46:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7f0d1e27-f5fc-49f3-abe2-ae7ad63dbbd9 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.455s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:46:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:34 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-c2564a7a-8034-4695-a822-e9d2e4aea3e2 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Snapshot image upload complete
Aug 26 08:46:34 user nova-compute[73104]: DEBUG nova.compute.manager [None req-c2564a7a-8034-4695-a822-e9d2e4aea3e2 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:46:34 user nova-compute[73104]: INFO nova.compute.manager [None req-c2564a7a-8034-4695-a822-e9d2e4aea3e2 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Shelve offloading
Aug 26 08:46:34 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Instance destroyed successfully.
Aug 26 08:46:34 user nova-compute[73104]: DEBUG nova.compute.manager [None req-c2564a7a-8034-4695-a822-e9d2e4aea3e2 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:46:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c2564a7a-8034-4695-a822-e9d2e4aea3e2 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "refresh_cache-c3b4c644-f7f3-4304-b732-9f43cfeac2bb" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:46:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c2564a7a-8034-4695-a822-e9d2e4aea3e2 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquired lock "refresh_cache-c3b4c644-f7f3-4304-b732-9f43cfeac2bb" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:46:34 user nova-compute[73104]: DEBUG nova.network.neutron [None req-c2564a7a-8034-4695-a822-e9d2e4aea3e2 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:46:35 user nova-compute[73104]: DEBUG nova.network.neutron [None req-c2564a7a-8034-4695-a822-e9d2e4aea3e2 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Updating instance_info_cache with network_info: [{"id": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "address": "fa:16:3e:4c:c9:02", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc2c1a60-58", "ovs_interfaceid": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:46:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c2564a7a-8034-4695-a822-e9d2e4aea3e2 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Releasing lock "refresh_cache-c3b4c644-f7f3-4304-b732-9f43cfeac2bb" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:46:35 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Instance destroyed successfully.
Aug 26 08:46:35 user nova-compute[73104]: DEBUG nova.objects.instance [None req-c2564a7a-8034-4695-a822-e9d2e4aea3e2 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lazy-loading 'resources' on Instance uuid c3b4c644-f7f3-4304-b732-9f43cfeac2bb {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:46:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-c2564a7a-8034-4695-a822-e9d2e4aea3e2 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:44:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-516733243',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-516733243',id=21,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/7E5NQLF0ppBSnaA5b97ACZ8aWxUr5RccERUW17fZtRLsaJRhM0S8cb6rnetzLx3STt8VOP73OPi/ha6ToIlMMPvS1XIkwRhm3xKLaXSSyF1T2XJJ2lMAfE/pUPfKxGA==',key_name='tempest-keypair-1461483520',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:44:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='770daa2e8b274a9b828e489c1573ced4',ramdisk_id='',reservation_id='r-7sybpznn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2062858766',owner_user_name='tempest-AttachVolumeShelveTestJSON-2062858766-project-member',shelved_at='2023-08-26T08:46:34.456103',shelved_host='user',shelved_image_id='29a2a78e-9d12-4f4c-bc12-ac86999ad7e0'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:46:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db3ae37701df47a5b35026fe3857bc51',uuid=c3b4c644-f7f3-4304-b732-9f43cfeac2bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "address": "fa:16:3e:4c:c9:02", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc2c1a60-58", "ovs_interfaceid": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:46:35 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-c2564a7a-8034-4695-a822-e9d2e4aea3e2 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Converting VIF {"id": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "address": "fa:16:3e:4c:c9:02", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc2c1a60-58", "ovs_interfaceid": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:46:35 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-c2564a7a-8034-4695-a822-e9d2e4aea3e2 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c9:02,bridge_name='br-int',has_traffic_filtering=True,id=cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03,network=Network(38f7ec35-12eb-46fe-a425-51ee854d804d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc2c1a60-58') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:46:35 user nova-compute[73104]: DEBUG os_vif [None req-c2564a7a-8034-4695-a822-e9d2e4aea3e2 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c9:02,bridge_name='br-int',has_traffic_filtering=True,id=cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03,network=Network(38f7ec35-12eb-46fe-a425-51ee854d804d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc2c1a60-58') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:46:35 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:35 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc2c1a60-58, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:46:35 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:35 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:46:35 user nova-compute[73104]: DEBUG nova.compute.manager [req-fe9ecd68-8d6a-48e8-893a-f72ddbafed4e req-7d5f6bc5-f5ac-40c1-9c28-b5f8f9ade551 service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Received event network-changed-cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:46:35 user nova-compute[73104]: DEBUG nova.compute.manager [req-fe9ecd68-8d6a-48e8-893a-f72ddbafed4e req-7d5f6bc5-f5ac-40c1-9c28-b5f8f9ade551 service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Refreshing instance network info cache due to event network-changed-cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:46:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-fe9ecd68-8d6a-48e8-893a-f72ddbafed4e req-7d5f6bc5-f5ac-40c1-9c28-b5f8f9ade551 service nova] Acquiring lock "refresh_cache-c3b4c644-f7f3-4304-b732-9f43cfeac2bb" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:46:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-fe9ecd68-8d6a-48e8-893a-f72ddbafed4e req-7d5f6bc5-f5ac-40c1-9c28-b5f8f9ade551 service nova] Acquired lock "refresh_cache-c3b4c644-f7f3-4304-b732-9f43cfeac2bb" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:46:35 user nova-compute[73104]: DEBUG nova.network.neutron [req-fe9ecd68-8d6a-48e8-893a-f72ddbafed4e req-7d5f6bc5-f5ac-40c1-9c28-b5f8f9ade551 service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Refreshing network info cache for port cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:46:35 user nova-compute[73104]: INFO os_vif [None req-c2564a7a-8034-4695-a822-e9d2e4aea3e2 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c9:02,bridge_name='br-int',has_traffic_filtering=True,id=cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03,network=Network(38f7ec35-12eb-46fe-a425-51ee854d804d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc2c1a60-58')
Aug 26 08:46:35 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-c2564a7a-8034-4695-a822-e9d2e4aea3e2 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Deleting instance files /opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb_del
Aug 26 08:46:35 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-c2564a7a-8034-4695-a822-e9d2e4aea3e2 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Deletion of /opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb_del complete
Aug 26 08:46:35 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-c2564a7a-8034-4695-a822-e9d2e4aea3e2 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Deleted allocations for instance c3b4c644-f7f3-4304-b732-9f43cfeac2bb
Aug 26 08:46:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c2564a7a-8034-4695-a822-e9d2e4aea3e2 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:46:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c2564a7a-8034-4695-a822-e9d2e4aea3e2 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:46:35 user nova-compute[73104]: DEBUG nova.objects.instance [None req-c2564a7a-8034-4695-a822-e9d2e4aea3e2 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lazy-loading 'numa_topology' on Instance uuid c3b4c644-f7f3-4304-b732-9f43cfeac2bb {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:46:35 user nova-compute[73104]: DEBUG nova.objects.base [None req-c2564a7a-8034-4695-a822-e9d2e4aea3e2 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Object Instance<c3b4c644-f7f3-4304-b732-9f43cfeac2bb> lazy-loaded attributes: resources,numa_topology {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:46:36 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:36 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-c2564a7a-8034-4695-a822-e9d2e4aea3e2 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:46:36 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-c2564a7a-8034-4695-a822-e9d2e4aea3e2 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:46:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c2564a7a-8034-4695-a822-e9d2e4aea3e2 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.245s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:46:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c2564a7a-8034-4695-a822-e9d2e4aea3e2 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.855s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:46:36 user nova-compute[73104]: DEBUG nova.network.neutron [req-fe9ecd68-8d6a-48e8-893a-f72ddbafed4e req-7d5f6bc5-f5ac-40c1-9c28-b5f8f9ade551 service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Updated VIF entry in instance network info cache for port cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:46:36 user nova-compute[73104]: DEBUG nova.network.neutron [req-fe9ecd68-8d6a-48e8-893a-f72ddbafed4e req-7d5f6bc5-f5ac-40c1-9c28-b5f8f9ade551 service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Updating instance_info_cache with network_info: [{"id": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "address": "fa:16:3e:4c:c9:02", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapcc2c1a60-58", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:46:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-fe9ecd68-8d6a-48e8-893a-f72ddbafed4e req-7d5f6bc5-f5ac-40c1-9c28-b5f8f9ade551 service nova] Releasing lock "refresh_cache-c3b4c644-f7f3-4304-b732-9f43cfeac2bb" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:46:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:45 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693039590.617398, c3b4c644-f7f3-4304-b732-9f43cfeac2bb => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:46:45 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] VM Stopped (Lifecycle Event)
Aug 26 08:46:45 user nova-compute[73104]: DEBUG nova.compute.manager [None req-a2fce679-bb0e-45c6-b581-9b7b0c9e7f65 None None] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:46:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:50 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-bcaa6091-5d96-4342-bb7c-29ef4dc8eaa5 req-d63297d9-09af-4477-b76e-901e0d28a8af service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received event network-changed-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:46:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-bcaa6091-5d96-4342-bb7c-29ef4dc8eaa5 req-d63297d9-09af-4477-b76e-901e0d28a8af service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Refreshing instance network info cache due to event network-changed-af4b7f02-03f5-492b-9d27-4d7e5523b423. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:46:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-bcaa6091-5d96-4342-bb7c-29ef4dc8eaa5 req-d63297d9-09af-4477-b76e-901e0d28a8af service nova] Acquiring lock "refresh_cache-02665c70-cf75-44ba-9d90-eb9e5f12e0b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:46:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-bcaa6091-5d96-4342-bb7c-29ef4dc8eaa5 req-d63297d9-09af-4477-b76e-901e0d28a8af service nova] Acquired lock "refresh_cache-02665c70-cf75-44ba-9d90-eb9e5f12e0b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:46:54 user nova-compute[73104]: DEBUG nova.network.neutron [req-bcaa6091-5d96-4342-bb7c-29ef4dc8eaa5 req-d63297d9-09af-4477-b76e-901e0d28a8af service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Refreshing network info cache for port af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:46:54 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:46:54 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:46:54 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:46:54 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 08:46:54 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Rebuilding the list of instances to heal {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 08:46:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-b5e1f82c-5675-4c37-8ba2-44e6a341a576" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:46:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-b5e1f82c-5675-4c37-8ba2-44e6a341a576" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:46:55 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 08:46:55 user nova-compute[73104]: DEBUG nova.objects.instance [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lazy-loading 'info_cache' on Instance uuid b5e1f82c-5675-4c37-8ba2-44e6a341a576 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:46:55 user nova-compute[73104]: DEBUG nova.network.neutron [req-bcaa6091-5d96-4342-bb7c-29ef4dc8eaa5 req-d63297d9-09af-4477-b76e-901e0d28a8af service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Updated VIF entry in instance network info cache for port af4b7f02-03f5-492b-9d27-4d7e5523b423. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:46:55 user nova-compute[73104]: DEBUG nova.network.neutron [req-bcaa6091-5d96-4342-bb7c-29ef4dc8eaa5 req-d63297d9-09af-4477-b76e-901e0d28a8af service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Updating instance_info_cache with network_info: [{"id": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "address": "fa:16:3e:d9:91:54", "network": {"id": "d09a6d6b-0c92-4bc3-a691-0aa3911d756e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1480336812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "994053e8d737440f8cb22f048a3c1873", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4b7f02-03", "ovs_interfaceid": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:46:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-bcaa6091-5d96-4342-bb7c-29ef4dc8eaa5 req-d63297d9-09af-4477-b76e-901e0d28a8af service nova] Releasing lock "refresh_cache-02665c70-cf75-44ba-9d90-eb9e5f12e0b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:46:55 user nova-compute[73104]: DEBUG nova.compute.manager [None req-e9125133-d5b0-4ab2-8bd2-7b2cdb2351f7 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:46:55 user nova-compute[73104]: INFO nova.compute.manager [None req-e9125133-d5b0-4ab2-8bd2-7b2cdb2351f7 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] instance snapshotting
Aug 26 08:46:55 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-e9125133-d5b0-4ab2-8bd2-7b2cdb2351f7 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Beginning live snapshot process
Aug 26 08:46:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e9125133-d5b0-4ab2-8bd2-7b2cdb2351f7 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk --force-share --output=json -f qcow2 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e9125133-d5b0-4ab2-8bd2-7b2cdb2351f7 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e9125133-d5b0-4ab2-8bd2-7b2cdb2351f7 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk --force-share --output=json -f qcow2 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e9125133-d5b0-4ab2-8bd2-7b2cdb2351f7 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk --force-share --output=json -f qcow2" returned: 0 in 0.211s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e9125133-d5b0-4ab2-8bd2-7b2cdb2351f7 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:56 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Updating instance_info_cache with network_info: [{"id": "3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96", "address": "fa:16:3e:c0:56:86", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3913bdf7-1f", "ovs_interfaceid": "3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:46:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-b5e1f82c-5675-4c37-8ba2-44e6a341a576" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:46:56 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 08:46:56 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:46:56 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:46:56 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:46:56 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:46:56 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:46:56 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:46:56 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 08:46:56 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:46:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:46:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:46:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:46:56 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 08:46:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e9125133-d5b0-4ab2-8bd2-7b2cdb2351f7 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.224s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e9125133-d5b0-4ab2-8bd2-7b2cdb2351f7 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpn8r8btz1/efa9054c831f46fa9243c4c09a54e6e6.delta 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e9125133-d5b0-4ab2-8bd2-7b2cdb2351f7 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpn8r8btz1/efa9054c831f46fa9243c4c09a54e6e6.delta 1073741824" returned: 0 in 0.057s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:56 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-e9125133-d5b0-4ab2-8bd2-7b2cdb2351f7 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 08:46:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:57 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-e9125133-d5b0-4ab2-8bd2-7b2cdb2351f7 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] COPY block job progress, current cursor: 458752 final cursor: 75563008 {{(pid=73104) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 08:46:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:57 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-e9125133-d5b0-4ab2-8bd2-7b2cdb2351f7 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73104) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 08:46:57 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-e9125133-d5b0-4ab2-8bd2-7b2cdb2351f7 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 08:46:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:58 user nova-compute[73104]: DEBUG nova.privsep.utils [None req-e9125133-d5b0-4ab2-8bd2-7b2cdb2351f7 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73104) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 08:46:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e9125133-d5b0-4ab2-8bd2-7b2cdb2351f7 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpn8r8btz1/efa9054c831f46fa9243c4c09a54e6e6.delta /opt/stack/data/nova/instances/snapshots/tmpn8r8btz1/efa9054c831f46fa9243c4c09a54e6e6 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e9125133-d5b0-4ab2-8bd2-7b2cdb2351f7 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpn8r8btz1/efa9054c831f46fa9243c4c09a54e6e6.delta /opt/stack/data/nova/instances/snapshots/tmpn8r8btz1/efa9054c831f46fa9243c4c09a54e6e6" returned: 0 in 0.418s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:58 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-e9125133-d5b0-4ab2-8bd2-7b2cdb2351f7 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Snapshot extracted, beginning image upload
Aug 26 08:46:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:46:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "bef1e493-6b2c-4688-98c2-647261feb571" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:46:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "bef1e493-6b2c-4688-98c2-647261feb571" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:46:58 user nova-compute[73104]: DEBUG nova.compute.manager [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:46:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:46:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:46:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Acquiring lock "55966005-e534-45d3-9bd4-cea5d54b661e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:46:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lock "55966005-e534-45d3-9bd4-cea5d54b661e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:46:59 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:46:59 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:46:59 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8008MB free_disk=24.453266143798828GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 08:46:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:46:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:46:59 user nova-compute[73104]: DEBUG nova.compute.manager [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:46:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:46:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:46:59 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance b5e1f82c-5675-4c37-8ba2-44e6a341a576 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:46:59 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 3cf85d2f-de0d-4e9b-a534-98c799ae8db9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:46:59 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:46:59 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 02665c70-cf75-44ba-9d90-eb9e5f12e0b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:46:59 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance b7f6e347-c1f3-4f56-86c4-3b28c4729964 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:46:59 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance bef1e493-6b2c-4688-98c2-647261feb571 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 26 08:46:59 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 55966005-e534-45d3-9bd4-cea5d54b661e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 26 08:46:59 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 08:46:59 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 08:46:59 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:46:59 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:46:59 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 08:46:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.527s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:46:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.509s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:46:59 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:46:59 user nova-compute[73104]: INFO nova.compute.claims [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Claim successful on node user
Aug 26 08:47:00 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:47:00 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:47:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:47:00 user nova-compute[73104]: DEBUG nova.compute.manager [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:47:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.823s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:47:00 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:47:00 user nova-compute[73104]: INFO nova.compute.claims [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Claim successful on node user
Aug 26 08:47:00 user nova-compute[73104]: DEBUG nova.compute.manager [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:47:00 user nova-compute[73104]: DEBUG nova.network.neutron [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:47:00 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:47:00 user nova-compute[73104]: DEBUG nova.compute.manager [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:47:00 user nova-compute[73104]: INFO nova.virt.block_device [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Booting with blank volume at /dev/vda
Aug 26 08:47:00 user nova-compute[73104]: DEBUG nova.policy [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bcd11beb7046440f814cbf4a13ab0272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a37356203d547c2abf0aa634c2ad548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:47:00 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:47:00 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:47:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:47:00 user nova-compute[73104]: DEBUG nova.compute.manager [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:47:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:01 user nova-compute[73104]: DEBUG nova.compute.manager [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:47:01 user nova-compute[73104]: DEBUG nova.network.neutron [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:47:01 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:47:01 user nova-compute[73104]: DEBUG nova.compute.manager [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:47:01 user nova-compute[73104]: DEBUG nova.compute.manager [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:47:01 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:47:01 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Creating image(s)
Aug 26 08:47:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Acquiring lock "/opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:47:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lock "/opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:47:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lock "/opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:47:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:01 user nova-compute[73104]: DEBUG nova.policy [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1fd1bc8d58240e89ed980aa9760cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8190893dbd48a083cc8dba20db0e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:47:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.344s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:47:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:47:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:01 user nova-compute[73104]: DEBUG nova.network.neutron [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Successfully created port: 6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:47:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.303s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/disk 1073741824" returned: 0 in 0.075s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.387s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:47:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:02 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-e9125133-d5b0-4ab2-8bd2-7b2cdb2351f7 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Snapshot image upload complete
Aug 26 08:47:02 user nova-compute[73104]: INFO nova.compute.manager [None req-e9125133-d5b0-4ab2-8bd2-7b2cdb2351f7 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Took 6.67 seconds to snapshot the instance on the hypervisor.
Aug 26 08:47:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.310s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:02 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Checking if we can resize image /opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 08:47:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/disk --force-share --output=json" returned: 0 in 0.318s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:02 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Cannot resize image /opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 08:47:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:47:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Ensure instance console log exists: /opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:47:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:47:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:47:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:47:03 user nova-compute[73104]: DEBUG nova.network.neutron [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Successfully created port: b646e439-ff88-4f5b-9fa6-f9a1eac84f08 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:47:03 user nova-compute[73104]: DEBUG nova.network.neutron [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Successfully updated port: 6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:47:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "refresh_cache-bef1e493-6b2c-4688-98c2-647261feb571" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:47:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquired lock "refresh_cache-bef1e493-6b2c-4688-98c2-647261feb571" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:47:03 user nova-compute[73104]: DEBUG nova.network.neutron [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:47:03 user nova-compute[73104]: DEBUG nova.compute.manager [req-9d5fd488-1935-4455-95a6-19b99a3c81b2 req-07c147be-5f3b-4140-a74b-4d710c181e59 service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Received event network-changed-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:47:03 user nova-compute[73104]: DEBUG nova.compute.manager [req-9d5fd488-1935-4455-95a6-19b99a3c81b2 req-07c147be-5f3b-4140-a74b-4d710c181e59 service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Refreshing instance network info cache due to event network-changed-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:47:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9d5fd488-1935-4455-95a6-19b99a3c81b2 req-07c147be-5f3b-4140-a74b-4d710c181e59 service nova] Acquiring lock "refresh_cache-bef1e493-6b2c-4688-98c2-647261feb571" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:47:03 user nova-compute[73104]: DEBUG nova.network.neutron [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:47:03 user nova-compute[73104]: DEBUG nova.network.neutron [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Updating instance_info_cache with network_info: [{"id": "6ddebd25-cfe6-4b0e-8b2d-746fae9f8685", "address": "fa:16:3e:03:fd:b2", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddebd25-cf", "ovs_interfaceid": "6ddebd25-cfe6-4b0e-8b2d-746fae9f8685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:47:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Releasing lock "refresh_cache-bef1e493-6b2c-4688-98c2-647261feb571" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:47:03 user nova-compute[73104]: DEBUG nova.compute.manager [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Instance network_info: |[{"id": "6ddebd25-cfe6-4b0e-8b2d-746fae9f8685", "address": "fa:16:3e:03:fd:b2", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddebd25-cf", "ovs_interfaceid": "6ddebd25-cfe6-4b0e-8b2d-746fae9f8685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:47:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9d5fd488-1935-4455-95a6-19b99a3c81b2 req-07c147be-5f3b-4140-a74b-4d710c181e59 service nova] Acquired lock "refresh_cache-bef1e493-6b2c-4688-98c2-647261feb571" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:47:03 user nova-compute[73104]: DEBUG nova.network.neutron [req-9d5fd488-1935-4455-95a6-19b99a3c81b2 req-07c147be-5f3b-4140-a74b-4d710c181e59 service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Refreshing network info cache for port 6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:47:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:04 user nova-compute[73104]: DEBUG nova.network.neutron [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Successfully updated port: b646e439-ff88-4f5b-9fa6-f9a1eac84f08 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:47:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Acquiring lock "refresh_cache-55966005-e534-45d3-9bd4-cea5d54b661e" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:47:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Acquired lock "refresh_cache-55966005-e534-45d3-9bd4-cea5d54b661e" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:47:04 user nova-compute[73104]: DEBUG nova.network.neutron [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:47:04 user nova-compute[73104]: DEBUG nova.compute.manager [req-0da9d23b-2fdc-45af-9fa6-ac3a34bda6f5 req-6934619e-e0f2-4708-b7e3-d1a77b92c692 service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Received event network-changed-b646e439-ff88-4f5b-9fa6-f9a1eac84f08 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:47:04 user nova-compute[73104]: DEBUG nova.compute.manager [req-0da9d23b-2fdc-45af-9fa6-ac3a34bda6f5 req-6934619e-e0f2-4708-b7e3-d1a77b92c692 service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Refreshing instance network info cache due to event network-changed-b646e439-ff88-4f5b-9fa6-f9a1eac84f08. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:47:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0da9d23b-2fdc-45af-9fa6-ac3a34bda6f5 req-6934619e-e0f2-4708-b7e3-d1a77b92c692 service nova] Acquiring lock "refresh_cache-55966005-e534-45d3-9bd4-cea5d54b661e" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:47:04 user nova-compute[73104]: DEBUG nova.network.neutron [req-9d5fd488-1935-4455-95a6-19b99a3c81b2 req-07c147be-5f3b-4140-a74b-4d710c181e59 service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Updated VIF entry in instance network info cache for port 6ddebd25-cfe6-4b0e-8b2d-746fae9f8685. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:47:04 user nova-compute[73104]: DEBUG nova.network.neutron [req-9d5fd488-1935-4455-95a6-19b99a3c81b2 req-07c147be-5f3b-4140-a74b-4d710c181e59 service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Updating instance_info_cache with network_info: [{"id": "6ddebd25-cfe6-4b0e-8b2d-746fae9f8685", "address": "fa:16:3e:03:fd:b2", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddebd25-cf", "ovs_interfaceid": "6ddebd25-cfe6-4b0e-8b2d-746fae9f8685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:47:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9d5fd488-1935-4455-95a6-19b99a3c81b2 req-07c147be-5f3b-4140-a74b-4d710c181e59 service nova] Releasing lock "refresh_cache-bef1e493-6b2c-4688-98c2-647261feb571" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:47:04 user nova-compute[73104]: DEBUG nova.network.neutron [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:47:04 user nova-compute[73104]: DEBUG nova.network.neutron [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Updating instance_info_cache with network_info: [{"id": "b646e439-ff88-4f5b-9fa6-f9a1eac84f08", "address": "fa:16:3e:b8:26:eb", "network": {"id": "edbebe23-8fc4-4a39-b4e8-d32d00d25c7f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2016586720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8190893dbd48a083cc8dba20db0e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb646e439-ff", "ovs_interfaceid": "b646e439-ff88-4f5b-9fa6-f9a1eac84f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Releasing lock "refresh_cache-55966005-e534-45d3-9bd4-cea5d54b661e" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG nova.compute.manager [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Instance network_info: |[{"id": "b646e439-ff88-4f5b-9fa6-f9a1eac84f08", "address": "fa:16:3e:b8:26:eb", "network": {"id": "edbebe23-8fc4-4a39-b4e8-d32d00d25c7f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2016586720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8190893dbd48a083cc8dba20db0e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb646e439-ff", "ovs_interfaceid": "b646e439-ff88-4f5b-9fa6-f9a1eac84f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0da9d23b-2fdc-45af-9fa6-ac3a34bda6f5 req-6934619e-e0f2-4708-b7e3-d1a77b92c692 service nova] Acquired lock "refresh_cache-55966005-e534-45d3-9bd4-cea5d54b661e" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG nova.network.neutron [req-0da9d23b-2fdc-45af-9fa6-ac3a34bda6f5 req-6934619e-e0f2-4708-b7e3-d1a77b92c692 service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Refreshing network info cache for port b646e439-ff88-4f5b-9fa6-f9a1eac84f08 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Start _get_guest_xml network_info=[{"id": "b646e439-ff88-4f5b-9fa6-f9a1eac84f08", "address": "fa:16:3e:b8:26:eb", "network": {"id": "edbebe23-8fc4-4a39-b4e8-d32d00d25c7f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2016586720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8190893dbd48a083cc8dba20db0e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb646e439-ff", "ovs_interfaceid": "b646e439-ff88-4f5b-9fa6-f9a1eac84f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:47:05 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:47:05 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:47:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-829727057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-829727057',id=25,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPrtw2uPRe9G8zyYK3ARIY3AfX0RzLppVCcvlKoAgXZOG4qTaMTx2cx9wO1C4CoqjxJ4W8gRg9Ex00VbBz9tkcQ5fjhSqrrzBpVdl1qo6UlzDiYX6hf0JXW1ZaomcLxiQ==',key_name='tempest-keypair-1580684820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b8190893dbd48a083cc8dba20db0e35',ramdisk_id='',reservation_id='r-kl6196e4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1715069850',owner_user_name='tempest-TaggedAttachmentsTest-1715069850-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:47:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1fd1bc8d58240e89ed980aa9760cbfe',uuid=55966005-e534-45d3-9bd4-cea5d54b661e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b646e439-ff88-4f5b-9fa6-f9a1eac84f08", "address": "fa:16:3e:b8:26:eb", "network": {"id": "edbebe23-8fc4-4a39-b4e8-d32d00d25c7f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2016586720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8190893dbd48a083cc8dba20db0e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb646e439-ff", "ovs_interfaceid": "b646e439-ff88-4f5b-9fa6-f9a1eac84f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Converting VIF {"id": "b646e439-ff88-4f5b-9fa6-f9a1eac84f08", "address": "fa:16:3e:b8:26:eb", "network": {"id": "edbebe23-8fc4-4a39-b4e8-d32d00d25c7f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2016586720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8190893dbd48a083cc8dba20db0e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb646e439-ff", "ovs_interfaceid": "b646e439-ff88-4f5b-9fa6-f9a1eac84f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:26:eb,bridge_name='br-int',has_traffic_filtering=True,id=b646e439-ff88-4f5b-9fa6-f9a1eac84f08,network=Network(edbebe23-8fc4-4a39-b4e8-d32d00d25c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb646e439-ff') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG nova.objects.instance [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lazy-loading 'pci_devices' on Instance uuid 55966005-e534-45d3-9bd4-cea5d54b661e {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:47:05 user nova-compute[73104]:   <uuid>55966005-e534-45d3-9bd4-cea5d54b661e</uuid>
Aug 26 08:47:05 user nova-compute[73104]:   <name>instance-00000019</name>
Aug 26 08:47:05 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:47:05 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:47:05 user nova-compute[73104]:   <metadata>
Aug 26 08:47:05 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:47:05 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:47:05 user nova-compute[73104]:       <nova:name>tempest-device-tagging-server-829727057</nova:name>
Aug 26 08:47:05 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:47:05</nova:creationTime>
Aug 26 08:47:05 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:47:05 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:47:05 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:47:05 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:47:05 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:47:05 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:47:05 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:47:05 user nova-compute[73104]:       <nova:owner>
Aug 26 08:47:05 user nova-compute[73104]:         <nova:user uuid="a1fd1bc8d58240e89ed980aa9760cbfe">tempest-TaggedAttachmentsTest-1715069850-project-member</nova:user>
Aug 26 08:47:05 user nova-compute[73104]:         <nova:project uuid="8b8190893dbd48a083cc8dba20db0e35">tempest-TaggedAttachmentsTest-1715069850</nova:project>
Aug 26 08:47:05 user nova-compute[73104]:       </nova:owner>
Aug 26 08:47:05 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:47:05 user nova-compute[73104]:       <nova:ports>
Aug 26 08:47:05 user nova-compute[73104]:         <nova:port uuid="b646e439-ff88-4f5b-9fa6-f9a1eac84f08">
Aug 26 08:47:05 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 08:47:05 user nova-compute[73104]:         </nova:port>
Aug 26 08:47:05 user nova-compute[73104]:       </nova:ports>
Aug 26 08:47:05 user nova-compute[73104]:     </nova:instance>
Aug 26 08:47:05 user nova-compute[73104]:   </metadata>
Aug 26 08:47:05 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:47:05 user nova-compute[73104]:     <system>
Aug 26 08:47:05 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:47:05 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:47:05 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:47:05 user nova-compute[73104]:       <entry name="serial">55966005-e534-45d3-9bd4-cea5d54b661e</entry>
Aug 26 08:47:05 user nova-compute[73104]:       <entry name="uuid">55966005-e534-45d3-9bd4-cea5d54b661e</entry>
Aug 26 08:47:05 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:47:05 user nova-compute[73104]:     </system>
Aug 26 08:47:05 user nova-compute[73104]:   </sysinfo>
Aug 26 08:47:05 user nova-compute[73104]:   <os>
Aug 26 08:47:05 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:47:05 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:47:05 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:47:05 user nova-compute[73104]:   </os>
Aug 26 08:47:05 user nova-compute[73104]:   <features>
Aug 26 08:47:05 user nova-compute[73104]:     <acpi/>
Aug 26 08:47:05 user nova-compute[73104]:     <apic/>
Aug 26 08:47:05 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:47:05 user nova-compute[73104]:   </features>
Aug 26 08:47:05 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:47:05 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:47:05 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:47:05 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:47:05 user nova-compute[73104]:   </clock>
Aug 26 08:47:05 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:47:05 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:47:05 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:47:05 user nova-compute[73104]:   </cpu>
Aug 26 08:47:05 user nova-compute[73104]:   <devices>
Aug 26 08:47:05 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:47:05 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:47:05 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/disk"/>
Aug 26 08:47:05 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:47:05 user nova-compute[73104]:     </disk>
Aug 26 08:47:05 user nova-compute[73104]:     <disk type="file" device="cdrom">
Aug 26 08:47:05 user nova-compute[73104]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 08:47:05 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/disk.config"/>
Aug 26 08:47:05 user nova-compute[73104]:       <target dev="hda" bus="ide"/>
Aug 26 08:47:05 user nova-compute[73104]:     </disk>
Aug 26 08:47:05 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:47:05 user nova-compute[73104]:       <mac address="fa:16:3e:b8:26:eb"/>
Aug 26 08:47:05 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:47:05 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:47:05 user nova-compute[73104]:       <target dev="tapb646e439-ff"/>
Aug 26 08:47:05 user nova-compute[73104]:     </interface>
Aug 26 08:47:05 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:47:05 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/console.log" append="off"/>
Aug 26 08:47:05 user nova-compute[73104]:     </serial>
Aug 26 08:47:05 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:47:05 user nova-compute[73104]:     <video>
Aug 26 08:47:05 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:47:05 user nova-compute[73104]:     </video>
Aug 26 08:47:05 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:47:05 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:47:05 user nova-compute[73104]:     </rng>
Aug 26 08:47:05 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:47:05 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:47:05 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:47:05 user nova-compute[73104]:     </memballoon>
Aug 26 08:47:05 user nova-compute[73104]:   </devices>
Aug 26 08:47:05 user nova-compute[73104]: </domain>
Aug 26 08:47:05 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-829727057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-829727057',id=25,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPrtw2uPRe9G8zyYK3ARIY3AfX0RzLppVCcvlKoAgXZOG4qTaMTx2cx9wO1C4CoqjxJ4W8gRg9Ex00VbBz9tkcQ5fjhSqrrzBpVdl1qo6UlzDiYX6hf0JXW1ZaomcLxiQ==',key_name='tempest-keypair-1580684820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b8190893dbd48a083cc8dba20db0e35',ramdisk_id='',reservation_id='r-kl6196e4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1715069850',owner_user_name='tempest-TaggedAttachmentsTest-1715069850-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:47:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1fd1bc8d58240e89ed980aa9760cbfe',uuid=55966005-e534-45d3-9bd4-cea5d54b661e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b646e439-ff88-4f5b-9fa6-f9a1eac84f08", "address": "fa:16:3e:b8:26:eb", "network": {"id": "edbebe23-8fc4-4a39-b4e8-d32d00d25c7f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2016586720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8190893dbd48a083cc8dba20db0e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb646e439-ff", "ovs_interfaceid": "b646e439-ff88-4f5b-9fa6-f9a1eac84f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Converting VIF {"id": "b646e439-ff88-4f5b-9fa6-f9a1eac84f08", "address": "fa:16:3e:b8:26:eb", "network": {"id": "edbebe23-8fc4-4a39-b4e8-d32d00d25c7f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2016586720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8190893dbd48a083cc8dba20db0e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb646e439-ff", "ovs_interfaceid": "b646e439-ff88-4f5b-9fa6-f9a1eac84f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:26:eb,bridge_name='br-int',has_traffic_filtering=True,id=b646e439-ff88-4f5b-9fa6-f9a1eac84f08,network=Network(edbebe23-8fc4-4a39-b4e8-d32d00d25c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb646e439-ff') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG os_vif [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:26:eb,bridge_name='br-int',has_traffic_filtering=True,id=b646e439-ff88-4f5b-9fa6-f9a1eac84f08,network=Network(edbebe23-8fc4-4a39-b4e8-d32d00d25c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb646e439-ff') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb646e439-ff, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb646e439-ff, col_values=(('external_ids', {'iface-id': 'b646e439-ff88-4f5b-9fa6-f9a1eac84f08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:26:eb', 'vm-uuid': '55966005-e534-45d3-9bd4-cea5d54b661e'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:05 user nova-compute[73104]: INFO os_vif [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:26:eb,bridge_name='br-int',has_traffic_filtering=True,id=b646e439-ff88-4f5b-9fa6-f9a1eac84f08,network=Network(edbebe23-8fc4-4a39-b4e8-d32d00d25c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb646e439-ff')
Aug 26 08:47:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] No BDM found with device name hda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] No VIF found with MAC fa:16:3e:b8:26:eb, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:47:05 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Using config drive
Aug 26 08:47:05 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Creating config drive at /opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/disk.config
Aug 26 08:47:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpiaihn4p0 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpiaihn4p0" returned: 0 in 0.087s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG nova.network.neutron [req-0da9d23b-2fdc-45af-9fa6-ac3a34bda6f5 req-6934619e-e0f2-4708-b7e3-d1a77b92c692 service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Updated VIF entry in instance network info cache for port b646e439-ff88-4f5b-9fa6-f9a1eac84f08. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG nova.network.neutron [req-0da9d23b-2fdc-45af-9fa6-ac3a34bda6f5 req-6934619e-e0f2-4708-b7e3-d1a77b92c692 service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Updating instance_info_cache with network_info: [{"id": "b646e439-ff88-4f5b-9fa6-f9a1eac84f08", "address": "fa:16:3e:b8:26:eb", "network": {"id": "edbebe23-8fc4-4a39-b4e8-d32d00d25c7f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2016586720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8190893dbd48a083cc8dba20db0e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb646e439-ff", "ovs_interfaceid": "b646e439-ff88-4f5b-9fa6-f9a1eac84f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:47:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0da9d23b-2fdc-45af-9fa6-ac3a34bda6f5 req-6934619e-e0f2-4708-b7e3-d1a77b92c692 service nova] Releasing lock "refresh_cache-55966005-e534-45d3-9bd4-cea5d54b661e" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:47:06 user nova-compute[73104]: DEBUG os_brick.utils [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:47:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:06 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cf08f2-774e-42ea-8a04-c2d4b8fb7231]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:47:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:06 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6649be58-1c5f-479a-a153-bf149134fce7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:47:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:06 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ebe56d-5e35-4cb6-ade9-8545a71a10ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:47:06 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d765348b-ab5d-4c99-9394-5e4ba9ecc03a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:47:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:47:06 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:47:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:47:06 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:47:06 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6724ec-9882-457c-bb74-ee09b3b823ca]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:47:06 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:47:06 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:47:06 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:47:06 user nova-compute[73104]: DEBUG os_brick.utils [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:47:06 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Updating existing volume attachment record: 0c502504-1e55-4cc2-abe9-d9b64e6a593c {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 08:47:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:07 user nova-compute[73104]: DEBUG nova.compute.manager [req-ed14adf4-daae-4820-b9d3-dc8b96e2a689 req-995c78ba-478e-4cce-9102-cf729594a6a0 service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Received event network-vif-plugged-b646e439-ff88-4f5b-9fa6-f9a1eac84f08 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:47:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ed14adf4-daae-4820-b9d3-dc8b96e2a689 req-995c78ba-478e-4cce-9102-cf729594a6a0 service nova] Acquiring lock "55966005-e534-45d3-9bd4-cea5d54b661e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:47:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ed14adf4-daae-4820-b9d3-dc8b96e2a689 req-995c78ba-478e-4cce-9102-cf729594a6a0 service nova] Lock "55966005-e534-45d3-9bd4-cea5d54b661e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:47:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ed14adf4-daae-4820-b9d3-dc8b96e2a689 req-995c78ba-478e-4cce-9102-cf729594a6a0 service nova] Lock "55966005-e534-45d3-9bd4-cea5d54b661e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:47:07 user nova-compute[73104]: DEBUG nova.compute.manager [req-ed14adf4-daae-4820-b9d3-dc8b96e2a689 req-995c78ba-478e-4cce-9102-cf729594a6a0 service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] No waiting events found dispatching network-vif-plugged-b646e439-ff88-4f5b-9fa6-f9a1eac84f08 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:47:07 user nova-compute[73104]: WARNING nova.compute.manager [req-ed14adf4-daae-4820-b9d3-dc8b96e2a689 req-995c78ba-478e-4cce-9102-cf729594a6a0 service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Received unexpected event network-vif-plugged-b646e439-ff88-4f5b-9fa6-f9a1eac84f08 for instance with vm_state building and task_state spawning.
Aug 26 08:47:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:09 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039629.1774964, 55966005-e534-45d3-9bd4-cea5d54b661e => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:47:09 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] VM Resumed (Lifecycle Event)
Aug 26 08:47:09 user nova-compute[73104]: DEBUG nova.compute.manager [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:47:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:47:09 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Instance spawned successfully.
Aug 26 08:47:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:47:09 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:47:09 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:47:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:47:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:47:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:47:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:47:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:47:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:47:09 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:47:09 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039629.1793733, 55966005-e534-45d3-9bd4-cea5d54b661e => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:47:09 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] VM Started (Lifecycle Event)
Aug 26 08:47:09 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:47:09 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:47:09 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:47:09 user nova-compute[73104]: INFO nova.compute.manager [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Took 8.03 seconds to spawn the instance on the hypervisor.
Aug 26 08:47:09 user nova-compute[73104]: DEBUG nova.compute.manager [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:47:09 user nova-compute[73104]: DEBUG nova.compute.manager [req-7a8a6f3f-03cd-47a8-97a7-ad56ef2c5d61 req-7f1ccc94-8bca-4c8c-a285-3f8881e10328 service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Received event network-vif-plugged-b646e439-ff88-4f5b-9fa6-f9a1eac84f08 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:47:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-7a8a6f3f-03cd-47a8-97a7-ad56ef2c5d61 req-7f1ccc94-8bca-4c8c-a285-3f8881e10328 service nova] Acquiring lock "55966005-e534-45d3-9bd4-cea5d54b661e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:47:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-7a8a6f3f-03cd-47a8-97a7-ad56ef2c5d61 req-7f1ccc94-8bca-4c8c-a285-3f8881e10328 service nova] Lock "55966005-e534-45d3-9bd4-cea5d54b661e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:47:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-7a8a6f3f-03cd-47a8-97a7-ad56ef2c5d61 req-7f1ccc94-8bca-4c8c-a285-3f8881e10328 service nova] Lock "55966005-e534-45d3-9bd4-cea5d54b661e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:47:09 user nova-compute[73104]: DEBUG nova.compute.manager [req-7a8a6f3f-03cd-47a8-97a7-ad56ef2c5d61 req-7f1ccc94-8bca-4c8c-a285-3f8881e10328 service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] No waiting events found dispatching network-vif-plugged-b646e439-ff88-4f5b-9fa6-f9a1eac84f08 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:47:09 user nova-compute[73104]: WARNING nova.compute.manager [req-7a8a6f3f-03cd-47a8-97a7-ad56ef2c5d61 req-7f1ccc94-8bca-4c8c-a285-3f8881e10328 service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Received unexpected event network-vif-plugged-b646e439-ff88-4f5b-9fa6-f9a1eac84f08 for instance with vm_state building and task_state spawning.
Aug 26 08:47:09 user nova-compute[73104]: INFO nova.compute.manager [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Took 9.87 seconds to build instance.
Aug 26 08:47:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1a80063b-2257-4da6-b4d3-651473b442b2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lock "55966005-e534-45d3-9bd4-cea5d54b661e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:47:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-067970cb-e305-497c-b853-68c42d330b2d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:47:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-067970cb-e305-497c-b853-68c42d330b2d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:47:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-067970cb-e305-497c-b853-68c42d330b2d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:47:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-067970cb-e305-497c-b853-68c42d330b2d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:47:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-067970cb-e305-497c-b853-68c42d330b2d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:47:20 user nova-compute[73104]: INFO nova.compute.manager [None req-067970cb-e305-497c-b853-68c42d330b2d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Terminating instance
Aug 26 08:47:20 user nova-compute[73104]: DEBUG nova.compute.manager [None req-067970cb-e305-497c-b853-68c42d330b2d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 08:47:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:47:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:20 user nova-compute[73104]: DEBUG nova.compute.manager [req-ded750e4-3683-40db-bc75-a95ea47a57a9 req-78bdd6dc-3ec4-4e34-b1b3-27eac8a70e15 service nova] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Received event network-vif-unplugged-4d938630-3013-4a42-b02d-cb0dd75e436c {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:47:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ded750e4-3683-40db-bc75-a95ea47a57a9 req-78bdd6dc-3ec4-4e34-b1b3-27eac8a70e15 service nova] Acquiring lock "86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:47:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ded750e4-3683-40db-bc75-a95ea47a57a9 req-78bdd6dc-3ec4-4e34-b1b3-27eac8a70e15 service nova] Lock "86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:47:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ded750e4-3683-40db-bc75-a95ea47a57a9 req-78bdd6dc-3ec4-4e34-b1b3-27eac8a70e15 service nova] Lock "86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:47:20 user nova-compute[73104]: DEBUG nova.compute.manager [req-ded750e4-3683-40db-bc75-a95ea47a57a9 req-78bdd6dc-3ec4-4e34-b1b3-27eac8a70e15 service nova] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] No waiting events found dispatching network-vif-unplugged-4d938630-3013-4a42-b02d-cb0dd75e436c {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:47:20 user nova-compute[73104]: DEBUG nova.compute.manager [req-ded750e4-3683-40db-bc75-a95ea47a57a9 req-78bdd6dc-3ec4-4e34-b1b3-27eac8a70e15 service nova] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Received event network-vif-unplugged-4d938630-3013-4a42-b02d-cb0dd75e436c for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:47:20 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Instance destroyed successfully.
Aug 26 08:47:20 user nova-compute[73104]: DEBUG nova.objects.instance [None req-067970cb-e305-497c-b853-68c42d330b2d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lazy-loading 'resources' on Instance uuid 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:47:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-067970cb-e305-497c-b853-68c42d330b2d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:44:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1780275581',display_name='tempest-AttachVolumeNegativeTest-server-1780275581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1780275581',id=20,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgj4uvLx2A21c08F1Gnl9TAK5U6ns7CaL7smxkSfZmqaFNkDJnUeDaNWRuIkWKx0zvA/dfKabuyFLCIGAivIJrDPX1I/S3T9ksh5Ceu7mTvEb51E4WsFHwHvG0RPgiaow==',key_name='tempest-keypair-1724422424',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:44:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ad68e5623014e2fb3f10ba92d388291',ramdisk_id='',reservation_id='r-6yv35ugc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1286694855',owner_user_name='tempest-AttachVolumeNegativeTest-1286694855-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:44:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='062587ed00ae457889f884346c99e11b',uuid=86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d938630-3013-4a42-b02d-cb0dd75e436c", "address": "fa:16:3e:85:52:72", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d938630-30", "ovs_interfaceid": "4d938630-3013-4a42-b02d-cb0dd75e436c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:47:20 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-067970cb-e305-497c-b853-68c42d330b2d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Converting VIF {"id": "4d938630-3013-4a42-b02d-cb0dd75e436c", "address": "fa:16:3e:85:52:72", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d938630-30", "ovs_interfaceid": "4d938630-3013-4a42-b02d-cb0dd75e436c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:47:20 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-067970cb-e305-497c-b853-68c42d330b2d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:52:72,bridge_name='br-int',has_traffic_filtering=True,id=4d938630-3013-4a42-b02d-cb0dd75e436c,network=Network(ea6c6ce0-85a4-40db-96e2-ca078887ab66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d938630-30') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:47:20 user nova-compute[73104]: DEBUG os_vif [None req-067970cb-e305-497c-b853-68c42d330b2d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:52:72,bridge_name='br-int',has_traffic_filtering=True,id=4d938630-3013-4a42-b02d-cb0dd75e436c,network=Network(ea6c6ce0-85a4-40db-96e2-ca078887ab66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d938630-30') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:47:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d938630-30, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:47:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:47:20 user nova-compute[73104]: INFO os_vif [None req-067970cb-e305-497c-b853-68c42d330b2d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:52:72,bridge_name='br-int',has_traffic_filtering=True,id=4d938630-3013-4a42-b02d-cb0dd75e436c,network=Network(ea6c6ce0-85a4-40db-96e2-ca078887ab66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d938630-30')
Aug 26 08:47:20 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-067970cb-e305-497c-b853-68c42d330b2d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Deleting instance files /opt/stack/data/nova/instances/86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d_del
Aug 26 08:47:20 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-067970cb-e305-497c-b853-68c42d330b2d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Deletion of /opt/stack/data/nova/instances/86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d_del complete
Aug 26 08:47:21 user nova-compute[73104]: INFO nova.compute.manager [None req-067970cb-e305-497c-b853-68c42d330b2d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 26 08:47:21 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-067970cb-e305-497c-b853-68c42d330b2d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 08:47:21 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 08:47:21 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 08:47:22 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:47:22 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Took 1.01 seconds to deallocate network for instance.
Aug 26 08:47:22 user nova-compute[73104]: DEBUG nova.compute.manager [req-d1b68895-db23-40cd-89c3-7c6ff3085537 req-5cc96ac8-f6a1-4aaf-afa7-85b6ae9fab9d service nova] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Received event network-vif-deleted-4d938630-3013-4a42-b02d-cb0dd75e436c {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:47:22 user nova-compute[73104]: INFO nova.compute.manager [req-d1b68895-db23-40cd-89c3-7c6ff3085537 req-5cc96ac8-f6a1-4aaf-afa7-85b6ae9fab9d service nova] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Neutron deleted interface 4d938630-3013-4a42-b02d-cb0dd75e436c; detaching it from the instance and deleting it from the info cache
Aug 26 08:47:22 user nova-compute[73104]: DEBUG nova.network.neutron [req-d1b68895-db23-40cd-89c3-7c6ff3085537 req-5cc96ac8-f6a1-4aaf-afa7-85b6ae9fab9d service nova] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:47:22 user nova-compute[73104]: DEBUG nova.compute.manager [req-d1b68895-db23-40cd-89c3-7c6ff3085537 req-5cc96ac8-f6a1-4aaf-afa7-85b6ae9fab9d service nova] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Detach interface failed, port_id=4d938630-3013-4a42-b02d-cb0dd75e436c, reason: Instance 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d could not be found. {{(pid=73104) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 08:47:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-067970cb-e305-497c-b853-68c42d330b2d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:47:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-067970cb-e305-497c-b853-68c42d330b2d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:47:22 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-067970cb-e305-497c-b853-68c42d330b2d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:47:22 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-067970cb-e305-497c-b853-68c42d330b2d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:47:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-067970cb-e305-497c-b853-68c42d330b2d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:47:22 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-067970cb-e305-497c-b853-68c42d330b2d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Deleted allocations for instance 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d
Aug 26 08:47:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-067970cb-e305-497c-b853-68c42d330b2d tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.451s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:47:22 user nova-compute[73104]: DEBUG nova.compute.manager [req-532ed6df-4d32-4d99-9e02-7a7394a58716 req-9bd62ab9-8d59-4644-bbae-0cc02b499890 service nova] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Received event network-vif-plugged-4d938630-3013-4a42-b02d-cb0dd75e436c {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:47:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-532ed6df-4d32-4d99-9e02-7a7394a58716 req-9bd62ab9-8d59-4644-bbae-0cc02b499890 service nova] Acquiring lock "86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:47:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-532ed6df-4d32-4d99-9e02-7a7394a58716 req-9bd62ab9-8d59-4644-bbae-0cc02b499890 service nova] Lock "86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:47:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-532ed6df-4d32-4d99-9e02-7a7394a58716 req-9bd62ab9-8d59-4644-bbae-0cc02b499890 service nova] Lock "86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:47:22 user nova-compute[73104]: DEBUG nova.compute.manager [req-532ed6df-4d32-4d99-9e02-7a7394a58716 req-9bd62ab9-8d59-4644-bbae-0cc02b499890 service nova] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] No waiting events found dispatching network-vif-plugged-4d938630-3013-4a42-b02d-cb0dd75e436c {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:47:22 user nova-compute[73104]: WARNING nova.compute.manager [req-532ed6df-4d32-4d99-9e02-7a7394a58716 req-9bd62ab9-8d59-4644-bbae-0cc02b499890 service nova] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Received unexpected event network-vif-plugged-4d938630-3013-4a42-b02d-cb0dd75e436c for instance with vm_state deleted and task_state None.
Aug 26 08:47:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG nova.compute.manager [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:47:25 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Creating image(s)
Aug 26 08:47:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Did not create local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Ensure instance console log exists: /opt/stack/data/nova/instances/bef1e493-6b2c-4688-98c2-647261feb571/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Start _get_guest_xml network_info=[{"id": "6ddebd25-cfe6-4b0e-8b2d-746fae9f8685", "address": "fa:16:3e:03:fd:b2", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddebd25-cf", "ovs_interfaceid": "6ddebd25-cfe6-4b0e-8b2d-746fae9f8685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '0c502504-1e55-4cc2-abe9-d9b64e6a593c', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Anmyhrti', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bef1e493-6b2c-4688-98c2-647261feb571', 'attached_at': '', 'detached_at': '', 'volume_id': 'ad797845-bc66-4e30-a209-353015b67372', 'serial': 'ad797845-bc66-4e30-a209-353015b67372'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:47:25 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:47:25 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:47:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Anmyhrti', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:47:25 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:47:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:47:25 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:47:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:47:25 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:47:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b6088c-cf61-45e0-8ee9-18a391c36644]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:47:25 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2a9950-9bea-4ff0-958d-fbe7b4f0a784]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372] added
Aug 26 08:47:25 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8b99f5-7e74-4c0c-b0df-9802f87b438a]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cb01df-e17f-4ce4-8bea-5d682f654eda]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Anmyhrti {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Anmyhrti" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ec4f34-da36-4f44-b49b-6473b2e3cff7]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Anmyhrti'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6406f116-42d7-4366-a089-12fa7e0c106f]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe55d28-8226-4410-9fb3-b1bc438eee89]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 08:47:25 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:47:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 08:47:25 user nova-compute[73104]:  {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:47:25 user nova-compute[73104]: WARNING os_brick.initiator.connectors.iscsi [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 08:47:25 user nova-compute[73104]: 
Aug 26 08:47:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba28897-7643-42cd-84eb-1102dfb99ffd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:47:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372, portal: 172.16.0.220,3260]
Aug 26 08:47:26 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372, portal: 172.16.0.220,3260] successful.
Aug 26 08:47:26 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:47:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54bd694-d8f3-4a57-b6b7-b400c5436d7e]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:47:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:47:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd32e00b-cb58-4c3f-92f8-30c123f90511]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:47:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:47:26 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:47:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:47:26 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:47:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:47:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:47:26 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:47:26 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:47:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1b5dee-0653-427b-86e5-934fd09baa52]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:47:26 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:47:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Anmyhrti', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:47:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:47:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26136336237616338', 'path': '/dev/sdb'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:47:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136336237616338', 'path': '/dev/sdb'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:47:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1620831996',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1620831996',id=24,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a37356203d547c2abf0aa634c2ad548',ramdisk_id='',reservation_id='r-4p9y2cyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1111216102',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:47:01Z,user_data=None,user_id='bcd11beb7046440f814cbf4a13ab0272',uuid=bef1e493-6b2c-4688-98c2-647261feb571,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ddebd25-cfe6-4b0e-8b2d-746fae9f8685", "address": "fa:16:3e:03:fd:b2", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddebd25-cf", "ovs_interfaceid": "6ddebd25-cfe6-4b0e-8b2d-746fae9f8685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:47:27 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Converting VIF {"id": "6ddebd25-cfe6-4b0e-8b2d-746fae9f8685", "address": "fa:16:3e:03:fd:b2", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddebd25-cf", "ovs_interfaceid": "6ddebd25-cfe6-4b0e-8b2d-746fae9f8685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:47:27 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:fd:b2,bridge_name='br-int',has_traffic_filtering=True,id=6ddebd25-cfe6-4b0e-8b2d-746fae9f8685,network=Network(ce0a529c-2119-4b2a-a08f-567e3671c3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddebd25-cf') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:47:27 user nova-compute[73104]: DEBUG nova.objects.instance [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lazy-loading 'pci_devices' on Instance uuid bef1e493-6b2c-4688-98c2-647261feb571 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:47:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:47:27 user nova-compute[73104]:   <uuid>bef1e493-6b2c-4688-98c2-647261feb571</uuid>
Aug 26 08:47:27 user nova-compute[73104]:   <name>instance-00000018</name>
Aug 26 08:47:27 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:47:27 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:47:27 user nova-compute[73104]:   <metadata>
Aug 26 08:47:27 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:47:27 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:47:27 user nova-compute[73104]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1620831996</nova:name>
Aug 26 08:47:27 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:47:25</nova:creationTime>
Aug 26 08:47:27 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:47:27 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:47:27 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:47:27 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:47:27 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:47:27 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:47:27 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:47:27 user nova-compute[73104]:       <nova:owner>
Aug 26 08:47:27 user nova-compute[73104]:         <nova:user uuid="bcd11beb7046440f814cbf4a13ab0272">tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member</nova:user>
Aug 26 08:47:27 user nova-compute[73104]:         <nova:project uuid="8a37356203d547c2abf0aa634c2ad548">tempest-ServerBootFromVolumeStableRescueTest-1111216102</nova:project>
Aug 26 08:47:27 user nova-compute[73104]:       </nova:owner>
Aug 26 08:47:27 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:47:27 user nova-compute[73104]:       <nova:ports>
Aug 26 08:47:27 user nova-compute[73104]:         <nova:port uuid="6ddebd25-cfe6-4b0e-8b2d-746fae9f8685">
Aug 26 08:47:27 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 08:47:27 user nova-compute[73104]:         </nova:port>
Aug 26 08:47:27 user nova-compute[73104]:       </nova:ports>
Aug 26 08:47:27 user nova-compute[73104]:     </nova:instance>
Aug 26 08:47:27 user nova-compute[73104]:   </metadata>
Aug 26 08:47:27 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:47:27 user nova-compute[73104]:     <system>
Aug 26 08:47:27 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:47:27 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:47:27 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:47:27 user nova-compute[73104]:       <entry name="serial">bef1e493-6b2c-4688-98c2-647261feb571</entry>
Aug 26 08:47:27 user nova-compute[73104]:       <entry name="uuid">bef1e493-6b2c-4688-98c2-647261feb571</entry>
Aug 26 08:47:27 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:47:27 user nova-compute[73104]:     </system>
Aug 26 08:47:27 user nova-compute[73104]:   </sysinfo>
Aug 26 08:47:27 user nova-compute[73104]:   <os>
Aug 26 08:47:27 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:47:27 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:47:27 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:47:27 user nova-compute[73104]:   </os>
Aug 26 08:47:27 user nova-compute[73104]:   <features>
Aug 26 08:47:27 user nova-compute[73104]:     <acpi/>
Aug 26 08:47:27 user nova-compute[73104]:     <apic/>
Aug 26 08:47:27 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:47:27 user nova-compute[73104]:   </features>
Aug 26 08:47:27 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:47:27 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:47:27 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:47:27 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:47:27 user nova-compute[73104]:   </clock>
Aug 26 08:47:27 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:47:27 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:47:27 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:47:27 user nova-compute[73104]:   </cpu>
Aug 26 08:47:27 user nova-compute[73104]:   <devices>
Aug 26 08:47:27 user nova-compute[73104]:     <disk type="block" device="disk">
Aug 26 08:47:27 user nova-compute[73104]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:47:27 user nova-compute[73104]:       <source dev="/dev/sdb"/>
Aug 26 08:47:27 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:47:27 user nova-compute[73104]:       <serial>ad797845-bc66-4e30-a209-353015b67372</serial>
Aug 26 08:47:27 user nova-compute[73104]:     </disk>
Aug 26 08:47:27 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:47:27 user nova-compute[73104]:       <mac address="fa:16:3e:03:fd:b2"/>
Aug 26 08:47:27 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:47:27 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:47:27 user nova-compute[73104]:       <target dev="tap6ddebd25-cf"/>
Aug 26 08:47:27 user nova-compute[73104]:     </interface>
Aug 26 08:47:27 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:47:27 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/bef1e493-6b2c-4688-98c2-647261feb571/console.log" append="off"/>
Aug 26 08:47:27 user nova-compute[73104]:     </serial>
Aug 26 08:47:27 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:47:27 user nova-compute[73104]:     <video>
Aug 26 08:47:27 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:47:27 user nova-compute[73104]:     </video>
Aug 26 08:47:27 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:47:27 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:47:27 user nova-compute[73104]:     </rng>
Aug 26 08:47:27 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:47:27 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:47:27 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:47:27 user nova-compute[73104]:     </memballoon>
Aug 26 08:47:27 user nova-compute[73104]:   </devices>
Aug 26 08:47:27 user nova-compute[73104]: </domain>
Aug 26 08:47:27 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:47:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1620831996',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1620831996',id=24,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a37356203d547c2abf0aa634c2ad548',ramdisk_id='',reservation_id='r-4p9y2cyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1111216102',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:47:01Z,user_data=None,user_id='bcd11beb7046440f814cbf4a13ab0272',uuid=bef1e493-6b2c-4688-98c2-647261feb571,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ddebd25-cfe6-4b0e-8b2d-746fae9f8685", "address": "fa:16:3e:03:fd:b2", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddebd25-cf", "ovs_interfaceid": "6ddebd25-cfe6-4b0e-8b2d-746fae9f8685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:47:27 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Converting VIF {"id": "6ddebd25-cfe6-4b0e-8b2d-746fae9f8685", "address": "fa:16:3e:03:fd:b2", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddebd25-cf", "ovs_interfaceid": "6ddebd25-cfe6-4b0e-8b2d-746fae9f8685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:47:27 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:fd:b2,bridge_name='br-int',has_traffic_filtering=True,id=6ddebd25-cfe6-4b0e-8b2d-746fae9f8685,network=Network(ce0a529c-2119-4b2a-a08f-567e3671c3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddebd25-cf') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:47:27 user nova-compute[73104]: DEBUG os_vif [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:fd:b2,bridge_name='br-int',has_traffic_filtering=True,id=6ddebd25-cfe6-4b0e-8b2d-746fae9f8685,network=Network(ce0a529c-2119-4b2a-a08f-567e3671c3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddebd25-cf') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:47:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:47:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:47:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ddebd25-cf, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:47:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6ddebd25-cf, col_values=(('external_ids', {'iface-id': '6ddebd25-cfe6-4b0e-8b2d-746fae9f8685', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:fd:b2', 'vm-uuid': 'bef1e493-6b2c-4688-98c2-647261feb571'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:47:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:47:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:27 user nova-compute[73104]: INFO os_vif [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:fd:b2,bridge_name='br-int',has_traffic_filtering=True,id=6ddebd25-cfe6-4b0e-8b2d-746fae9f8685,network=Network(ce0a529c-2119-4b2a-a08f-567e3671c3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddebd25-cf')
Aug 26 08:47:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:47:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] No VIF found with MAC fa:16:3e:03:fd:b2, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:47:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:29 user nova-compute[73104]: DEBUG nova.compute.manager [req-95843b56-180f-40c8-a8ef-7370d18101f2 req-a4744024-82ba-4b20-aea5-bf9e09481022 service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Received event network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:47:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-95843b56-180f-40c8-a8ef-7370d18101f2 req-a4744024-82ba-4b20-aea5-bf9e09481022 service nova] Acquiring lock "bef1e493-6b2c-4688-98c2-647261feb571-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:47:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-95843b56-180f-40c8-a8ef-7370d18101f2 req-a4744024-82ba-4b20-aea5-bf9e09481022 service nova] Lock "bef1e493-6b2c-4688-98c2-647261feb571-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:47:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-95843b56-180f-40c8-a8ef-7370d18101f2 req-a4744024-82ba-4b20-aea5-bf9e09481022 service nova] Lock "bef1e493-6b2c-4688-98c2-647261feb571-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:47:29 user nova-compute[73104]: DEBUG nova.compute.manager [req-95843b56-180f-40c8-a8ef-7370d18101f2 req-a4744024-82ba-4b20-aea5-bf9e09481022 service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] No waiting events found dispatching network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:47:29 user nova-compute[73104]: WARNING nova.compute.manager [req-95843b56-180f-40c8-a8ef-7370d18101f2 req-a4744024-82ba-4b20-aea5-bf9e09481022 service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Received unexpected event network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 for instance with vm_state building and task_state spawning.
Aug 26 08:47:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:30 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039650.8831866, bef1e493-6b2c-4688-98c2-647261feb571 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:47:30 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: bef1e493-6b2c-4688-98c2-647261feb571] VM Resumed (Lifecycle Event)
Aug 26 08:47:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:47:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:47:30 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Instance spawned successfully.
Aug 26 08:47:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:47:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:47:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:47:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:47:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:47:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:47:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:47:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:47:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:47:30 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: bef1e493-6b2c-4688-98c2-647261feb571] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:47:30 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039650.8840559, bef1e493-6b2c-4688-98c2-647261feb571 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:47:30 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: bef1e493-6b2c-4688-98c2-647261feb571] VM Started (Lifecycle Event)
Aug 26 08:47:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:47:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:47:31 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: bef1e493-6b2c-4688-98c2-647261feb571] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:47:31 user nova-compute[73104]: INFO nova.compute.manager [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Took 5.31 seconds to spawn the instance on the hypervisor.
Aug 26 08:47:31 user nova-compute[73104]: DEBUG nova.compute.manager [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:47:31 user nova-compute[73104]: DEBUG nova.compute.manager [req-e7982e1e-3cdd-4c17-a40c-a515f1b9ff1e req-0b6570d4-1ea4-47f6-a6fa-97d6dc19df92 service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Received event network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:47:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e7982e1e-3cdd-4c17-a40c-a515f1b9ff1e req-0b6570d4-1ea4-47f6-a6fa-97d6dc19df92 service nova] Acquiring lock "bef1e493-6b2c-4688-98c2-647261feb571-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:47:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e7982e1e-3cdd-4c17-a40c-a515f1b9ff1e req-0b6570d4-1ea4-47f6-a6fa-97d6dc19df92 service nova] Lock "bef1e493-6b2c-4688-98c2-647261feb571-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:47:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e7982e1e-3cdd-4c17-a40c-a515f1b9ff1e req-0b6570d4-1ea4-47f6-a6fa-97d6dc19df92 service nova] Lock "bef1e493-6b2c-4688-98c2-647261feb571-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:47:31 user nova-compute[73104]: DEBUG nova.compute.manager [req-e7982e1e-3cdd-4c17-a40c-a515f1b9ff1e req-0b6570d4-1ea4-47f6-a6fa-97d6dc19df92 service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] No waiting events found dispatching network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:47:31 user nova-compute[73104]: WARNING nova.compute.manager [req-e7982e1e-3cdd-4c17-a40c-a515f1b9ff1e req-0b6570d4-1ea4-47f6-a6fa-97d6dc19df92 service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Received unexpected event network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 for instance with vm_state building and task_state spawning.
Aug 26 08:47:31 user nova-compute[73104]: INFO nova.compute.manager [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Took 31.72 seconds to build instance.
Aug 26 08:47:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5cfd14c2-5b30-4e6e-a00c-e9fd01909a17 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "bef1e493-6b2c-4688-98c2-647261feb571" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.337s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:47:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:35 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693039640.892981, 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:47:35 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] VM Stopped (Lifecycle Event)
Aug 26 08:47:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-43f12e14-6a10-47c1-a0dd-7ae0a97eadbd None None] [instance: 86886ba0-ca1b-42ef-a6f4-9bd7b47b8a8d] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:47:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:45 user nova-compute[73104]: DEBUG nova.compute.manager [req-553cdd32-2dae-4431-a358-0b8ca7bd2ce6 req-cc640867-9fbc-4cd7-8812-ebdf4662c593 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Received event network-changed-68e8044e-0d86-4309-938c-f00d2c392440 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:47:45 user nova-compute[73104]: DEBUG nova.compute.manager [req-553cdd32-2dae-4431-a358-0b8ca7bd2ce6 req-cc640867-9fbc-4cd7-8812-ebdf4662c593 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Refreshing instance network info cache due to event network-changed-68e8044e-0d86-4309-938c-f00d2c392440. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:47:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-553cdd32-2dae-4431-a358-0b8ca7bd2ce6 req-cc640867-9fbc-4cd7-8812-ebdf4662c593 service nova] Acquiring lock "refresh_cache-b7f6e347-c1f3-4f56-86c4-3b28c4729964" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:47:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-553cdd32-2dae-4431-a358-0b8ca7bd2ce6 req-cc640867-9fbc-4cd7-8812-ebdf4662c593 service nova] Acquired lock "refresh_cache-b7f6e347-c1f3-4f56-86c4-3b28c4729964" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:47:45 user nova-compute[73104]: DEBUG nova.network.neutron [req-553cdd32-2dae-4431-a358-0b8ca7bd2ce6 req-cc640867-9fbc-4cd7-8812-ebdf4662c593 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Refreshing network info cache for port 68e8044e-0d86-4309-938c-f00d2c392440 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:47:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:47:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:47:46 user nova-compute[73104]: DEBUG nova.objects.instance [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lazy-loading 'flavor' on Instance uuid b7f6e347-c1f3-4f56-86c4-3b28c4729964 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:47:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:47:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:47:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:47:46 user nova-compute[73104]: INFO nova.compute.manager [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Attaching volume e0162bff-65f9-448e-9744-0d52eb0fbfe9 to /dev/vdb
Aug 26 08:47:46 user nova-compute[73104]: DEBUG os_brick.utils [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:47:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:46 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08c3b44-25cb-4ebe-bbb3-145acdb5155d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:47:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:47 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a449b94a-922d-42a2-a845-f35267ba3ad0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:47:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:47 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14ad5a6-9392-49cc-a08a-557c748e1c0a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:47:47 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7181dc-5ce8-4045-8507-d58dd27beb4c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:47:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:47:47 user nova-compute[73104]: DEBUG nova.network.neutron [req-553cdd32-2dae-4431-a358-0b8ca7bd2ce6 req-cc640867-9fbc-4cd7-8812-ebdf4662c593 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Updated VIF entry in instance network info cache for port 68e8044e-0d86-4309-938c-f00d2c392440. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:47:47 user nova-compute[73104]: DEBUG nova.network.neutron [req-553cdd32-2dae-4431-a358-0b8ca7bd2ce6 req-cc640867-9fbc-4cd7-8812-ebdf4662c593 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Updating instance_info_cache with network_info: [{"id": "68e8044e-0d86-4309-938c-f00d2c392440", "address": "fa:16:3e:8e:1c:6e", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68e8044e-0d", "ovs_interfaceid": "68e8044e-0d86-4309-938c-f00d2c392440", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:47:47 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:47:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-553cdd32-2dae-4431-a358-0b8ca7bd2ce6 req-cc640867-9fbc-4cd7-8812-ebdf4662c593 service nova] Releasing lock "refresh_cache-b7f6e347-c1f3-4f56-86c4-3b28c4729964" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:47:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:47:47 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:47:47 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc050c9-27ec-4b41-b549-e1960016c920]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:47:47 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:47:47 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:47:47 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:47:47 user nova-compute[73104]: DEBUG os_brick.utils [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:47:47 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Updating existing volume attachment record: 4f69a3b0-2003-444f-8187-452f2eb555fa {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 08:47:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:47:48 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:47:48 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73104) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 08:47:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:51 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:47:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:52 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:47:52 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 08:47:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-3cf85d2f-de0d-4e9b-a534-98c799ae8db9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:47:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-3cf85d2f-de0d-4e9b-a534-98c799ae8db9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:47:52 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 08:47:52 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Updating instance_info_cache with network_info: [{"id": "1ff011d7-db1c-4bac-a2d3-ecf253085265", "address": "fa:16:3e:72:e3:65", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff011d7-db", "ovs_interfaceid": "1ff011d7-db1c-4bac-a2d3-ecf253085265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:47:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-3cf85d2f-de0d-4e9b-a534-98c799ae8db9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:47:52 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 08:47:52 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:47:52 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:47:52 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:47:52 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Cleaning up deleted instances {{(pid=73104) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 08:47:53 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] There are 0 instances to clean {{(pid=73104) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 08:47:53 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:47:53 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:47:53 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:47:53 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:47:53 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 08:47:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:54 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:47:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:47:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:47:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:47:54 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 08:47:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:54 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:47:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:57 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:47:57 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:47:57 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=7965MB free_disk=24.38074493408203GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 08:47:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:47:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:47:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:57 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance b5e1f82c-5675-4c37-8ba2-44e6a341a576 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:47:57 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 3cf85d2f-de0d-4e9b-a534-98c799ae8db9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:47:57 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 02665c70-cf75-44ba-9d90-eb9e5f12e0b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:47:57 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance b7f6e347-c1f3-4f56-86c4-3b28c4729964 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:47:57 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance bef1e493-6b2c-4688-98c2-647261feb571 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:47:57 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 55966005-e534-45d3-9bd4-cea5d54b661e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:47:57 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 08:47:57 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 08:47:57 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Refreshing inventories for resource provider 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 08:47:57 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Updating ProviderTree inventory for provider 8a2a2397-4d47-4524-8146-84db4225a812 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 08:47:57 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Updating inventory in ProviderTree for provider 8a2a2397-4d47-4524-8146-84db4225a812 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 08:47:57 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Refreshing aggregate associations for resource provider 8a2a2397-4d47-4524-8146-84db4225a812, aggregates: None {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 08:47:57 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Refreshing trait associations for resource provider 8a2a2397-4d47-4524-8146-84db4225a812, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 08:47:57 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:47:57 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:47:57 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 08:47:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.671s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:47:57 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:47:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:47:58 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:47:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkWilbGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:47:58 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:47:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:47:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:47:58 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:47:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:47:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:47:58 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:47:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:58 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1bd567-0e52-460a-a562-b65e49ef2d5f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:47:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:47:58 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:47:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:58 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca14f0d6-c658-4d41-bfb7-ef71377d97f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:47:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9] added
Aug 26 08:47:58 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:47:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:58 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad923b6-86ed-40d9-aef1-dd8e7c07c4e5]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3697192-7348-4701-9a09-4987bdad5920]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nkWilbGB {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nkWilbGB" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9b1562-2c45-4f05-9752-0328eeed8e50]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nkWilbGB'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6daaa7d-cb47-4f3d-be6a-8d683d95bb03]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5c8034-0556-4015-b479-d62033e05dc0]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:47:59 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:47:59 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec9ccd2-c75b-4cc0-8740-f1337c3172de]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9, portal: 172.16.0.220,3260]
Aug 26 08:47:59 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9, portal: 172.16.0.220,3260] successful.
Aug 26 08:47:59 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6197a580-d103-4c52-ba38-8843a408122b]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74b4309-48da-44bc-96df-b7aa3d74446b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:47:59 user nova-compute[73104]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)
Aug 26 08:47:59 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:47:59 user nova-compute[73104]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)
Aug 26 08:47:59 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bdc3490-2a2e-45bf-8acc-df0ce3e7efe5]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:47:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkWilbGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:48:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:48:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23234306164383265', 'path': '/dev/sdc'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:48:00 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234306164383265', 'path': '/dev/sdc'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:48:00 user nova-compute[73104]: DEBUG nova.objects.instance [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lazy-loading 'flavor' on Instance uuid b7f6e347-c1f3-4f56-86c4-3b28c4729964 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:48:00 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 08:48:00 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:48:00 user nova-compute[73104]:   <source dev="/dev/sdc"/>
Aug 26 08:48:00 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:48:00 user nova-compute[73104]:   <serial>e0162bff-65f9-448e-9744-0d52eb0fbfe9</serial>
Aug 26 08:48:00 user nova-compute[73104]: </disk>
Aug 26 08:48:00 user nova-compute[73104]:  {{(pid=73104) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 08:48:00 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:48:00 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:48:00 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] No VIF found with MAC fa:16:3e:8e:1c:6e, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:48:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-785c8c4e-d1d1-46b3-9de0-f00026822a7b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.057s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:02 user nova-compute[73104]: INFO nova.compute.manager [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Rebuilding instance
Aug 26 08:48:02 user nova-compute[73104]: DEBUG nova.compute.manager [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:48:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:03 user nova-compute[73104]: DEBUG nova.compute.manager [req-0570d83d-bc05-4b82-b01a-5265ba8c3bf9 req-0f91d72b-6f12-419e-a8ba-8330b6c38b46 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Received event network-vif-unplugged-68e8044e-0d86-4309-938c-f00d2c392440 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:48:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0570d83d-bc05-4b82-b01a-5265ba8c3bf9 req-0f91d72b-6f12-419e-a8ba-8330b6c38b46 service nova] Acquiring lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0570d83d-bc05-4b82-b01a-5265ba8c3bf9 req-0f91d72b-6f12-419e-a8ba-8330b6c38b46 service nova] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0570d83d-bc05-4b82-b01a-5265ba8c3bf9 req-0f91d72b-6f12-419e-a8ba-8330b6c38b46 service nova] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:03 user nova-compute[73104]: DEBUG nova.compute.manager [req-0570d83d-bc05-4b82-b01a-5265ba8c3bf9 req-0f91d72b-6f12-419e-a8ba-8330b6c38b46 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] No waiting events found dispatching network-vif-unplugged-68e8044e-0d86-4309-938c-f00d2c392440 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:48:03 user nova-compute[73104]: WARNING nova.compute.manager [req-0570d83d-bc05-4b82-b01a-5265ba8c3bf9 req-0f91d72b-6f12-419e-a8ba-8330b6c38b46 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Received unexpected event network-vif-unplugged-68e8044e-0d86-4309-938c-f00d2c392440 for instance with vm_state active and task_state rebuilding.
Aug 26 08:48:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:03 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Instance destroyed successfully.
Aug 26 08:48:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:03 user nova-compute[73104]: INFO nova.compute.manager [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Detaching volume e0162bff-65f9-448e-9744-0d52eb0fbfe9
Aug 26 08:48:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:04 user nova-compute[73104]: INFO nova.virt.block_device [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Attempting to driver detach volume e0162bff-65f9-448e-9744-0d52eb0fbfe9 from mountpoint /dev/vdb
Aug 26 08:48:04 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Attempting to detach device vdb from instance b7f6e347-c1f3-4f56-86c4-3b28c4729964 from the persistent domain config. {{(pid=73104) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:48:04 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:48:04 user nova-compute[73104]:   <source dev="/dev/sdc"/>
Aug 26 08:48:04 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:48:04 user nova-compute[73104]:   <serial>e0162bff-65f9-448e-9744-0d52eb0fbfe9</serial>
Aug 26 08:48:04 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 08:48:04 user nova-compute[73104]: </disk>
Aug 26 08:48:04 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:04 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Successfully detached device vdb from instance b7f6e347-c1f3-4f56-86c4-3b28c4729964 from the persistent domain config.
Aug 26 08:48:04 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkWilbGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:48:04 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 08:48:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[77dc00f4-21d0-4dd5-b8ba-6aec1dc3036a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[302dc601-4801-4171-9b23-4f1054fa521d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:48:04 user nova-compute[73104]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)
Aug 26 08:48:04 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:48:04 user nova-compute[73104]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)
Aug 26 08:48:04 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0cc069240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9'): ({'sdc'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Removing single pathed devices sdc {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[655e6d35-0024-45b0-8339-a6cfd423749b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb25b58-767a-4267-91ed-b519f50055bc]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Flushing IO for device /dev/sdc {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8e07a7-9531-4381-bdb6-ee8c6ddee9aa]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[210a2ea6-ef4f-4c71-8b8c-b61a0e42f178]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] SCSI volumes sdc have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddbefdc-f04d-46e6-a1d5-1c242af184b2]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[08485bf4-c863-44f8-83ea-1e4250380081]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9, portal: 172.16.0.220,3260]
Aug 26 08:48:04 user nova-compute[73104]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9, portal: 172.16.0.220,3260] successful.
Aug 26 08:48:04 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df8c932-c8fd-43d3-8ce6-1f0446755d23]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] <== disconnect_volume: return (305ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:48:04 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:48:05 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Instance destroyed successfully.
Aug 26 08:48:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:45:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-507169638',display_name='tempest-ServerActionsTestOtherA-server-1640836795',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-507169638',id=23,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYLqMl8GpNjfNVCgo2H+2r4h7f+wltYEXzpCmKmElhA0DBXXS8OJ+jJMfreN4vSnENs3yu+UIcdrUm0f/2htkz5kCGsZ2tw03AkxIejr18INsy4zP7Li4asqVv0WIUqpw==',key_name='tempest-keypair-2115817653',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:46:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='efb864c0a34541dca00c6dbbcea17319',ramdisk_id='',reservation_id='r-p9meui0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1245661612',owner_user_name='tempest-ServerActionsTestOtherA-1245661612-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:48:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='257343af54bd42b591e8874ef4ecf8dc',uuid=b7f6e347-c1f3-4f56-86c4-3b28c4729964,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68e8044e-0d86-4309-938c-f00d2c392440", "address": "fa:16:3e:8e:1c:6e", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68e8044e-0d", "ovs_interfaceid": "68e8044e-0d86-4309-938c-f00d2c392440", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Converting VIF {"id": "68e8044e-0d86-4309-938c-f00d2c392440", "address": "fa:16:3e:8e:1c:6e", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68e8044e-0d", "ovs_interfaceid": "68e8044e-0d86-4309-938c-f00d2c392440", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:1c:6e,bridge_name='br-int',has_traffic_filtering=True,id=68e8044e-0d86-4309-938c-f00d2c392440,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68e8044e-0d') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG os_vif [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:1c:6e,bridge_name='br-int',has_traffic_filtering=True,id=68e8044e-0d86-4309-938c-f00d2c392440,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68e8044e-0d') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68e8044e-0d, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:48:05 user nova-compute[73104]: INFO os_vif [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:1c:6e,bridge_name='br-int',has_traffic_filtering=True,id=68e8044e-0d86-4309-938c-f00d2c392440,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68e8044e-0d')
Aug 26 08:48:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkWilbGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:48:05 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 08:48:05 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f072d19b-43dd-4324-bb17-b5f08e7594b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f940724e-0122-494e-87d0-f7008d71f977]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:48:05 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:48:05 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b46e69e0>, {}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Disconnecting from: [] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.048s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] <== disconnect_volume: return (50ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:48:05 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Deleting instance files /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964_del
Aug 26 08:48:05 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Deletion of /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964_del complete
Aug 26 08:48:05 user nova-compute[73104]: INFO nova.virt.block_device [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Booting with volume e0162bff-65f9-448e-9744-0d52eb0fbfe9 at /dev/vdb
Aug 26 08:48:05 user nova-compute[73104]: DEBUG os_brick.utils [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4f5150-7b37-432a-a6b3-4e4563c10f19]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[598fc2e0-9cbd-4f77-b8e4-ca1159d48d35]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2401d1-b70d-4872-8a92-d78c5d32b603]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e37fbc-309d-4480-9c90-560facfe7efb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG nova.compute.manager [req-e61d218a-f984-4061-bead-346cbb751d02 req-2d223abe-ef04-4236-8334-2fe3f2eaa7f4 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Received event network-vif-plugged-68e8044e-0d86-4309-938c-f00d2c392440 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e61d218a-f984-4061-bead-346cbb751d02 req-2d223abe-ef04-4236-8334-2fe3f2eaa7f4 service nova] Acquiring lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e61d218a-f984-4061-bead-346cbb751d02 req-2d223abe-ef04-4236-8334-2fe3f2eaa7f4 service nova] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e61d218a-f984-4061-bead-346cbb751d02 req-2d223abe-ef04-4236-8334-2fe3f2eaa7f4 service nova] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG nova.compute.manager [req-e61d218a-f984-4061-bead-346cbb751d02 req-2d223abe-ef04-4236-8334-2fe3f2eaa7f4 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] No waiting events found dispatching network-vif-plugged-68e8044e-0d86-4309-938c-f00d2c392440 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:48:05 user nova-compute[73104]: WARNING nova.compute.manager [req-e61d218a-f984-4061-bead-346cbb751d02 req-2d223abe-ef04-4236-8334-2fe3f2eaa7f4 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Received unexpected event network-vif-plugged-68e8044e-0d86-4309-938c-f00d2c392440 for instance with vm_state active and task_state rebuild_block_device_mapping.
Aug 26 08:48:05 user nova-compute[73104]: DEBUG nova.compute.manager [req-e61d218a-f984-4061-bead-346cbb751d02 req-2d223abe-ef04-4236-8334-2fe3f2eaa7f4 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Received event network-vif-plugged-68e8044e-0d86-4309-938c-f00d2c392440 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e61d218a-f984-4061-bead-346cbb751d02 req-2d223abe-ef04-4236-8334-2fe3f2eaa7f4 service nova] Acquiring lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e61d218a-f984-4061-bead-346cbb751d02 req-2d223abe-ef04-4236-8334-2fe3f2eaa7f4 service nova] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e61d218a-f984-4061-bead-346cbb751d02 req-2d223abe-ef04-4236-8334-2fe3f2eaa7f4 service nova] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG nova.compute.manager [req-e61d218a-f984-4061-bead-346cbb751d02 req-2d223abe-ef04-4236-8334-2fe3f2eaa7f4 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] No waiting events found dispatching network-vif-plugged-68e8044e-0d86-4309-938c-f00d2c392440 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:48:05 user nova-compute[73104]: WARNING nova.compute.manager [req-e61d218a-f984-4061-bead-346cbb751d02 req-2d223abe-ef04-4236-8334-2fe3f2eaa7f4 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Received unexpected event network-vif-plugged-68e8044e-0d86-4309-938c-f00d2c392440 for instance with vm_state active and task_state rebuild_block_device_mapping.
Aug 26 08:48:05 user nova-compute[73104]: DEBUG nova.compute.manager [req-e61d218a-f984-4061-bead-346cbb751d02 req-2d223abe-ef04-4236-8334-2fe3f2eaa7f4 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Received event network-vif-plugged-68e8044e-0d86-4309-938c-f00d2c392440 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e61d218a-f984-4061-bead-346cbb751d02 req-2d223abe-ef04-4236-8334-2fe3f2eaa7f4 service nova] Acquiring lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e61d218a-f984-4061-bead-346cbb751d02 req-2d223abe-ef04-4236-8334-2fe3f2eaa7f4 service nova] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e61d218a-f984-4061-bead-346cbb751d02 req-2d223abe-ef04-4236-8334-2fe3f2eaa7f4 service nova] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG nova.compute.manager [req-e61d218a-f984-4061-bead-346cbb751d02 req-2d223abe-ef04-4236-8334-2fe3f2eaa7f4 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] No waiting events found dispatching network-vif-plugged-68e8044e-0d86-4309-938c-f00d2c392440 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:48:05 user nova-compute[73104]: WARNING nova.compute.manager [req-e61d218a-f984-4061-bead-346cbb751d02 req-2d223abe-ef04-4236-8334-2fe3f2eaa7f4 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Received unexpected event network-vif-plugged-68e8044e-0d86-4309-938c-f00d2c392440 for instance with vm_state active and task_state rebuild_block_device_mapping.
Aug 26 08:48:05 user nova-compute[73104]: DEBUG nova.compute.manager [req-e61d218a-f984-4061-bead-346cbb751d02 req-2d223abe-ef04-4236-8334-2fe3f2eaa7f4 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Received event network-vif-unplugged-68e8044e-0d86-4309-938c-f00d2c392440 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e61d218a-f984-4061-bead-346cbb751d02 req-2d223abe-ef04-4236-8334-2fe3f2eaa7f4 service nova] Acquiring lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e61d218a-f984-4061-bead-346cbb751d02 req-2d223abe-ef04-4236-8334-2fe3f2eaa7f4 service nova] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e61d218a-f984-4061-bead-346cbb751d02 req-2d223abe-ef04-4236-8334-2fe3f2eaa7f4 service nova] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG nova.compute.manager [req-e61d218a-f984-4061-bead-346cbb751d02 req-2d223abe-ef04-4236-8334-2fe3f2eaa7f4 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] No waiting events found dispatching network-vif-unplugged-68e8044e-0d86-4309-938c-f00d2c392440 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:48:05 user nova-compute[73104]: WARNING nova.compute.manager [req-e61d218a-f984-4061-bead-346cbb751d02 req-2d223abe-ef04-4236-8334-2fe3f2eaa7f4 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Received unexpected event network-vif-unplugged-68e8044e-0d86-4309-938c-f00d2c392440 for instance with vm_state active and task_state rebuild_block_device_mapping.
Aug 26 08:48:05 user nova-compute[73104]: DEBUG nova.compute.manager [req-e61d218a-f984-4061-bead-346cbb751d02 req-2d223abe-ef04-4236-8334-2fe3f2eaa7f4 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Received event network-vif-plugged-68e8044e-0d86-4309-938c-f00d2c392440 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e61d218a-f984-4061-bead-346cbb751d02 req-2d223abe-ef04-4236-8334-2fe3f2eaa7f4 service nova] Acquiring lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e61d218a-f984-4061-bead-346cbb751d02 req-2d223abe-ef04-4236-8334-2fe3f2eaa7f4 service nova] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e61d218a-f984-4061-bead-346cbb751d02 req-2d223abe-ef04-4236-8334-2fe3f2eaa7f4 service nova] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG nova.compute.manager [req-e61d218a-f984-4061-bead-346cbb751d02 req-2d223abe-ef04-4236-8334-2fe3f2eaa7f4 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] No waiting events found dispatching network-vif-plugged-68e8044e-0d86-4309-938c-f00d2c392440 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:48:05 user nova-compute[73104]: WARNING nova.compute.manager [req-e61d218a-f984-4061-bead-346cbb751d02 req-2d223abe-ef04-4236-8334-2fe3f2eaa7f4 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Received unexpected event network-vif-plugged-68e8044e-0d86-4309-938c-f00d2c392440 for instance with vm_state active and task_state rebuild_block_device_mapping.
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:48:05 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:48:05 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2374bf8f-2ea6-4617-b6de-4183b9195f9a]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG os_brick.utils [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:48:05 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Updating existing volume attachment record: 1d00cdf1-8c38-4bae-b056-4b24f709e49e {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 08:48:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "5ddeefec-ed4f-4fec-8d1c-02a2ddf65023" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "5ddeefec-ed4f-4fec-8d1c-02a2ddf65023" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:15 user nova-compute[73104]: DEBUG nova.compute.manager [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:48:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:15 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:48:15 user nova-compute[73104]: INFO nova.compute.claims [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Claim successful on node user
Aug 26 08:48:16 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:48:16 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:48:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.337s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:48:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:48:16 user nova-compute[73104]: DEBUG nova.network.neutron [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:48:16 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:48:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:48:16 user nova-compute[73104]: DEBUG nova.policy [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '062587ed00ae457889f884346c99e11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad68e5623014e2fb3f10ba92d388291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:48:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:48:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:48:16 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Creating image(s)
Aug 26 08:48:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "/opt/stack/data/nova/instances/5ddeefec-ed4f-4fec-8d1c-02a2ddf65023/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "/opt/stack/data/nova/instances/5ddeefec-ed4f-4fec-8d1c-02a2ddf65023/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "/opt/stack/data/nova/instances/5ddeefec-ed4f-4fec-8d1c-02a2ddf65023/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.215s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.205s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/5ddeefec-ed4f-4fec-8d1c-02a2ddf65023/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/5ddeefec-ed4f-4fec-8d1c-02a2ddf65023/disk 1073741824" returned: 0 in 0.050s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.196s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:17 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5ddeefec-ed4f-4fec-8d1c-02a2ddf65023/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 08:48:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ddeefec-ed4f-4fec-8d1c-02a2ddf65023/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:17 user nova-compute[73104]: DEBUG nova.network.neutron [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Successfully created port: 06ff3140-31c9-478c-9d4e-c2a4ee346df4 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:48:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ddeefec-ed4f-4fec-8d1c-02a2ddf65023/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:17 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Cannot resize image /opt/stack/data/nova/instances/5ddeefec-ed4f-4fec-8d1c-02a2ddf65023/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 08:48:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:48:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Ensure instance console log exists: /opt/stack/data/nova/instances/5ddeefec-ed4f-4fec-8d1c-02a2ddf65023/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:48:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.network.neutron [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Successfully updated port: 06ff3140-31c9-478c-9d4e-c2a4ee346df4 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "refresh_cache-5ddeefec-ed4f-4fec-8d1c-02a2ddf65023" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquired lock "refresh_cache-5ddeefec-ed4f-4fec-8d1c-02a2ddf65023" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.network.neutron [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.network.neutron [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.compute.manager [req-1a5ce0b7-7411-4c5a-8df3-2101d240d468 req-f870d225-a0b5-419c-9e0c-88f99019e038 service nova] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Received event network-changed-06ff3140-31c9-478c-9d4e-c2a4ee346df4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.compute.manager [req-1a5ce0b7-7411-4c5a-8df3-2101d240d468 req-f870d225-a0b5-419c-9e0c-88f99019e038 service nova] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Refreshing instance network info cache due to event network-changed-06ff3140-31c9-478c-9d4e-c2a4ee346df4. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1a5ce0b7-7411-4c5a-8df3-2101d240d468 req-f870d225-a0b5-419c-9e0c-88f99019e038 service nova] Acquiring lock "refresh_cache-5ddeefec-ed4f-4fec-8d1c-02a2ddf65023" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.network.neutron [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Updating instance_info_cache with network_info: [{"id": "06ff3140-31c9-478c-9d4e-c2a4ee346df4", "address": "fa:16:3e:e2:2f:c2", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06ff3140-31", "ovs_interfaceid": "06ff3140-31c9-478c-9d4e-c2a4ee346df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Releasing lock "refresh_cache-5ddeefec-ed4f-4fec-8d1c-02a2ddf65023" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.compute.manager [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Instance network_info: |[{"id": "06ff3140-31c9-478c-9d4e-c2a4ee346df4", "address": "fa:16:3e:e2:2f:c2", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06ff3140-31", "ovs_interfaceid": "06ff3140-31c9-478c-9d4e-c2a4ee346df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1a5ce0b7-7411-4c5a-8df3-2101d240d468 req-f870d225-a0b5-419c-9e0c-88f99019e038 service nova] Acquired lock "refresh_cache-5ddeefec-ed4f-4fec-8d1c-02a2ddf65023" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.network.neutron [req-1a5ce0b7-7411-4c5a-8df3-2101d240d468 req-f870d225-a0b5-419c-9e0c-88f99019e038 service nova] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Refreshing network info cache for port 06ff3140-31c9-478c-9d4e-c2a4ee346df4 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Start _get_guest_xml network_info=[{"id": "06ff3140-31c9-478c-9d4e-c2a4ee346df4", "address": "fa:16:3e:e2:2f:c2", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06ff3140-31", "ovs_interfaceid": "06ff3140-31c9-478c-9d4e-c2a4ee346df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:48:18 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:48:18 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:48:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1947806886',display_name='tempest-AttachVolumeNegativeTest-server-1947806886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1947806886',id=26,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3zEFdjwtyy3z3V9yFt/ad6c0VMW1+BT5tG/K8PStg58n0jMcAMvcGQUArDzPCM/e971SPyjfjEKpdiZRBzjCYz/LB4F24ZZaHnw5l+84MLmZvyLQJWhy6mfupasy1WWQ==',key_name='tempest-keypair-1404848892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ad68e5623014e2fb3f10ba92d388291',ramdisk_id='',reservation_id='r-20uwd4qd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1286694855',owner_user_name='tempest-AttachVolumeNegativeTest-1286694855-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:48:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='062587ed00ae457889f884346c99e11b',uuid=5ddeefec-ed4f-4fec-8d1c-02a2ddf65023,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06ff3140-31c9-478c-9d4e-c2a4ee346df4", "address": "fa:16:3e:e2:2f:c2", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06ff3140-31", "ovs_interfaceid": "06ff3140-31c9-478c-9d4e-c2a4ee346df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Converting VIF {"id": "06ff3140-31c9-478c-9d4e-c2a4ee346df4", "address": "fa:16:3e:e2:2f:c2", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06ff3140-31", "ovs_interfaceid": "06ff3140-31c9-478c-9d4e-c2a4ee346df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:2f:c2,bridge_name='br-int',has_traffic_filtering=True,id=06ff3140-31c9-478c-9d4e-c2a4ee346df4,network=Network(ea6c6ce0-85a4-40db-96e2-ca078887ab66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06ff3140-31') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.objects.instance [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:48:18 user nova-compute[73104]:   <uuid>5ddeefec-ed4f-4fec-8d1c-02a2ddf65023</uuid>
Aug 26 08:48:18 user nova-compute[73104]:   <name>instance-0000001a</name>
Aug 26 08:48:18 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:48:18 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:48:18 user nova-compute[73104]:   <metadata>
Aug 26 08:48:18 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:48:18 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:48:18 user nova-compute[73104]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1947806886</nova:name>
Aug 26 08:48:18 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:48:18</nova:creationTime>
Aug 26 08:48:18 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:48:18 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:48:18 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:48:18 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:48:18 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:48:18 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:48:18 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:48:18 user nova-compute[73104]:       <nova:owner>
Aug 26 08:48:18 user nova-compute[73104]:         <nova:user uuid="062587ed00ae457889f884346c99e11b">tempest-AttachVolumeNegativeTest-1286694855-project-member</nova:user>
Aug 26 08:48:18 user nova-compute[73104]:         <nova:project uuid="4ad68e5623014e2fb3f10ba92d388291">tempest-AttachVolumeNegativeTest-1286694855</nova:project>
Aug 26 08:48:18 user nova-compute[73104]:       </nova:owner>
Aug 26 08:48:18 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:48:18 user nova-compute[73104]:       <nova:ports>
Aug 26 08:48:18 user nova-compute[73104]:         <nova:port uuid="06ff3140-31c9-478c-9d4e-c2a4ee346df4">
Aug 26 08:48:18 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 08:48:18 user nova-compute[73104]:         </nova:port>
Aug 26 08:48:18 user nova-compute[73104]:       </nova:ports>
Aug 26 08:48:18 user nova-compute[73104]:     </nova:instance>
Aug 26 08:48:18 user nova-compute[73104]:   </metadata>
Aug 26 08:48:18 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:48:18 user nova-compute[73104]:     <system>
Aug 26 08:48:18 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:48:18 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:48:18 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:48:18 user nova-compute[73104]:       <entry name="serial">5ddeefec-ed4f-4fec-8d1c-02a2ddf65023</entry>
Aug 26 08:48:18 user nova-compute[73104]:       <entry name="uuid">5ddeefec-ed4f-4fec-8d1c-02a2ddf65023</entry>
Aug 26 08:48:18 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:48:18 user nova-compute[73104]:     </system>
Aug 26 08:48:18 user nova-compute[73104]:   </sysinfo>
Aug 26 08:48:18 user nova-compute[73104]:   <os>
Aug 26 08:48:18 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:48:18 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:48:18 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:48:18 user nova-compute[73104]:   </os>
Aug 26 08:48:18 user nova-compute[73104]:   <features>
Aug 26 08:48:18 user nova-compute[73104]:     <acpi/>
Aug 26 08:48:18 user nova-compute[73104]:     <apic/>
Aug 26 08:48:18 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:48:18 user nova-compute[73104]:   </features>
Aug 26 08:48:18 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:48:18 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:48:18 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:48:18 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:48:18 user nova-compute[73104]:   </clock>
Aug 26 08:48:18 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:48:18 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:48:18 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:48:18 user nova-compute[73104]:   </cpu>
Aug 26 08:48:18 user nova-compute[73104]:   <devices>
Aug 26 08:48:18 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:48:18 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:48:18 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/5ddeefec-ed4f-4fec-8d1c-02a2ddf65023/disk"/>
Aug 26 08:48:18 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:48:18 user nova-compute[73104]:     </disk>
Aug 26 08:48:18 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:48:18 user nova-compute[73104]:       <mac address="fa:16:3e:e2:2f:c2"/>
Aug 26 08:48:18 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:48:18 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:48:18 user nova-compute[73104]:       <target dev="tap06ff3140-31"/>
Aug 26 08:48:18 user nova-compute[73104]:     </interface>
Aug 26 08:48:18 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:48:18 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/5ddeefec-ed4f-4fec-8d1c-02a2ddf65023/console.log" append="off"/>
Aug 26 08:48:18 user nova-compute[73104]:     </serial>
Aug 26 08:48:18 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:48:18 user nova-compute[73104]:     <video>
Aug 26 08:48:18 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:48:18 user nova-compute[73104]:     </video>
Aug 26 08:48:18 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:48:18 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:48:18 user nova-compute[73104]:     </rng>
Aug 26 08:48:18 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:48:18 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:48:18 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:48:18 user nova-compute[73104]:     </memballoon>
Aug 26 08:48:18 user nova-compute[73104]:   </devices>
Aug 26 08:48:18 user nova-compute[73104]: </domain>
Aug 26 08:48:18 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:48:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1947806886',display_name='tempest-AttachVolumeNegativeTest-server-1947806886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1947806886',id=26,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3zEFdjwtyy3z3V9yFt/ad6c0VMW1+BT5tG/K8PStg58n0jMcAMvcGQUArDzPCM/e971SPyjfjEKpdiZRBzjCYz/LB4F24ZZaHnw5l+84MLmZvyLQJWhy6mfupasy1WWQ==',key_name='tempest-keypair-1404848892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ad68e5623014e2fb3f10ba92d388291',ramdisk_id='',reservation_id='r-20uwd4qd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1286694855',owner_user_name='tempest-AttachVolumeNegativeTest-1286694855-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:48:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='062587ed00ae457889f884346c99e11b',uuid=5ddeefec-ed4f-4fec-8d1c-02a2ddf65023,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06ff3140-31c9-478c-9d4e-c2a4ee346df4", "address": "fa:16:3e:e2:2f:c2", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06ff3140-31", "ovs_interfaceid": "06ff3140-31c9-478c-9d4e-c2a4ee346df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Converting VIF {"id": "06ff3140-31c9-478c-9d4e-c2a4ee346df4", "address": "fa:16:3e:e2:2f:c2", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06ff3140-31", "ovs_interfaceid": "06ff3140-31c9-478c-9d4e-c2a4ee346df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:2f:c2,bridge_name='br-int',has_traffic_filtering=True,id=06ff3140-31c9-478c-9d4e-c2a4ee346df4,network=Network(ea6c6ce0-85a4-40db-96e2-ca078887ab66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06ff3140-31') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG os_vif [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:2f:c2,bridge_name='br-int',has_traffic_filtering=True,id=06ff3140-31c9-478c-9d4e-c2a4ee346df4,network=Network(ea6c6ce0-85a4-40db-96e2-ca078887ab66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06ff3140-31') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06ff3140-31, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap06ff3140-31, col_values=(('external_ids', {'iface-id': '06ff3140-31c9-478c-9d4e-c2a4ee346df4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:2f:c2', 'vm-uuid': '5ddeefec-ed4f-4fec-8d1c-02a2ddf65023'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:18 user nova-compute[73104]: INFO os_vif [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:2f:c2,bridge_name='br-int',has_traffic_filtering=True,id=06ff3140-31c9-478c-9d4e-c2a4ee346df4,network=Network(ea6c6ce0-85a4-40db-96e2-ca078887ab66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06ff3140-31')
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] No VIF found with MAC fa:16:3e:e2:2f:c2, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693039683.84031, b7f6e347-c1f3-4f56-86c4-3b28c4729964 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:48:18 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] VM Stopped (Lifecycle Event)
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.compute.manager [None req-da629d28-a556-499b-812f-43c8d40a74e5 None None] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.network.neutron [req-1a5ce0b7-7411-4c5a-8df3-2101d240d468 req-f870d225-a0b5-419c-9e0c-88f99019e038 service nova] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Updated VIF entry in instance network info cache for port 06ff3140-31c9-478c-9d4e-c2a4ee346df4. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG nova.network.neutron [req-1a5ce0b7-7411-4c5a-8df3-2101d240d468 req-f870d225-a0b5-419c-9e0c-88f99019e038 service nova] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Updating instance_info_cache with network_info: [{"id": "06ff3140-31c9-478c-9d4e-c2a4ee346df4", "address": "fa:16:3e:e2:2f:c2", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06ff3140-31", "ovs_interfaceid": "06ff3140-31c9-478c-9d4e-c2a4ee346df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:48:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1a5ce0b7-7411-4c5a-8df3-2101d240d468 req-f870d225-a0b5-419c-9e0c-88f99019e038 service nova] Releasing lock "refresh_cache-5ddeefec-ed4f-4fec-8d1c-02a2ddf65023" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:48:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:20 user nova-compute[73104]: DEBUG nova.compute.manager [req-094588e3-aaae-4500-9ea7-1ce06e7d8bdc req-33650d9f-c902-436d-b14c-ffe56f239400 service nova] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Received event network-vif-plugged-06ff3140-31c9-478c-9d4e-c2a4ee346df4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:48:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-094588e3-aaae-4500-9ea7-1ce06e7d8bdc req-33650d9f-c902-436d-b14c-ffe56f239400 service nova] Acquiring lock "5ddeefec-ed4f-4fec-8d1c-02a2ddf65023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-094588e3-aaae-4500-9ea7-1ce06e7d8bdc req-33650d9f-c902-436d-b14c-ffe56f239400 service nova] Lock "5ddeefec-ed4f-4fec-8d1c-02a2ddf65023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-094588e3-aaae-4500-9ea7-1ce06e7d8bdc req-33650d9f-c902-436d-b14c-ffe56f239400 service nova] Lock "5ddeefec-ed4f-4fec-8d1c-02a2ddf65023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:20 user nova-compute[73104]: DEBUG nova.compute.manager [req-094588e3-aaae-4500-9ea7-1ce06e7d8bdc req-33650d9f-c902-436d-b14c-ffe56f239400 service nova] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] No waiting events found dispatching network-vif-plugged-06ff3140-31c9-478c-9d4e-c2a4ee346df4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:48:20 user nova-compute[73104]: WARNING nova.compute.manager [req-094588e3-aaae-4500-9ea7-1ce06e7d8bdc req-33650d9f-c902-436d-b14c-ffe56f239400 service nova] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Received unexpected event network-vif-plugged-06ff3140-31c9-478c-9d4e-c2a4ee346df4 for instance with vm_state building and task_state spawning.
Aug 26 08:48:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:22 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039702.1510334, 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:48:22 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] VM Resumed (Lifecycle Event)
Aug 26 08:48:22 user nova-compute[73104]: DEBUG nova.compute.manager [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:48:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:48:22 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Instance spawned successfully.
Aug 26 08:48:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:48:22 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:48:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:48:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:48:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:48:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:48:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:48:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:48:22 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:48:22 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:48:22 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039702.1602125, 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:48:22 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] VM Started (Lifecycle Event)
Aug 26 08:48:22 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:48:22 user nova-compute[73104]: DEBUG nova.compute.manager [req-979f6a3c-fa35-4323-969c-364f690375c7 req-12851ede-4c94-4c54-bb8a-e5243672270a service nova] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Received event network-vif-plugged-06ff3140-31c9-478c-9d4e-c2a4ee346df4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:48:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-979f6a3c-fa35-4323-969c-364f690375c7 req-12851ede-4c94-4c54-bb8a-e5243672270a service nova] Acquiring lock "5ddeefec-ed4f-4fec-8d1c-02a2ddf65023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-979f6a3c-fa35-4323-969c-364f690375c7 req-12851ede-4c94-4c54-bb8a-e5243672270a service nova] Lock "5ddeefec-ed4f-4fec-8d1c-02a2ddf65023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-979f6a3c-fa35-4323-969c-364f690375c7 req-12851ede-4c94-4c54-bb8a-e5243672270a service nova] Lock "5ddeefec-ed4f-4fec-8d1c-02a2ddf65023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:22 user nova-compute[73104]: DEBUG nova.compute.manager [req-979f6a3c-fa35-4323-969c-364f690375c7 req-12851ede-4c94-4c54-bb8a-e5243672270a service nova] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] No waiting events found dispatching network-vif-plugged-06ff3140-31c9-478c-9d4e-c2a4ee346df4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:48:22 user nova-compute[73104]: WARNING nova.compute.manager [req-979f6a3c-fa35-4323-969c-364f690375c7 req-12851ede-4c94-4c54-bb8a-e5243672270a service nova] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Received unexpected event network-vif-plugged-06ff3140-31c9-478c-9d4e-c2a4ee346df4 for instance with vm_state building and task_state spawning.
Aug 26 08:48:22 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:48:22 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:48:22 user nova-compute[73104]: INFO nova.compute.manager [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Took 5.95 seconds to spawn the instance on the hypervisor.
Aug 26 08:48:22 user nova-compute[73104]: DEBUG nova.compute.manager [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:48:22 user nova-compute[73104]: INFO nova.compute.manager [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Took 6.64 seconds to build instance.
Aug 26 08:48:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-23c35f76-9dfa-4b6f-899c-899cc100da2c tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "5ddeefec-ed4f-4fec-8d1c-02a2ddf65023" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.752s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:22 user nova-compute[73104]: INFO nova.compute.manager [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Unshelving
Aug 26 08:48:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:23 user nova-compute[73104]: DEBUG nova.objects.instance [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lazy-loading 'pci_requests' on Instance uuid c3b4c644-f7f3-4304-b732-9f43cfeac2bb {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:48:23 user nova-compute[73104]: DEBUG nova.objects.instance [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lazy-loading 'numa_topology' on Instance uuid c3b4c644-f7f3-4304-b732-9f43cfeac2bb {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:48:23 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:48:23 user nova-compute[73104]: INFO nova.compute.claims [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Claim successful on node user
Aug 26 08:48:23 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:48:23 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:48:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:23 user nova-compute[73104]: INFO nova.network.neutron [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Updating port cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 26 08:48:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:48:23 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Creating image(s)
Aug 26 08:48:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "/opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "/opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "/opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.220s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.196s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk 1073741824" returned: 0 in 0.054s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.223s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "refresh_cache-c3b4c644-f7f3-4304-b732-9f43cfeac2bb" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquired lock "refresh_cache-c3b4c644-f7f3-4304-b732-9f43cfeac2bb" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG nova.network.neutron [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG nova.compute.manager [req-ec7358b7-34cf-456f-9a7f-3d745b3c1fdb req-bebf1283-a915-4d04-a73c-4cb68103f2eb service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Received event network-changed-cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG nova.compute.manager [req-ec7358b7-34cf-456f-9a7f-3d745b3c1fdb req-bebf1283-a915-4d04-a73c-4cb68103f2eb service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Refreshing instance network info cache due to event network-changed-cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ec7358b7-34cf-456f-9a7f-3d745b3c1fdb req-bebf1283-a915-4d04-a73c-4cb68103f2eb service nova] Acquiring lock "refresh_cache-c3b4c644-f7f3-4304-b732-9f43cfeac2bb" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Cannot resize image /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Ensure instance console log exists: /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Start _get_guest_xml network_info=[{"id": "68e8044e-0d86-4309-938c-f00d2c392440", "address": "fa:16:3e:8e:1c:6e", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68e8044e-0d", "ovs_interfaceid": "68e8044e-0d86-4309-938c-f00d2c392440", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '1d00cdf1-8c38-4bae-b056-4b24f709e49e', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkWilbGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b7f6e347-c1f3-4f56-86c4-3b28c4729964', 'attached_at': '', 'detached_at': '', 'volume_id': 'e0162bff-65f9-448e-9744-0d52eb0fbfe9', 'serial': 'e0162bff-65f9-448e-9744-0d52eb0fbfe9'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:48:24 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 08:48:24 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 08:48:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG nova.objects.instance [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lazy-loading 'vcpu_model' on Instance uuid b7f6e347-c1f3-4f56-86c4-3b28c4729964 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkWilbGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:48:24 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 08:48:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:48:24 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 08:48:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:48:24 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a16d47-6b70-41bd-bfa3-a9b7c1e4d9a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:48:24 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9418bbd-829d-4dce-8d05-4732e46c14b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9] added
Aug 26 08:48:24 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[807090bd-bce6-4ccb-8ecb-42e5b217ef91]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[713ace63-4871-402c-b065-0d8c010f03da]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nkWilbGB {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nkWilbGB" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e5a59f-b7b7-4e9f-a827-98314467f9d9]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nkWilbGB'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7111625-72b4-40a5-97b8-3928bd38a12a]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccc59af-0bcf-4bdf-8922-72d8582ee648]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:48:24 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:48:24 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:48:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec551412-f274-4303-a20f-3c7c1fc5e9fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9, portal: 172.16.0.220,3260]
Aug 26 08:48:25 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9, portal: 172.16.0.220,3260] successful.
Aug 26 08:48:25 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:48:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6ff927-a9f0-46ed-8439-175c1b4b9ccc]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:48:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2722b6a6-83ea-4463-884e-a86d682b0155]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:48:25 user nova-compute[73104]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)
Aug 26 08:48:25 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:48:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:48:25 user nova-compute[73104]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)
Aug 26 08:48:25 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:48:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:48:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:48:25 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:48:25 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:48:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:25 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d76495-a306-47c1-87b1-699e1f265e30]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:25 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:48:25 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkWilbGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:48:25 user nova-compute[73104]: DEBUG nova.network.neutron [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Updating instance_info_cache with network_info: [{"id": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "address": "fa:16:3e:4c:c9:02", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc2c1a60-58", "ovs_interfaceid": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:48:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Releasing lock "refresh_cache-c3b4c644-f7f3-4304-b732-9f43cfeac2bb" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:48:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:48:25 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Creating image(s)
Aug 26 08:48:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "/opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "/opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:25 user nova-compute[73104]: DEBUG nova.objects.instance [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lazy-loading 'trusted_certs' on Instance uuid c3b4c644-f7f3-4304-b732-9f43cfeac2bb {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:48:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ec7358b7-34cf-456f-9a7f-3d745b3c1fdb req-bebf1283-a915-4d04-a73c-4cb68103f2eb service nova] Acquired lock "refresh_cache-c3b4c644-f7f3-4304-b732-9f43cfeac2bb" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:48:25 user nova-compute[73104]: DEBUG nova.network.neutron [req-ec7358b7-34cf-456f-9a7f-3d745b3c1fdb req-bebf1283-a915-4d04-a73c-4cb68103f2eb service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Refreshing network info cache for port cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:48:25 user nova-compute[73104]: DEBUG nova.objects.base [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Object Instance<c3b4c644-f7f3-4304-b732-9f43cfeac2bb> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:48:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "9f56b1bd37eb486652c6cd4f0de383960874322f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "9f56b1bd37eb486652c6cd4f0de383960874322f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f56b1bd37eb486652c6cd4f0de383960874322f.part --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.609s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:48:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] <== connect_volume: return (1613ms) {'type': 'block', 'scsi_wwn': '23234306164383265', 'path': '/dev/sdc'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:48:26 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234306164383265', 'path': '/dev/sdc'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:48:26 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T08:45:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-507169638',display_name='tempest-ServerActionsTestOtherA-server-1640836795',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-507169638',id=23,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYLqMl8GpNjfNVCgo2H+2r4h7f+wltYEXzpCmKmElhA0DBXXS8OJ+jJMfreN4vSnENs3yu+UIcdrUm0f/2htkz5kCGsZ2tw03AkxIejr18INsy4zP7Li4asqVv0WIUqpw==',key_name='tempest-keypair-2115817653',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:46:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='efb864c0a34541dca00c6dbbcea17319',ramdisk_id='',reservation_id='r-p9meui0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1245661612',owner_user_name='tempest-ServerActionsTestOtherA-1245661612-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:48:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='257343af54bd42b591e8874ef4ecf8dc',uuid=b7f6e347-c1f3-4f56-86c4-3b28c4729964,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68e8044e-0d86-4309-938c-f00d2c392440", "address": "fa:16:3e:8e:1c:6e", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68e8044e-0d", "ovs_interfaceid": "68e8044e-0d86-4309-938c-f00d2c392440", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:48:26 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Converting VIF {"id": "68e8044e-0d86-4309-938c-f00d2c392440", "address": "fa:16:3e:8e:1c:6e", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68e8044e-0d", "ovs_interfaceid": "68e8044e-0d86-4309-938c-f00d2c392440", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:48:26 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:1c:6e,bridge_name='br-int',has_traffic_filtering=True,id=68e8044e-0d86-4309-938c-f00d2c392440,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68e8044e-0d') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:48:26 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:48:26 user nova-compute[73104]:   <uuid>b7f6e347-c1f3-4f56-86c4-3b28c4729964</uuid>
Aug 26 08:48:26 user nova-compute[73104]:   <name>instance-00000017</name>
Aug 26 08:48:26 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:48:26 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:48:26 user nova-compute[73104]:   <metadata>
Aug 26 08:48:26 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:48:26 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:48:26 user nova-compute[73104]:       <nova:name>tempest-ServerActionsTestOtherA-server-1640836795</nova:name>
Aug 26 08:48:26 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:48:24</nova:creationTime>
Aug 26 08:48:26 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:48:26 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:48:26 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:48:26 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:48:26 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:48:26 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:48:26 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:48:26 user nova-compute[73104]:       <nova:owner>
Aug 26 08:48:26 user nova-compute[73104]:         <nova:user uuid="257343af54bd42b591e8874ef4ecf8dc">tempest-ServerActionsTestOtherA-1245661612-project-member</nova:user>
Aug 26 08:48:26 user nova-compute[73104]:         <nova:project uuid="efb864c0a34541dca00c6dbbcea17319">tempest-ServerActionsTestOtherA-1245661612</nova:project>
Aug 26 08:48:26 user nova-compute[73104]:       </nova:owner>
Aug 26 08:48:26 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:48:26 user nova-compute[73104]:       <nova:ports>
Aug 26 08:48:26 user nova-compute[73104]:         <nova:port uuid="68e8044e-0d86-4309-938c-f00d2c392440">
Aug 26 08:48:26 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 08:48:26 user nova-compute[73104]:         </nova:port>
Aug 26 08:48:26 user nova-compute[73104]:       </nova:ports>
Aug 26 08:48:26 user nova-compute[73104]:     </nova:instance>
Aug 26 08:48:26 user nova-compute[73104]:   </metadata>
Aug 26 08:48:26 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:48:26 user nova-compute[73104]:     <system>
Aug 26 08:48:26 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:48:26 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:48:26 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:48:26 user nova-compute[73104]:       <entry name="serial">b7f6e347-c1f3-4f56-86c4-3b28c4729964</entry>
Aug 26 08:48:26 user nova-compute[73104]:       <entry name="uuid">b7f6e347-c1f3-4f56-86c4-3b28c4729964</entry>
Aug 26 08:48:26 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:48:26 user nova-compute[73104]:     </system>
Aug 26 08:48:26 user nova-compute[73104]:   </sysinfo>
Aug 26 08:48:26 user nova-compute[73104]:   <os>
Aug 26 08:48:26 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:48:26 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:48:26 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:48:26 user nova-compute[73104]:   </os>
Aug 26 08:48:26 user nova-compute[73104]:   <features>
Aug 26 08:48:26 user nova-compute[73104]:     <acpi/>
Aug 26 08:48:26 user nova-compute[73104]:     <apic/>
Aug 26 08:48:26 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:48:26 user nova-compute[73104]:   </features>
Aug 26 08:48:26 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:48:26 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:48:26 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:48:26 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:48:26 user nova-compute[73104]:   </clock>
Aug 26 08:48:26 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:48:26 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:48:26 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:48:26 user nova-compute[73104]:   </cpu>
Aug 26 08:48:26 user nova-compute[73104]:   <devices>
Aug 26 08:48:26 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:48:26 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:48:26 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk"/>
Aug 26 08:48:26 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:48:26 user nova-compute[73104]:     </disk>
Aug 26 08:48:26 user nova-compute[73104]:     <disk type="block" device="disk">
Aug 26 08:48:26 user nova-compute[73104]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:48:26 user nova-compute[73104]:       <source dev="/dev/sdc"/>
Aug 26 08:48:26 user nova-compute[73104]:       <target dev="vdb" bus="virtio"/>
Aug 26 08:48:26 user nova-compute[73104]:       <serial>e0162bff-65f9-448e-9744-0d52eb0fbfe9</serial>
Aug 26 08:48:26 user nova-compute[73104]:     </disk>
Aug 26 08:48:26 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:48:26 user nova-compute[73104]:       <mac address="fa:16:3e:8e:1c:6e"/>
Aug 26 08:48:26 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:48:26 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:48:26 user nova-compute[73104]:       <target dev="tap68e8044e-0d"/>
Aug 26 08:48:26 user nova-compute[73104]:     </interface>
Aug 26 08:48:26 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:48:26 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/console.log" append="off"/>
Aug 26 08:48:26 user nova-compute[73104]:     </serial>
Aug 26 08:48:26 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:48:26 user nova-compute[73104]:     <video>
Aug 26 08:48:26 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:48:26 user nova-compute[73104]:     </video>
Aug 26 08:48:26 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:48:26 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:48:26 user nova-compute[73104]:     </rng>
Aug 26 08:48:26 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:48:26 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:48:26 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:48:26 user nova-compute[73104]:     </memballoon>
Aug 26 08:48:26 user nova-compute[73104]:   </devices>
Aug 26 08:48:26 user nova-compute[73104]: </domain>
Aug 26 08:48:26 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:48:26 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T08:45:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-507169638',display_name='tempest-ServerActionsTestOtherA-server-1640836795',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-507169638',id=23,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYLqMl8GpNjfNVCgo2H+2r4h7f+wltYEXzpCmKmElhA0DBXXS8OJ+jJMfreN4vSnENs3yu+UIcdrUm0f/2htkz5kCGsZ2tw03AkxIejr18INsy4zP7Li4asqVv0WIUqpw==',key_name='tempest-keypair-2115817653',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:46:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='efb864c0a34541dca00c6dbbcea17319',ramdisk_id='',reservation_id='r-p9meui0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1245661612',owner_user_name='tempest-ServerActionsTestOtherA-1245661612-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:48:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='257343af54bd42b591e8874ef4ecf8dc',uuid=b7f6e347-c1f3-4f56-86c4-3b28c4729964,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68e8044e-0d86-4309-938c-f00d2c392440", "address": "fa:16:3e:8e:1c:6e", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68e8044e-0d", "ovs_interfaceid": "68e8044e-0d86-4309-938c-f00d2c392440", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:48:26 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Converting VIF {"id": "68e8044e-0d86-4309-938c-f00d2c392440", "address": "fa:16:3e:8e:1c:6e", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68e8044e-0d", "ovs_interfaceid": "68e8044e-0d86-4309-938c-f00d2c392440", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:48:26 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:1c:6e,bridge_name='br-int',has_traffic_filtering=True,id=68e8044e-0d86-4309-938c-f00d2c392440,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68e8044e-0d') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:48:26 user nova-compute[73104]: DEBUG os_vif [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:1c:6e,bridge_name='br-int',has_traffic_filtering=True,id=68e8044e-0d86-4309-938c-f00d2c392440,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68e8044e-0d') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:48:26 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:26 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:48:26 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:48:26 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:26 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68e8044e-0d, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:48:26 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap68e8044e-0d, col_values=(('external_ids', {'iface-id': '68e8044e-0d86-4309-938c-f00d2c392440', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:1c:6e', 'vm-uuid': 'b7f6e347-c1f3-4f56-86c4-3b28c4729964'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:48:26 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:26 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:48:26 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:26 user nova-compute[73104]: INFO os_vif [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:1c:6e,bridge_name='br-int',has_traffic_filtering=True,id=68e8044e-0d86-4309-938c-f00d2c392440,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68e8044e-0d')
Aug 26 08:48:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f56b1bd37eb486652c6cd4f0de383960874322f.part --force-share --output=json" returned: 0 in 0.192s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:26 user nova-compute[73104]: DEBUG nova.virt.images [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] 29a2a78e-9d12-4f4c-bc12-ac86999ad7e0 was qcow2, converting to raw {{(pid=73104) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 08:48:26 user nova-compute[73104]: DEBUG nova.privsep.utils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73104) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 08:48:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9f56b1bd37eb486652c6cd4f0de383960874322f.part /opt/stack/data/nova/instances/_base/9f56b1bd37eb486652c6cd4f0de383960874322f.converted {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:26 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:48:26 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:48:26 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] No VIF found with MAC fa:16:3e:8e:1c:6e, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:48:26 user nova-compute[73104]: DEBUG nova.network.neutron [req-ec7358b7-34cf-456f-9a7f-3d745b3c1fdb req-bebf1283-a915-4d04-a73c-4cb68103f2eb service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Updated VIF entry in instance network info cache for port cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:48:26 user nova-compute[73104]: DEBUG nova.network.neutron [req-ec7358b7-34cf-456f-9a7f-3d745b3c1fdb req-bebf1283-a915-4d04-a73c-4cb68103f2eb service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Updating instance_info_cache with network_info: [{"id": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "address": "fa:16:3e:4c:c9:02", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc2c1a60-58", "ovs_interfaceid": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:48:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ec7358b7-34cf-456f-9a7f-3d745b3c1fdb req-bebf1283-a915-4d04-a73c-4cb68103f2eb service nova] Releasing lock "refresh_cache-c3b4c644-f7f3-4304-b732-9f43cfeac2bb" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:48:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9f56b1bd37eb486652c6cd4f0de383960874322f.part /opt/stack/data/nova/instances/_base/9f56b1bd37eb486652c6cd4f0de383960874322f.converted" returned: 0 in 0.329s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f56b1bd37eb486652c6cd4f0de383960874322f.converted --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f56b1bd37eb486652c6cd4f0de383960874322f.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "9f56b1bd37eb486652c6cd4f0de383960874322f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.840s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f56b1bd37eb486652c6cd4f0de383960874322f --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f56b1bd37eb486652c6cd4f0de383960874322f --force-share --output=json" returned: 0 in 0.210s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "9f56b1bd37eb486652c6cd4f0de383960874322f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "9f56b1bd37eb486652c6cd4f0de383960874322f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f56b1bd37eb486652c6cd4f0de383960874322f --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f56b1bd37eb486652c6cd4f0de383960874322f --force-share --output=json" returned: 0 in 0.208s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f56b1bd37eb486652c6cd4f0de383960874322f,backing_fmt=raw /opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f56b1bd37eb486652c6cd4f0de383960874322f,backing_fmt=raw /opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk 1073741824" returned: 0 in 0.056s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "9f56b1bd37eb486652c6cd4f0de383960874322f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f56b1bd37eb486652c6cd4f0de383960874322f --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f56b1bd37eb486652c6cd4f0de383960874322f --force-share --output=json" returned: 0 in 0.228s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:27 user nova-compute[73104]: DEBUG nova.objects.instance [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lazy-loading 'migration_context' on Instance uuid c3b4c644-f7f3-4304-b732-9f43cfeac2bb {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:48:27 user nova-compute[73104]: DEBUG nova.objects.base [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Object Instance<c3b4c644-f7f3-4304-b732-9f43cfeac2bb> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:48:27 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Rebasing disk image.
Aug 26 08:48:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.226s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 -F raw /opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:28 user nova-compute[73104]: DEBUG nova.compute.manager [req-b2ceb2e8-923e-4887-b9dc-e7716ee5e5bb req-3a277f64-20c2-41f6-8145-61b870237fe6 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Received event network-vif-plugged-68e8044e-0d86-4309-938c-f00d2c392440 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:48:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b2ceb2e8-923e-4887-b9dc-e7716ee5e5bb req-3a277f64-20c2-41f6-8145-61b870237fe6 service nova] Acquiring lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b2ceb2e8-923e-4887-b9dc-e7716ee5e5bb req-3a277f64-20c2-41f6-8145-61b870237fe6 service nova] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b2ceb2e8-923e-4887-b9dc-e7716ee5e5bb req-3a277f64-20c2-41f6-8145-61b870237fe6 service nova] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:28 user nova-compute[73104]: DEBUG nova.compute.manager [req-b2ceb2e8-923e-4887-b9dc-e7716ee5e5bb req-3a277f64-20c2-41f6-8145-61b870237fe6 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] No waiting events found dispatching network-vif-plugged-68e8044e-0d86-4309-938c-f00d2c392440 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:48:28 user nova-compute[73104]: WARNING nova.compute.manager [req-b2ceb2e8-923e-4887-b9dc-e7716ee5e5bb req-3a277f64-20c2-41f6-8145-61b870237fe6 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Received unexpected event network-vif-plugged-68e8044e-0d86-4309-938c-f00d2c392440 for instance with vm_state active and task_state rebuild_spawning.
Aug 26 08:48:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:30 user nova-compute[73104]: DEBUG nova.compute.manager [req-78195623-4e1c-4db1-afdc-57c453b609a5 req-b5753053-8970-4677-91c6-8fdc1f9ab628 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Received event network-vif-plugged-68e8044e-0d86-4309-938c-f00d2c392440 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:48:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-78195623-4e1c-4db1-afdc-57c453b609a5 req-b5753053-8970-4677-91c6-8fdc1f9ab628 service nova] Acquiring lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-78195623-4e1c-4db1-afdc-57c453b609a5 req-b5753053-8970-4677-91c6-8fdc1f9ab628 service nova] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-78195623-4e1c-4db1-afdc-57c453b609a5 req-b5753053-8970-4677-91c6-8fdc1f9ab628 service nova] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:30 user nova-compute[73104]: DEBUG nova.compute.manager [req-78195623-4e1c-4db1-afdc-57c453b609a5 req-b5753053-8970-4677-91c6-8fdc1f9ab628 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] No waiting events found dispatching network-vif-plugged-68e8044e-0d86-4309-938c-f00d2c392440 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:48:30 user nova-compute[73104]: WARNING nova.compute.manager [req-78195623-4e1c-4db1-afdc-57c453b609a5 req-b5753053-8970-4677-91c6-8fdc1f9ab628 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Received unexpected event network-vif-plugged-68e8044e-0d86-4309-938c-f00d2c392440 for instance with vm_state active and task_state rebuild_spawning.
Aug 26 08:48:31 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 -F raw /opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk" returned: 0 in 3.006s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Ensure instance console log exists: /opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Start _get_guest_xml network_info=[{"id": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "address": "fa:16:3e:4c:c9:02", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc2c1a60-58", "ovs_interfaceid": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='83978711cdeb37355af3cd2de69a1063',container_format='bare',created_at=2023-08-26T08:46:29Z,direct_url=<?>,disk_format='qcow2',id=29a2a78e-9d12-4f4c-bc12-ac86999ad7e0,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-516733243-shelved',owner='770daa2e8b274a9b828e489c1573ced4',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T08:46:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:48:31 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:48:31 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='83978711cdeb37355af3cd2de69a1063',container_format='bare',created_at=2023-08-26T08:46:29Z,direct_url=<?>,disk_format='qcow2',id=29a2a78e-9d12-4f4c-bc12-ac86999ad7e0,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-516733243-shelved',owner='770daa2e8b274a9b828e489c1573ced4',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T08:46:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.objects.instance [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lazy-loading 'vcpu_model' on Instance uuid c3b4c644-f7f3-4304-b732-9f43cfeac2bb {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039711.1060026, b7f6e347-c1f3-4f56-86c4-3b28c4729964 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:48:31 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] VM Resumed (Lifecycle Event)
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.compute.manager [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.objects.base [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Object Instance<c3b4c644-f7f3-4304-b732-9f43cfeac2bb> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T08:44:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-516733243',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-516733243',id=21,image_ref='29a2a78e-9d12-4f4c-bc12-ac86999ad7e0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1461483520',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:44:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='770daa2e8b274a9b828e489c1573ced4',ramdisk_id='',reservation_id='r-7sybpznn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2062858766',owner_user_name='tempest-AttachVolumeShelveTestJSON-2062858766-project-member',shelved_at='2023-08-26T08:46:34.456103',shelved_host='user',shelved_image_id='29a2a78e-9d12-4f4c-bc12-ac86999ad7e0'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:48:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db3ae37701df47a5b35026fe3857bc51',uuid=c3b4c644-f7f3-4304-b732-9f43cfeac2bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "address": "fa:16:3e:4c:c9:02", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc2c1a60-58", "ovs_interfaceid": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Converting VIF {"id": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "address": "fa:16:3e:4c:c9:02", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc2c1a60-58", "ovs_interfaceid": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c9:02,bridge_name='br-int',has_traffic_filtering=True,id=cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03,network=Network(38f7ec35-12eb-46fe-a425-51ee854d804d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc2c1a60-58') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.objects.instance [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lazy-loading 'pci_devices' on Instance uuid c3b4c644-f7f3-4304-b732-9f43cfeac2bb {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:48:31 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Instance spawned successfully.
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.objects.base [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Object Instance<c3b4c644-f7f3-4304-b732-9f43cfeac2bb> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:48:31 user nova-compute[73104]:   <uuid>c3b4c644-f7f3-4304-b732-9f43cfeac2bb</uuid>
Aug 26 08:48:31 user nova-compute[73104]:   <name>instance-00000015</name>
Aug 26 08:48:31 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:48:31 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:48:31 user nova-compute[73104]:   <metadata>
Aug 26 08:48:31 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:48:31 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:48:31 user nova-compute[73104]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-516733243</nova:name>
Aug 26 08:48:31 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:48:31</nova:creationTime>
Aug 26 08:48:31 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:48:31 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:48:31 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:48:31 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:48:31 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:48:31 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:48:31 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:48:31 user nova-compute[73104]:       <nova:owner>
Aug 26 08:48:31 user nova-compute[73104]:         <nova:user uuid="db3ae37701df47a5b35026fe3857bc51">tempest-AttachVolumeShelveTestJSON-2062858766-project-member</nova:user>
Aug 26 08:48:31 user nova-compute[73104]:         <nova:project uuid="770daa2e8b274a9b828e489c1573ced4">tempest-AttachVolumeShelveTestJSON-2062858766</nova:project>
Aug 26 08:48:31 user nova-compute[73104]:       </nova:owner>
Aug 26 08:48:31 user nova-compute[73104]:       <nova:root type="image" uuid="29a2a78e-9d12-4f4c-bc12-ac86999ad7e0"/>
Aug 26 08:48:31 user nova-compute[73104]:       <nova:ports>
Aug 26 08:48:31 user nova-compute[73104]:         <nova:port uuid="cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03">
Aug 26 08:48:31 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 08:48:31 user nova-compute[73104]:         </nova:port>
Aug 26 08:48:31 user nova-compute[73104]:       </nova:ports>
Aug 26 08:48:31 user nova-compute[73104]:     </nova:instance>
Aug 26 08:48:31 user nova-compute[73104]:   </metadata>
Aug 26 08:48:31 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:48:31 user nova-compute[73104]:     <system>
Aug 26 08:48:31 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:48:31 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:48:31 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:48:31 user nova-compute[73104]:       <entry name="serial">c3b4c644-f7f3-4304-b732-9f43cfeac2bb</entry>
Aug 26 08:48:31 user nova-compute[73104]:       <entry name="uuid">c3b4c644-f7f3-4304-b732-9f43cfeac2bb</entry>
Aug 26 08:48:31 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:48:31 user nova-compute[73104]:     </system>
Aug 26 08:48:31 user nova-compute[73104]:   </sysinfo>
Aug 26 08:48:31 user nova-compute[73104]:   <os>
Aug 26 08:48:31 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:48:31 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:48:31 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:48:31 user nova-compute[73104]:   </os>
Aug 26 08:48:31 user nova-compute[73104]:   <features>
Aug 26 08:48:31 user nova-compute[73104]:     <acpi/>
Aug 26 08:48:31 user nova-compute[73104]:     <apic/>
Aug 26 08:48:31 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:48:31 user nova-compute[73104]:   </features>
Aug 26 08:48:31 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:48:31 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:48:31 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:48:31 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:48:31 user nova-compute[73104]:   </clock>
Aug 26 08:48:31 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:48:31 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:48:31 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:48:31 user nova-compute[73104]:   </cpu>
Aug 26 08:48:31 user nova-compute[73104]:   <devices>
Aug 26 08:48:31 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:48:31 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:48:31 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk"/>
Aug 26 08:48:31 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:48:31 user nova-compute[73104]:     </disk>
Aug 26 08:48:31 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:48:31 user nova-compute[73104]:       <mac address="fa:16:3e:4c:c9:02"/>
Aug 26 08:48:31 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:48:31 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:48:31 user nova-compute[73104]:       <target dev="tapcc2c1a60-58"/>
Aug 26 08:48:31 user nova-compute[73104]:     </interface>
Aug 26 08:48:31 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:48:31 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/console.log" append="off"/>
Aug 26 08:48:31 user nova-compute[73104]:     </serial>
Aug 26 08:48:31 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:48:31 user nova-compute[73104]:     <video>
Aug 26 08:48:31 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:48:31 user nova-compute[73104]:     </video>
Aug 26 08:48:31 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:48:31 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:48:31 user nova-compute[73104]:     </rng>
Aug 26 08:48:31 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:48:31 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:48:31 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:48:31 user nova-compute[73104]:     </memballoon>
Aug 26 08:48:31 user nova-compute[73104]:   </devices>
Aug 26 08:48:31 user nova-compute[73104]: </domain>
Aug 26 08:48:31 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T08:44:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-516733243',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-516733243',id=21,image_ref='29a2a78e-9d12-4f4c-bc12-ac86999ad7e0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1461483520',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:44:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='770daa2e8b274a9b828e489c1573ced4',ramdisk_id='',reservation_id='r-7sybpznn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2062858766',owner_user_name='tempest-AttachVolumeShelveTestJSON-2062858766-project-member',shelved_at='2023-08-26T08:46:34.456103',shelved_host='user',shelved_image_id='29a2a78e-9d12-4f4c-bc12-ac86999ad7e0'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:48:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db3ae37701df47a5b35026fe3857bc51',uuid=c3b4c644-f7f3-4304-b732-9f43cfeac2bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "address": "fa:16:3e:4c:c9:02", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc2c1a60-58", "ovs_interfaceid": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Converting VIF {"id": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "address": "fa:16:3e:4c:c9:02", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc2c1a60-58", "ovs_interfaceid": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c9:02,bridge_name='br-int',has_traffic_filtering=True,id=cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03,network=Network(38f7ec35-12eb-46fe-a425-51ee854d804d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc2c1a60-58') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG os_vif [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c9:02,bridge_name='br-int',has_traffic_filtering=True,id=cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03,network=Network(38f7ec35-12eb-46fe-a425-51ee854d804d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc2c1a60-58') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:48:31 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039711.1062272, b7f6e347-c1f3-4f56-86c4-3b28c4729964 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:48:31 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] VM Started (Lifecycle Event)
Aug 26 08:48:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc2c1a60-58, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcc2c1a60-58, col_values=(('external_ids', {'iface-id': 'cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:c9:02', 'vm-uuid': 'c3b4c644-f7f3-4304-b732-9f43cfeac2bb'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:31 user nova-compute[73104]: INFO os_vif [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c9:02,bridge_name='br-int',has_traffic_filtering=True,id=cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03,network=Network(38f7ec35-12eb-46fe-a425-51ee854d804d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc2c1a60-58')
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:48:31 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] No VIF found with MAC fa:16:3e:4c:c9:02, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.compute.manager [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG nova.objects.instance [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73104) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Aug 26 08:48:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-34d7c0c3-6a56-4f5c-b9bf-bf412eb50ef4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.150s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:33 user nova-compute[73104]: DEBUG nova.compute.manager [req-396ec41e-9eab-4056-9297-b0d5b692c9cb req-f2e7382a-019c-4955-97c3-2618cd408a02 service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Received event network-vif-plugged-cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:48:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-396ec41e-9eab-4056-9297-b0d5b692c9cb req-f2e7382a-019c-4955-97c3-2618cd408a02 service nova] Acquiring lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-396ec41e-9eab-4056-9297-b0d5b692c9cb req-f2e7382a-019c-4955-97c3-2618cd408a02 service nova] Lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-396ec41e-9eab-4056-9297-b0d5b692c9cb req-f2e7382a-019c-4955-97c3-2618cd408a02 service nova] Lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:33 user nova-compute[73104]: DEBUG nova.compute.manager [req-396ec41e-9eab-4056-9297-b0d5b692c9cb req-f2e7382a-019c-4955-97c3-2618cd408a02 service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] No waiting events found dispatching network-vif-plugged-cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:48:33 user nova-compute[73104]: WARNING nova.compute.manager [req-396ec41e-9eab-4056-9297-b0d5b692c9cb req-f2e7382a-019c-4955-97c3-2618cd408a02 service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Received unexpected event network-vif-plugged-cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 08:48:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:35 user nova-compute[73104]: DEBUG nova.compute.manager [req-2d0a57b7-1fca-46e9-872f-45ad94723d4f req-e7fdd711-e918-45a1-9f17-31a7c65c33ea service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Received event network-vif-plugged-cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:48:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2d0a57b7-1fca-46e9-872f-45ad94723d4f req-e7fdd711-e918-45a1-9f17-31a7c65c33ea service nova] Acquiring lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2d0a57b7-1fca-46e9-872f-45ad94723d4f req-e7fdd711-e918-45a1-9f17-31a7c65c33ea service nova] Lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2d0a57b7-1fca-46e9-872f-45ad94723d4f req-e7fdd711-e918-45a1-9f17-31a7c65c33ea service nova] Lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:35 user nova-compute[73104]: DEBUG nova.compute.manager [req-2d0a57b7-1fca-46e9-872f-45ad94723d4f req-e7fdd711-e918-45a1-9f17-31a7c65c33ea service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] No waiting events found dispatching network-vif-plugged-cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:48:35 user nova-compute[73104]: WARNING nova.compute.manager [req-2d0a57b7-1fca-46e9-872f-45ad94723d4f req-e7fdd711-e918-45a1-9f17-31a7c65c33ea service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Received unexpected event network-vif-plugged-cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 08:48:35 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039715.822817, c3b4c644-f7f3-4304-b732-9f43cfeac2bb => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:48:35 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] VM Resumed (Lifecycle Event)
Aug 26 08:48:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:48:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:48:35 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Instance spawned successfully.
Aug 26 08:48:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:48:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:48:35 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:48:35 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039715.8241193, c3b4c644-f7f3-4304-b732-9f43cfeac2bb => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:48:35 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] VM Started (Lifecycle Event)
Aug 26 08:48:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:48:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:48:35 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:48:36 user nova-compute[73104]: DEBUG nova.compute.manager [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:48:36 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5d658ac0-e88f-431f-bf3f-148a65a221cf tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.372s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:41 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Acquiring lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:48 user nova-compute[73104]: DEBUG nova.objects.instance [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lazy-loading 'flavor' on Instance uuid 02665c70-cf75-44ba-9d90-eb9e5f12e0b7 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:48:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Acquiring lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:48 user nova-compute[73104]: INFO nova.compute.manager [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Attaching volume e30bc0fc-d957-4e49-83a6-c3db0a223e1b to /dev/vdb
Aug 26 08:48:48 user nova-compute[73104]: DEBUG os_brick.utils [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:48:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:48 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53d781f-fb28-4901-80ce-a8748c627abb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:48 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fc4bb2-7291-4f0a-abc0-995e5d708172]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.053s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:48 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f264e4-03a1-4ea6-8fbf-b3409013bad7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:48 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e4d4a4-ad1f-419c-a75d-c2301fffa998]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:48:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:48:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:48:48 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:48:48 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0694c50-3969-4456-9ecd-21788eb0f0c4]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:48:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:48:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:48:48 user nova-compute[73104]: DEBUG os_brick.utils [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] <== get_connector_properties: return (182ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:48:48 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Updating existing volume attachment record: 34aff9cd-4427-4444-991e-d22dd8c9bdc2 {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 08:48:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:50 user nova-compute[73104]: INFO nova.compute.manager [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Rescuing
Aug 26 08:48:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "refresh_cache-bef1e493-6b2c-4688-98c2-647261feb571" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:48:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquired lock "refresh_cache-bef1e493-6b2c-4688-98c2-647261feb571" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:48:50 user nova-compute[73104]: DEBUG nova.network.neutron [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:48:50 user nova-compute[73104]: DEBUG nova.compute.manager [req-f5f627ac-edb5-43bf-b264-3a1a6375594b req-d103cdc1-0427-4401-afc6-27df94fea56a service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Received event network-changed-b646e439-ff88-4f5b-9fa6-f9a1eac84f08 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:48:50 user nova-compute[73104]: DEBUG nova.compute.manager [req-f5f627ac-edb5-43bf-b264-3a1a6375594b req-d103cdc1-0427-4401-afc6-27df94fea56a service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Refreshing instance network info cache due to event network-changed-b646e439-ff88-4f5b-9fa6-f9a1eac84f08. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:48:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f5f627ac-edb5-43bf-b264-3a1a6375594b req-d103cdc1-0427-4401-afc6-27df94fea56a service nova] Acquiring lock "refresh_cache-55966005-e534-45d3-9bd4-cea5d54b661e" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:48:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f5f627ac-edb5-43bf-b264-3a1a6375594b req-d103cdc1-0427-4401-afc6-27df94fea56a service nova] Acquired lock "refresh_cache-55966005-e534-45d3-9bd4-cea5d54b661e" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:48:50 user nova-compute[73104]: DEBUG nova.network.neutron [req-f5f627ac-edb5-43bf-b264-3a1a6375594b req-d103cdc1-0427-4401-afc6-27df94fea56a service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Refreshing network info cache for port b646e439-ff88-4f5b-9fa6-f9a1eac84f08 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:48:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ab77dfaf-2d16-4753-9bca-9223c9e7a8e3 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Acquiring lock "interface-55966005-e534-45d3-9bd4-cea5d54b661e-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ab77dfaf-2d16-4753-9bca-9223c9e7a8e3 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lock "interface-55966005-e534-45d3-9bd4-cea5d54b661e-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:51 user nova-compute[73104]: DEBUG nova.objects.instance [None req-ab77dfaf-2d16-4753-9bca-9223c9e7a8e3 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lazy-loading 'flavor' on Instance uuid 55966005-e534-45d3-9bd4-cea5d54b661e {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:48:51 user nova-compute[73104]: DEBUG nova.network.neutron [req-f5f627ac-edb5-43bf-b264-3a1a6375594b req-d103cdc1-0427-4401-afc6-27df94fea56a service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Updated VIF entry in instance network info cache for port b646e439-ff88-4f5b-9fa6-f9a1eac84f08. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:48:51 user nova-compute[73104]: DEBUG nova.network.neutron [req-f5f627ac-edb5-43bf-b264-3a1a6375594b req-d103cdc1-0427-4401-afc6-27df94fea56a service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Updating instance_info_cache with network_info: [{"id": "b646e439-ff88-4f5b-9fa6-f9a1eac84f08", "address": "fa:16:3e:b8:26:eb", "network": {"id": "edbebe23-8fc4-4a39-b4e8-d32d00d25c7f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2016586720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8190893dbd48a083cc8dba20db0e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb646e439-ff", "ovs_interfaceid": "b646e439-ff88-4f5b-9fa6-f9a1eac84f08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:48:51 user nova-compute[73104]: DEBUG nova.network.neutron [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Updating instance_info_cache with network_info: [{"id": "6ddebd25-cfe6-4b0e-8b2d-746fae9f8685", "address": "fa:16:3e:03:fd:b2", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddebd25-cf", "ovs_interfaceid": "6ddebd25-cfe6-4b0e-8b2d-746fae9f8685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:48:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f5f627ac-edb5-43bf-b264-3a1a6375594b req-d103cdc1-0427-4401-afc6-27df94fea56a service nova] Releasing lock "refresh_cache-55966005-e534-45d3-9bd4-cea5d54b661e" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:48:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Releasing lock "refresh_cache-bef1e493-6b2c-4688-98c2-647261feb571" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:48:51 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:51 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:51 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:51 user nova-compute[73104]: DEBUG nova.objects.instance [None req-ab77dfaf-2d16-4753-9bca-9223c9e7a8e3 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lazy-loading 'pci_requests' on Instance uuid 55966005-e534-45d3-9bd4-cea5d54b661e {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:48:51 user nova-compute[73104]: DEBUG nova.objects.base [None req-ab77dfaf-2d16-4753-9bca-9223c9e7a8e3 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Object Instance<55966005-e534-45d3-9bd4-cea5d54b661e> lazy-loaded attributes: flavor,pci_requests {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:48:51 user nova-compute[73104]: DEBUG nova.network.neutron [None req-ab77dfaf-2d16-4753-9bca-9223c9e7a8e3 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:48:51 user nova-compute[73104]: DEBUG nova.policy [None req-ab77dfaf-2d16-4753-9bca-9223c9e7a8e3 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1fd1bc8d58240e89ed980aa9760cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8190893dbd48a083cc8dba20db0e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:48:51 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:51 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:52 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Instance destroyed successfully.
Aug 26 08:48:52 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Attempting a stable device rescue
Aug 26 08:48:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73104) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 08:48:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Instance directory exists: not creating {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 08:48:52 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Creating image(s)
Aug 26 08:48:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "/opt/stack/data/nova/instances/bef1e493-6b2c-4688-98c2-647261feb571/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "/opt/stack/data/nova/instances/bef1e493-6b2c-4688-98c2-647261feb571/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "/opt/stack/data/nova/instances/bef1e493-6b2c-4688-98c2-647261feb571/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:52 user nova-compute[73104]: DEBUG nova.objects.instance [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lazy-loading 'trusted_certs' on Instance uuid bef1e493-6b2c-4688-98c2-647261feb571 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:48:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "24498f0cb1430b6c450a18c2c9154b7ac4b9878f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "24498f0cb1430b6c450a18c2c9154b7ac4b9878f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24498f0cb1430b6c450a18c2c9154b7ac4b9878f.part --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:53 user nova-compute[73104]: DEBUG nova.network.neutron [None req-ab77dfaf-2d16-4753-9bca-9223c9e7a8e3 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Successfully created port: 84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:48:53 user nova-compute[73104]: DEBUG nova.compute.manager [req-06ace8b8-ce28-4b55-aebf-a99c1b611c73 req-e81d2b60-b412-473e-b855-9b2c432a268e service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Received event network-vif-unplugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:48:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-06ace8b8-ce28-4b55-aebf-a99c1b611c73 req-e81d2b60-b412-473e-b855-9b2c432a268e service nova] Acquiring lock "bef1e493-6b2c-4688-98c2-647261feb571-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-06ace8b8-ce28-4b55-aebf-a99c1b611c73 req-e81d2b60-b412-473e-b855-9b2c432a268e service nova] Lock "bef1e493-6b2c-4688-98c2-647261feb571-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-06ace8b8-ce28-4b55-aebf-a99c1b611c73 req-e81d2b60-b412-473e-b855-9b2c432a268e service nova] Lock "bef1e493-6b2c-4688-98c2-647261feb571-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:53 user nova-compute[73104]: DEBUG nova.compute.manager [req-06ace8b8-ce28-4b55-aebf-a99c1b611c73 req-e81d2b60-b412-473e-b855-9b2c432a268e service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] No waiting events found dispatching network-vif-unplugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:48:53 user nova-compute[73104]: WARNING nova.compute.manager [req-06ace8b8-ce28-4b55-aebf-a99c1b611c73 req-e81d2b60-b412-473e-b855-9b2c432a268e service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Received unexpected event network-vif-unplugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 for instance with vm_state active and task_state rescuing.
Aug 26 08:48:53 user nova-compute[73104]: DEBUG nova.compute.manager [req-06ace8b8-ce28-4b55-aebf-a99c1b611c73 req-e81d2b60-b412-473e-b855-9b2c432a268e service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Received event network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:48:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-06ace8b8-ce28-4b55-aebf-a99c1b611c73 req-e81d2b60-b412-473e-b855-9b2c432a268e service nova] Acquiring lock "bef1e493-6b2c-4688-98c2-647261feb571-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-06ace8b8-ce28-4b55-aebf-a99c1b611c73 req-e81d2b60-b412-473e-b855-9b2c432a268e service nova] Lock "bef1e493-6b2c-4688-98c2-647261feb571-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-06ace8b8-ce28-4b55-aebf-a99c1b611c73 req-e81d2b60-b412-473e-b855-9b2c432a268e service nova] Lock "bef1e493-6b2c-4688-98c2-647261feb571-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:53 user nova-compute[73104]: DEBUG nova.compute.manager [req-06ace8b8-ce28-4b55-aebf-a99c1b611c73 req-e81d2b60-b412-473e-b855-9b2c432a268e service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] No waiting events found dispatching network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:48:53 user nova-compute[73104]: WARNING nova.compute.manager [req-06ace8b8-ce28-4b55-aebf-a99c1b611c73 req-e81d2b60-b412-473e-b855-9b2c432a268e service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Received unexpected event network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 for instance with vm_state active and task_state rescuing.
Aug 26 08:48:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24498f0cb1430b6c450a18c2c9154b7ac4b9878f.part --force-share --output=json" returned: 0 in 0.234s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:53 user nova-compute[73104]: DEBUG nova.virt.images [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] 012dc83a-a2a0-48e2-b249-a77de8c3cdaa was qcow2, converting to raw {{(pid=73104) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 08:48:53 user nova-compute[73104]: DEBUG nova.privsep.utils [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73104) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 08:48:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/24498f0cb1430b6c450a18c2c9154b7ac4b9878f.part /opt/stack/data/nova/instances/_base/24498f0cb1430b6c450a18c2c9154b7ac4b9878f.converted {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/24498f0cb1430b6c450a18c2c9154b7ac4b9878f.part /opt/stack/data/nova/instances/_base/24498f0cb1430b6c450a18c2c9154b7ac4b9878f.converted" returned: 0 in 0.463s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24498f0cb1430b6c450a18c2c9154b7ac4b9878f.converted --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24498f0cb1430b6c450a18c2c9154b7ac4b9878f.converted --force-share --output=json" returned: 0 in 0.220s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "24498f0cb1430b6c450a18c2c9154b7ac4b9878f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.997s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "24498f0cb1430b6c450a18c2c9154b7ac4b9878f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "24498f0cb1430b6c450a18c2c9154b7ac4b9878f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24498f0cb1430b6c450a18c2c9154b7ac4b9878f --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24498f0cb1430b6c450a18c2c9154b7ac4b9878f --force-share --output=json" returned: 0 in 0.214s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/24498f0cb1430b6c450a18c2c9154b7ac4b9878f,backing_fmt=raw /opt/stack/data/nova/instances/bef1e493-6b2c-4688-98c2-647261feb571/disk.rescue {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.network.neutron [None req-ab77dfaf-2d16-4753-9bca-9223c9e7a8e3 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Successfully updated port: 84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/24498f0cb1430b6c450a18c2c9154b7ac4b9878f,backing_fmt=raw /opt/stack/data/nova/instances/bef1e493-6b2c-4688-98c2-647261feb571/disk.rescue" returned: 0 in 0.069s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "24498f0cb1430b6c450a18c2c9154b7ac4b9878f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.objects.instance [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lazy-loading 'migration_context' on Instance uuid bef1e493-6b2c-4688-98c2-647261feb571 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ab77dfaf-2d16-4753-9bca-9223c9e7a8e3 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Acquiring lock "refresh_cache-55966005-e534-45d3-9bd4-cea5d54b661e" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ab77dfaf-2d16-4753-9bca-9223c9e7a8e3 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Acquired lock "refresh_cache-55966005-e534-45d3-9bd4-cea5d54b661e" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.network.neutron [None req-ab77dfaf-2d16-4753-9bca-9223c9e7a8e3 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.objects.base [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Object Instance<bef1e493-6b2c-4688-98c2-647261feb571> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Start _get_guest_xml network_info=[{"id": "6ddebd25-cfe6-4b0e-8b2d-746fae9f8685", "address": "fa:16:3e:03:fd:b2", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "vif_mac": "fa:16:3e:03:fd:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddebd25-cf", "ovs_interfaceid": "6ddebd25-cfe6-4b0e-8b2d-746fae9f8685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '012dc83a-a2a0-48e2-b249-a77de8c3cdaa', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '0c502504-1e55-4cc2-abe9-d9b64e6a593c', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Anmyhrti', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'bef1e493-6b2c-4688-98c2-647261feb571', 'attached_at': '', 'detached_at': '', 'volume_id': 'ad797845-bc66-4e30-a209-353015b67372', 'serial': 'ad797845-bc66-4e30-a209-353015b67372'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.objects.instance [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lazy-loading 'resources' on Instance uuid bef1e493-6b2c-4688-98c2-647261feb571 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.objects.base [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Object Instance<bef1e493-6b2c-4688-98c2-647261feb571> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.objects.instance [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lazy-loading 'numa_topology' on Instance uuid bef1e493-6b2c-4688-98c2-647261feb571 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-b7a228a6-8dae-4544-b3da-8b76eb372664 req-992e7ec4-523f-4ec1-baa2-10fbfaadd778 service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Received event network-changed-84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-b7a228a6-8dae-4544-b3da-8b76eb372664 req-992e7ec4-523f-4ec1-baa2-10fbfaadd778 service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Refreshing instance network info cache due to event network-changed-84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b7a228a6-8dae-4544-b3da-8b76eb372664 req-992e7ec4-523f-4ec1-baa2-10fbfaadd778 service nova] Acquiring lock "refresh_cache-55966005-e534-45d3-9bd4-cea5d54b661e" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.objects.base [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Object Instance<bef1e493-6b2c-4688-98c2-647261feb571> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:48:54 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:48:54 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.objects.instance [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lazy-loading 'vcpu_model' on Instance uuid bef1e493-6b2c-4688-98c2-647261feb571 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.objects.base [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Object Instance<bef1e493-6b2c-4688-98c2-647261feb571> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Anmyhrti', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:48:54 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:48:54 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:48:54 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:48:54 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:48:54 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:48:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[712201b7-c639-4183-a7e1-74afe82a50a1]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = Anmyhrti\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 26 08:48:54 user nova-compute[73104]: node.name = iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372
Aug 26 08:48:54 user nova-compute[73104]: node.tpgt = -1
Aug 26 08:48:54 user nova-compute[73104]: node.startup = automatic
Aug 26 08:48:54 user nova-compute[73104]: node.leading_login = No
Aug 26 08:48:54 user nova-compute[73104]: iface.iscsi_ifacename = default
Aug 26 08:48:54 user nova-compute[73104]: iface.net_ifacename = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.ipaddress = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.prefix_len = 0
Aug 26 08:48:54 user nova-compute[73104]: iface.hwaddress = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.transport_name = tcp
Aug 26 08:48:54 user nova-compute[73104]: iface.initiatorname = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.state = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.vlan_id = 0
Aug 26 08:48:54 user nova-compute[73104]: iface.vlan_priority = 0
Aug 26 08:48:54 user nova-compute[73104]: iface.vlan_state = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.iface_num = 0
Aug 26 08:48:54 user nova-compute[73104]: iface.mtu = 0
Aug 26 08:48:54 user nova-compute[73104]: iface.port = 0
Aug 26 08:48:54 user nova-compute[73104]: iface.bootproto = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.subnet_mask = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.gateway = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.dhcp_alt_client_id_state = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.dhcp_alt_client_id = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.dhcp_dns = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.dhcp_learn_iqn = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.dhcp_req_vendor_id_state = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.dhcp_vendor_id_state = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.dhcp_vendor_id = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.dhcp_slp_da = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.fragmentation = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.gratuitous_arp = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.incoming_forwarding = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.tos_state = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.tos = 0
Aug 26 08:48:54 user nova-compute[73104]: iface.ttl = 0
Aug 26 08:48:54 user nova-compute[73104]: iface.delayed_ack = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.tcp_nagle = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.tcp_wsf_state = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.tcp_wsf = 0
Aug 26 08:48:54 user nova-compute[73104]: iface.tcp_timer_scale = 0
Aug 26 08:48:54 user nova-compute[73104]: iface.tcp_timestamp = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.redirect = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.def_task_mgmt_timeout = 0
Aug 26 08:48:54 user nova-compute[73104]: iface.header_digest = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.data_digest = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.immediate_data = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.initial_r2t = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.data_seq_inorder = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.data_pdu_inorder = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.erl = 0
Aug 26 08:48:54 user nova-compute[73104]: iface.max_receive_data_len = 0
Aug 26 08:48:54 user nova-compute[73104]: iface.first_burst_len = 0
Aug 26 08:48:54 user nova-compute[73104]: iface.max_outstanding_r2t = 0
Aug 26 08:48:54 user nova-compute[73104]: iface.max_burst_len = 0
Aug 26 08:48:54 user nova-compute[73104]: iface.chap_auth = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.bidi_chap = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.strict_login_compliance = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.discovery_auth = <empty>
Aug 26 08:48:54 user nova-compute[73104]: iface.discovery_logout = <empty>
Aug 26 08:48:54 user nova-compute[73104]: node.discovery_address = <empty>
Aug 26 08:48:54 user nova-compute[73104]: node.discovery_port = 0
Aug 26 08:48:54 user nova-compute[73104]: node.discovery_type = static
Aug 26 08:48:54 user nova-compute[73104]: node.session.initial_cmdsn = 0
Aug 26 08:48:54 user nova-compute[73104]: node.session.initial_login_retry_max = 8
Aug 26 08:48:54 user nova-compute[73104]: node.session.xmit_thread_priority = -20
Aug 26 08:48:54 user nova-compute[73104]: node.session.cmds_max = 128
Aug 26 08:48:54 user nova-compute[73104]: node.session.queue_depth = 32
Aug 26 08:48:54 user nova-compute[73104]: node.session.nr_sessions = 1
Aug 26 08:48:54 user nova-compute[73104]: node.session.auth.authmethod = CHAP
Aug 26 08:48:54 user nova-compute[73104]: node.session.auth.username = Anmyhrti
Aug 26 08:48:54 user nova-compute[73104]: node.session.auth.password = ***
Aug 26 08:48:54 user nova-compute[73104]: node.session.auth.username_in = <empty>
Aug 26 08:48:54 user nova-compute[73104]: node.session.auth.password_in = <empty>
Aug 26 08:48:54 user nova-compute[73104]: node.session.auth.chap_algs = MD5
Aug 26 08:48:54 user nova-compute[73104]: node.session.timeo.replacement_timeout = 120
Aug 26 08:48:54 user nova-compute[73104]: node.session.err_timeo.abort_timeout = 15
Aug 26 08:48:54 user nova-compute[73104]: node.session.err_timeo.lu_reset_timeout = 30
Aug 26 08:48:54 user nova-compute[73104]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 26 08:48:54 user nova-compute[73104]: node.session.err_timeo.host_reset_timeout = 60
Aug 26 08:48:54 user nova-compute[73104]: node.session.iscsi.FastAbort = Yes
Aug 26 08:48:54 user nova-compute[73104]: node.session.iscsi.InitialR2T = No
Aug 26 08:48:54 user nova-compute[73104]: node.session.iscsi.ImmediateData = Yes
Aug 26 08:48:54 user nova-compute[73104]: node.session.iscsi.FirstBurstLength = 262144
Aug 26 08:48:54 user nova-compute[73104]: node.session.iscsi.MaxBurstLength = 16776192
Aug 26 08:48:54 user nova-compute[73104]: node.session.iscsi.DefaultTime2Retain = 0
Aug 26 08:48:54 user nova-compute[73104]: node.session.iscsi.DefaultTime2Wait = 2
Aug 26 08:48:54 user nova-compute[73104]: node.session.iscsi.MaxConnections = 1
Aug 26 08:48:54 user nova-compute[73104]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 26 08:48:54 user nova-compute[73104]: node.session.iscsi.ERL = 0
Aug 26 08:48:54 user nova-compute[73104]: node.session.scan = manual
Aug 26 08:48:54 user nova-compute[73104]: node.session.reopen_max = 0
Aug 26 08:48:54 user nova-compute[73104]: node.conn[0].address = 172.16.0.220
Aug 26 08:48:54 user nova-compute[73104]: node.conn[0].port = 3260
Aug 26 08:48:54 user nova-compute[73104]: node.conn[0].startup = manual
Aug 26 08:48:54 user nova-compute[73104]: node.conn[0].tcp.window_size = 524288
Aug 26 08:48:54 user nova-compute[73104]: node.conn[0].tcp.type_of_service = 0
Aug 26 08:48:54 user nova-compute[73104]: node.conn[0].timeo.logout_timeout = 15
Aug 26 08:48:54 user nova-compute[73104]: node.conn[0].timeo.login_timeout = 15
Aug 26 08:48:54 user nova-compute[73104]: node.conn[0].timeo.auth_timeout = 45
Aug 26 08:48:54 user nova-compute[73104]: node.conn[0].timeo.noop_out_interval = 5
Aug 26 08:48:54 user nova-compute[73104]: node.conn[0].timeo.noop_out_timeout = 5
Aug 26 08:48:54 user nova-compute[73104]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 26 08:48:54 user nova-compute[73104]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 26 08:48:54 user nova-compute[73104]: node.conn[0].iscsi.HeaderDigest = None
Aug 26 08:48:54 user nova-compute[73104]: node.conn[0].iscsi.DataDigest = None
Aug 26 08:48:54 user nova-compute[73104]: node.conn[0].iscsi.IFMarker = No
Aug 26 08:48:54 user nova-compute[73104]: node.conn[0].iscsi.OFMarker = No
Aug 26 08:48:54 user nova-compute[73104]: # END RECORD
Aug 26 08:48:54 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[29752a15-6ea3-475b-9b55-54eebbf81b7b]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[77acfa9f-bef7-4189-a10f-9bf6bd54d4ad]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Anmyhrti {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Anmyhrti" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6656896f-5aae-4fb2-8758-90ebdde81cda]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Anmyhrti'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[07047843-1897-4afa-a4c4-d38dd29f6d17]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9512cc0-dc52-4b3f-90f7-0b1402aaeb4b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:48:54 user nova-compute[73104]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)
Aug 26 08:48:54 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:48:54 user nova-compute[73104]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)
Aug 26 08:48:54 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.172s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] HCTL ('33', '0', '0', 0) found on session 26 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f686a726-a1d4-4977-bdcb-761e0b6d2b40]: (4, ('0 0 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Searching for a device in session 26 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Anmyhrti', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.202s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] <== connect_volume: return (204ms) {'type': 'block', 'scsi_wwn': '26136336237616338', 'path': '/dev/sdb'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136336237616338', 'path': '/dev/sdb'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1620831996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1620831996',id=24,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:47:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a37356203d547c2abf0aa634c2ad548',ramdisk_id='',reservation_id='r-4p9y2cyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1111216102',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:47:31Z,user_data=None,user_id='bcd11beb7046440f814cbf4a13ab0272',uuid=bef1e493-6b2c-4688-98c2-647261feb571,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ddebd25-cfe6-4b0e-8b2d-746fae9f8685", "address": "fa:16:3e:03:fd:b2", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "vif_mac": "fa:16:3e:03:fd:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddebd25-cf", "ovs_interfaceid": "6ddebd25-cfe6-4b0e-8b2d-746fae9f8685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Converting VIF {"id": "6ddebd25-cfe6-4b0e-8b2d-746fae9f8685", "address": "fa:16:3e:03:fd:b2", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "vif_mac": "fa:16:3e:03:fd:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddebd25-cf", "ovs_interfaceid": "6ddebd25-cfe6-4b0e-8b2d-746fae9f8685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:fd:b2,bridge_name='br-int',has_traffic_filtering=True,id=6ddebd25-cfe6-4b0e-8b2d-746fae9f8685,network=Network(ce0a529c-2119-4b2a-a08f-567e3671c3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddebd25-cf') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:48:54 user nova-compute[73104]: DEBUG nova.objects.instance [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lazy-loading 'pci_devices' on Instance uuid bef1e493-6b2c-4688-98c2-647261feb571 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:48:55 user nova-compute[73104]: DEBUG nova.objects.base [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Object Instance<bef1e493-6b2c-4688-98c2-647261feb571> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:48:55 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:48:55 user nova-compute[73104]:   <uuid>bef1e493-6b2c-4688-98c2-647261feb571</uuid>
Aug 26 08:48:55 user nova-compute[73104]:   <name>instance-00000018</name>
Aug 26 08:48:55 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:48:55 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:48:55 user nova-compute[73104]:   <metadata>
Aug 26 08:48:55 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:48:55 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:48:55 user nova-compute[73104]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1620831996</nova:name>
Aug 26 08:48:55 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:48:54</nova:creationTime>
Aug 26 08:48:55 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:48:55 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:48:55 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:48:55 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:48:55 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:48:55 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:48:55 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:48:55 user nova-compute[73104]:       <nova:owner>
Aug 26 08:48:55 user nova-compute[73104]:         <nova:user uuid="bcd11beb7046440f814cbf4a13ab0272">tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member</nova:user>
Aug 26 08:48:55 user nova-compute[73104]:         <nova:project uuid="8a37356203d547c2abf0aa634c2ad548">tempest-ServerBootFromVolumeStableRescueTest-1111216102</nova:project>
Aug 26 08:48:55 user nova-compute[73104]:       </nova:owner>
Aug 26 08:48:55 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:48:55 user nova-compute[73104]:       <nova:ports>
Aug 26 08:48:55 user nova-compute[73104]:         <nova:port uuid="6ddebd25-cfe6-4b0e-8b2d-746fae9f8685">
Aug 26 08:48:55 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 08:48:55 user nova-compute[73104]:         </nova:port>
Aug 26 08:48:55 user nova-compute[73104]:       </nova:ports>
Aug 26 08:48:55 user nova-compute[73104]:     </nova:instance>
Aug 26 08:48:55 user nova-compute[73104]:   </metadata>
Aug 26 08:48:55 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:48:55 user nova-compute[73104]:     <system>
Aug 26 08:48:55 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:48:55 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:48:55 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:48:55 user nova-compute[73104]:       <entry name="serial">bef1e493-6b2c-4688-98c2-647261feb571</entry>
Aug 26 08:48:55 user nova-compute[73104]:       <entry name="uuid">bef1e493-6b2c-4688-98c2-647261feb571</entry>
Aug 26 08:48:55 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:48:55 user nova-compute[73104]:     </system>
Aug 26 08:48:55 user nova-compute[73104]:   </sysinfo>
Aug 26 08:48:55 user nova-compute[73104]:   <os>
Aug 26 08:48:55 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:48:55 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:48:55 user nova-compute[73104]:   </os>
Aug 26 08:48:55 user nova-compute[73104]:   <features>
Aug 26 08:48:55 user nova-compute[73104]:     <acpi/>
Aug 26 08:48:55 user nova-compute[73104]:     <apic/>
Aug 26 08:48:55 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:48:55 user nova-compute[73104]:   </features>
Aug 26 08:48:55 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:48:55 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:48:55 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:48:55 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:48:55 user nova-compute[73104]:   </clock>
Aug 26 08:48:55 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:48:55 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:48:55 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:48:55 user nova-compute[73104]:   </cpu>
Aug 26 08:48:55 user nova-compute[73104]:   <devices>
Aug 26 08:48:55 user nova-compute[73104]:     <disk type="block" device="disk">
Aug 26 08:48:55 user nova-compute[73104]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:48:55 user nova-compute[73104]:       <source dev="/dev/sdb"/>
Aug 26 08:48:55 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:48:55 user nova-compute[73104]:       <serial>ad797845-bc66-4e30-a209-353015b67372</serial>
Aug 26 08:48:55 user nova-compute[73104]:     </disk>
Aug 26 08:48:55 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:48:55 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:48:55 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/bef1e493-6b2c-4688-98c2-647261feb571/disk.rescue"/>
Aug 26 08:48:55 user nova-compute[73104]:       <target dev="vdb" bus="virtio"/>
Aug 26 08:48:55 user nova-compute[73104]:       <boot order="1"/>
Aug 26 08:48:55 user nova-compute[73104]:     </disk>
Aug 26 08:48:55 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:48:55 user nova-compute[73104]:       <mac address="fa:16:3e:03:fd:b2"/>
Aug 26 08:48:55 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:48:55 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:48:55 user nova-compute[73104]:       <target dev="tap6ddebd25-cf"/>
Aug 26 08:48:55 user nova-compute[73104]:     </interface>
Aug 26 08:48:55 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:48:55 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/bef1e493-6b2c-4688-98c2-647261feb571/console.log" append="off"/>
Aug 26 08:48:55 user nova-compute[73104]:     </serial>
Aug 26 08:48:55 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:48:55 user nova-compute[73104]:     <video>
Aug 26 08:48:55 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:48:55 user nova-compute[73104]:     </video>
Aug 26 08:48:55 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:48:55 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:48:55 user nova-compute[73104]:     </rng>
Aug 26 08:48:55 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:48:55 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:48:55 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:48:55 user nova-compute[73104]:     </memballoon>
Aug 26 08:48:55 user nova-compute[73104]:   </devices>
Aug 26 08:48:55 user nova-compute[73104]: </domain>
Aug 26 08:48:55 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:48:55 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Instance destroyed successfully.
Aug 26 08:48:55 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:48:55 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:48:55 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] No VIF found with MAC fa:16:3e:03:fd:b2, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:48:55 user nova-compute[73104]: DEBUG nova.network.neutron [None req-ab77dfaf-2d16-4753-9bca-9223c9e7a8e3 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Updating instance_info_cache with network_info: [{"id": "b646e439-ff88-4f5b-9fa6-f9a1eac84f08", "address": "fa:16:3e:b8:26:eb", "network": {"id": "edbebe23-8fc4-4a39-b4e8-d32d00d25c7f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2016586720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8190893dbd48a083cc8dba20db0e35", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb646e439-ff", "ovs_interfaceid": "b646e439-ff88-4f5b-9fa6-f9a1eac84f08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3", "address": "fa:16:3e:01:da:bd", "network": {"id": "00ba0bd2-fa5c-432e-b569-f345ad827158", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-447437431", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8b8190893dbd48a083cc8dba20db0e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c9d528-26", "ovs_interfaceid": "84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:48:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ab77dfaf-2d16-4753-9bca-9223c9e7a8e3 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Releasing lock "refresh_cache-55966005-e534-45d3-9bd4-cea5d54b661e" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:48:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b7a228a6-8dae-4544-b3da-8b76eb372664 req-992e7ec4-523f-4ec1-baa2-10fbfaadd778 service nova] Acquired lock "refresh_cache-55966005-e534-45d3-9bd4-cea5d54b661e" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:48:55 user nova-compute[73104]: DEBUG nova.network.neutron [req-b7a228a6-8dae-4544-b3da-8b76eb372664 req-992e7ec4-523f-4ec1-baa2-10fbfaadd778 service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Refreshing network info cache for port 84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:48:55 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-ab77dfaf-2d16-4753-9bca-9223c9e7a8e3 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-829727057',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-829727057',id=25,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPrtw2uPRe9G8zyYK3ARIY3AfX0RzLppVCcvlKoAgXZOG4qTaMTx2cx9wO1C4CoqjxJ4W8gRg9Ex00VbBz9tkcQ5fjhSqrrzBpVdl1qo6UlzDiYX6hf0JXW1ZaomcLxiQ==',key_name='tempest-keypair-1580684820',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:47:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8b8190893dbd48a083cc8dba20db0e35',ramdisk_id='',reservation_id='r-kl6196e4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1715069850',owner_user_name='tempest-TaggedAttachmentsTest-1715069850-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:47:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1fd1bc8d58240e89ed980aa9760cbfe',uuid=55966005-e534-45d3-9bd4-cea5d54b661e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3", "address": "fa:16:3e:01:da:bd", "network": {"id": "00ba0bd2-fa5c-432e-b569-f345ad827158", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-447437431", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8b8190893dbd48a083cc8dba20db0e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c9d528-26", "ovs_interfaceid": "84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:48:55 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-ab77dfaf-2d16-4753-9bca-9223c9e7a8e3 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Converting VIF {"id": "84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3", "address": "fa:16:3e:01:da:bd", "network": {"id": "00ba0bd2-fa5c-432e-b569-f345ad827158", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-447437431", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8b8190893dbd48a083cc8dba20db0e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c9d528-26", "ovs_interfaceid": "84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:48:55 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-ab77dfaf-2d16-4753-9bca-9223c9e7a8e3 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:da:bd,bridge_name='br-int',has_traffic_filtering=True,id=84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3,network=Network(00ba0bd2-fa5c-432e-b569-f345ad827158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c9d528-26') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:48:55 user nova-compute[73104]: DEBUG os_vif [None req-ab77dfaf-2d16-4753-9bca-9223c9e7a8e3 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:da:bd,bridge_name='br-int',has_traffic_filtering=True,id=84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3,network=Network(00ba0bd2-fa5c-432e-b569-f345ad827158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c9d528-26') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:48:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:48:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:48:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84c9d528-26, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:48:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap84c9d528-26, col_values=(('external_ids', {'iface-id': '84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:da:bd', 'vm-uuid': '55966005-e534-45d3-9bd4-cea5d54b661e'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:48:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:48:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:55 user nova-compute[73104]: INFO os_vif [None req-ab77dfaf-2d16-4753-9bca-9223c9e7a8e3 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:da:bd,bridge_name='br-int',has_traffic_filtering=True,id=84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3,network=Network(00ba0bd2-fa5c-432e-b569-f345ad827158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c9d528-26')
Aug 26 08:48:55 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-ab77dfaf-2d16-4753-9bca-9223c9e7a8e3 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-829727057',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-829727057',id=25,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPrtw2uPRe9G8zyYK3ARIY3AfX0RzLppVCcvlKoAgXZOG4qTaMTx2cx9wO1C4CoqjxJ4W8gRg9Ex00VbBz9tkcQ5fjhSqrrzBpVdl1qo6UlzDiYX6hf0JXW1ZaomcLxiQ==',key_name='tempest-keypair-1580684820',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:47:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8b8190893dbd48a083cc8dba20db0e35',ramdisk_id='',reservation_id='r-kl6196e4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1715069850',owner_user_name='tempest-TaggedAttachmentsTest-1715069850-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:47:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1fd1bc8d58240e89ed980aa9760cbfe',uuid=55966005-e534-45d3-9bd4-cea5d54b661e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3", "address": "fa:16:3e:01:da:bd", "network": {"id": "00ba0bd2-fa5c-432e-b569-f345ad827158", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-447437431", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8b8190893dbd48a083cc8dba20db0e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c9d528-26", "ovs_interfaceid": "84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:48:55 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-ab77dfaf-2d16-4753-9bca-9223c9e7a8e3 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Converting VIF {"id": "84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3", "address": "fa:16:3e:01:da:bd", "network": {"id": "00ba0bd2-fa5c-432e-b569-f345ad827158", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-447437431", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8b8190893dbd48a083cc8dba20db0e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c9d528-26", "ovs_interfaceid": "84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:48:55 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-ab77dfaf-2d16-4753-9bca-9223c9e7a8e3 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:da:bd,bridge_name='br-int',has_traffic_filtering=True,id=84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3,network=Network(00ba0bd2-fa5c-432e-b569-f345ad827158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c9d528-26') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:48:55 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-ab77dfaf-2d16-4753-9bca-9223c9e7a8e3 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] attach device xml: <interface type="ethernet">
Aug 26 08:48:55 user nova-compute[73104]:   <mac address="fa:16:3e:01:da:bd"/>
Aug 26 08:48:55 user nova-compute[73104]:   <model type="virtio"/>
Aug 26 08:48:55 user nova-compute[73104]:   <mtu size="1442"/>
Aug 26 08:48:55 user nova-compute[73104]:   <target dev="tap84c9d528-26"/>
Aug 26 08:48:55 user nova-compute[73104]: </interface>
Aug 26 08:48:55 user nova-compute[73104]:  {{(pid=73104) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 08:48:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:55 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:48:55 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:48:55 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 08:48:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-02665c70-cf75-44ba-9d90-eb9e5f12e0b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:48:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-02665c70-cf75-44ba-9d90-eb9e5f12e0b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:48:55 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 08:48:56 user nova-compute[73104]: DEBUG nova.compute.manager [req-1c39620e-9f9e-43e5-8b8a-b79e37ef35a0 req-2d9ea1d8-4b46-4b88-8c9e-9c1fdb1a9718 service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Received event network-vif-plugged-84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:48:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1c39620e-9f9e-43e5-8b8a-b79e37ef35a0 req-2d9ea1d8-4b46-4b88-8c9e-9c1fdb1a9718 service nova] Acquiring lock "55966005-e534-45d3-9bd4-cea5d54b661e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1c39620e-9f9e-43e5-8b8a-b79e37ef35a0 req-2d9ea1d8-4b46-4b88-8c9e-9c1fdb1a9718 service nova] Lock "55966005-e534-45d3-9bd4-cea5d54b661e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1c39620e-9f9e-43e5-8b8a-b79e37ef35a0 req-2d9ea1d8-4b46-4b88-8c9e-9c1fdb1a9718 service nova] Lock "55966005-e534-45d3-9bd4-cea5d54b661e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:56 user nova-compute[73104]: DEBUG nova.compute.manager [req-1c39620e-9f9e-43e5-8b8a-b79e37ef35a0 req-2d9ea1d8-4b46-4b88-8c9e-9c1fdb1a9718 service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] No waiting events found dispatching network-vif-plugged-84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:48:56 user nova-compute[73104]: WARNING nova.compute.manager [req-1c39620e-9f9e-43e5-8b8a-b79e37ef35a0 req-2d9ea1d8-4b46-4b88-8c9e-9c1fdb1a9718 service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Received unexpected event network-vif-plugged-84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3 for instance with vm_state active and task_state None.
Aug 26 08:48:56 user nova-compute[73104]: DEBUG nova.network.neutron [req-b7a228a6-8dae-4544-b3da-8b76eb372664 req-992e7ec4-523f-4ec1-baa2-10fbfaadd778 service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Updated VIF entry in instance network info cache for port 84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:48:56 user nova-compute[73104]: DEBUG nova.network.neutron [req-b7a228a6-8dae-4544-b3da-8b76eb372664 req-992e7ec4-523f-4ec1-baa2-10fbfaadd778 service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Updating instance_info_cache with network_info: [{"id": "b646e439-ff88-4f5b-9fa6-f9a1eac84f08", "address": "fa:16:3e:b8:26:eb", "network": {"id": "edbebe23-8fc4-4a39-b4e8-d32d00d25c7f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2016586720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8190893dbd48a083cc8dba20db0e35", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb646e439-ff", "ovs_interfaceid": "b646e439-ff88-4f5b-9fa6-f9a1eac84f08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3", "address": "fa:16:3e:01:da:bd", "network": {"id": "00ba0bd2-fa5c-432e-b569-f345ad827158", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-447437431", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8b8190893dbd48a083cc8dba20db0e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c9d528-26", "ovs_interfaceid": "84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:48:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b7a228a6-8dae-4544-b3da-8b76eb372664 req-992e7ec4-523f-4ec1-baa2-10fbfaadd778 service nova] Releasing lock "refresh_cache-55966005-e534-45d3-9bd4-cea5d54b661e" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:48:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ab77dfaf-2d16-4753-9bca-9223c9e7a8e3 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:48:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ab77dfaf-2d16-4753-9bca-9223c9e7a8e3 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] No BDM found with device name hda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:48:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ab77dfaf-2d16-4753-9bca-9223c9e7a8e3 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] No VIF found with MAC fa:16:3e:b8:26:eb, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:48:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-ab77dfaf-2d16-4753-9bca-9223c9e7a8e3 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:48:56 user nova-compute[73104]:   <nova:package version="0.0.0"/>
Aug 26 08:48:56 user nova-compute[73104]:   <nova:name>tempest-device-tagging-server-829727057</nova:name>
Aug 26 08:48:56 user nova-compute[73104]:   <nova:creationTime>2023-08-26 08:48:56</nova:creationTime>
Aug 26 08:48:56 user nova-compute[73104]:   <nova:flavor name="m1.tiny">
Aug 26 08:48:56 user nova-compute[73104]:     <nova:memory>512</nova:memory>
Aug 26 08:48:56 user nova-compute[73104]:     <nova:disk>1</nova:disk>
Aug 26 08:48:56 user nova-compute[73104]:     <nova:swap>0</nova:swap>
Aug 26 08:48:56 user nova-compute[73104]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:48:56 user nova-compute[73104]:     <nova:vcpus>1</nova:vcpus>
Aug 26 08:48:56 user nova-compute[73104]:   </nova:flavor>
Aug 26 08:48:56 user nova-compute[73104]:   <nova:owner>
Aug 26 08:48:56 user nova-compute[73104]:     <nova:user uuid="a1fd1bc8d58240e89ed980aa9760cbfe">tempest-TaggedAttachmentsTest-1715069850-project-member</nova:user>
Aug 26 08:48:56 user nova-compute[73104]:     <nova:project uuid="8b8190893dbd48a083cc8dba20db0e35">tempest-TaggedAttachmentsTest-1715069850</nova:project>
Aug 26 08:48:56 user nova-compute[73104]:   </nova:owner>
Aug 26 08:48:56 user nova-compute[73104]:   <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:48:56 user nova-compute[73104]:   <nova:ports>
Aug 26 08:48:56 user nova-compute[73104]:     <nova:port uuid="b646e439-ff88-4f5b-9fa6-f9a1eac84f08">
Aug 26 08:48:56 user nova-compute[73104]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 08:48:56 user nova-compute[73104]:     </nova:port>
Aug 26 08:48:56 user nova-compute[73104]:     <nova:port uuid="84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3">
Aug 26 08:48:56 user nova-compute[73104]:       <nova:ip type="fixed" address="10.10.10.103" ipVersion="4"/>
Aug 26 08:48:56 user nova-compute[73104]:     </nova:port>
Aug 26 08:48:56 user nova-compute[73104]:   </nova:ports>
Aug 26 08:48:56 user nova-compute[73104]: </nova:instance>
Aug 26 08:48:56 user nova-compute[73104]:  {{(pid=73104) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 26 08:48:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ab77dfaf-2d16-4753-9bca-9223c9e7a8e3 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lock "interface-55966005-e534-45d3-9bd4-cea5d54b661e-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 5.698s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:56 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Updating instance_info_cache with network_info: [{"id": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "address": "fa:16:3e:d9:91:54", "network": {"id": "d09a6d6b-0c92-4bc3-a691-0aa3911d756e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1480336812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "994053e8d737440f8cb22f048a3c1873", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4b7f02-03", "ovs_interfaceid": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:48:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-02665c70-cf75-44ba-9d90-eb9e5f12e0b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:48:56 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 08:48:56 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:48:56 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:48:56 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:48:56 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:48:56 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:48:56 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:48:56 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 08:48:56 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Acquiring lock "55966005-e534-45d3-9bd4-cea5d54b661e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lock "55966005-e534-45d3-9bd4-cea5d54b661e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG nova.objects.instance [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lazy-loading 'flavor' on Instance uuid 55966005-e534-45d3-9bd4-cea5d54b661e {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lock "55966005-e534-45d3-9bd4-cea5d54b661e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Acquiring lock "55966005-e534-45d3-9bd4-cea5d54b661e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lock "55966005-e534-45d3-9bd4-cea5d54b661e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:57 user nova-compute[73104]: INFO nova.compute.manager [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Attaching volume 4be7d96a-c45e-406e-8250-75fba2d5553b to /dev/vdb
Aug 26 08:48:57 user nova-compute[73104]: DEBUG os_brick.utils [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[616e3655-beb4-4d6f-b5a0-8948a0d008dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ff0df0-f98d-4cc2-9444-ef86772dfe57]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c1d895-e46f-4687-9bf7-1ff5a258f4c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[116892e7-3bda-448b-9b2c-cd4dc34de358]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:48:57 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:48:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[09468601-df6b-4a3a-9516-c6553c690658]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG os_brick.utils [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:48:57 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Updating existing volume attachment record: 2c7df094-4f22-4539-9657-9ea521852e98 {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 08:48:58 user nova-compute[73104]: DEBUG nova.compute.manager [req-5616d5fe-4dc9-44c1-beeb-4625b9b1bdce req-3eb78fe2-e558-4cf8-9d52-a2a6dd9a3c87 service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Received event network-vif-plugged-84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:48:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5616d5fe-4dc9-44c1-beeb-4625b9b1bdce req-3eb78fe2-e558-4cf8-9d52-a2a6dd9a3c87 service nova] Acquiring lock "55966005-e534-45d3-9bd4-cea5d54b661e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5616d5fe-4dc9-44c1-beeb-4625b9b1bdce req-3eb78fe2-e558-4cf8-9d52-a2a6dd9a3c87 service nova] Lock "55966005-e534-45d3-9bd4-cea5d54b661e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5616d5fe-4dc9-44c1-beeb-4625b9b1bdce req-3eb78fe2-e558-4cf8-9d52-a2a6dd9a3c87 service nova] Lock "55966005-e534-45d3-9bd4-cea5d54b661e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:58 user nova-compute[73104]: DEBUG nova.compute.manager [req-5616d5fe-4dc9-44c1-beeb-4625b9b1bdce req-3eb78fe2-e558-4cf8-9d52-a2a6dd9a3c87 service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] No waiting events found dispatching network-vif-plugged-84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:48:58 user nova-compute[73104]: WARNING nova.compute.manager [req-5616d5fe-4dc9-44c1-beeb-4625b9b1bdce req-3eb78fe2-e558-4cf8-9d52-a2a6dd9a3c87 service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Received unexpected event network-vif-plugged-84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3 for instance with vm_state active and task_state None.
Aug 26 08:48:58 user nova-compute[73104]: DEBUG nova.compute.manager [req-5616d5fe-4dc9-44c1-beeb-4625b9b1bdce req-3eb78fe2-e558-4cf8-9d52-a2a6dd9a3c87 service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Received event network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:48:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5616d5fe-4dc9-44c1-beeb-4625b9b1bdce req-3eb78fe2-e558-4cf8-9d52-a2a6dd9a3c87 service nova] Acquiring lock "bef1e493-6b2c-4688-98c2-647261feb571-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5616d5fe-4dc9-44c1-beeb-4625b9b1bdce req-3eb78fe2-e558-4cf8-9d52-a2a6dd9a3c87 service nova] Lock "bef1e493-6b2c-4688-98c2-647261feb571-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5616d5fe-4dc9-44c1-beeb-4625b9b1bdce req-3eb78fe2-e558-4cf8-9d52-a2a6dd9a3c87 service nova] Lock "bef1e493-6b2c-4688-98c2-647261feb571-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:58 user nova-compute[73104]: DEBUG nova.compute.manager [req-5616d5fe-4dc9-44c1-beeb-4625b9b1bdce req-3eb78fe2-e558-4cf8-9d52-a2a6dd9a3c87 service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] No waiting events found dispatching network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:48:58 user nova-compute[73104]: WARNING nova.compute.manager [req-5616d5fe-4dc9-44c1-beeb-4625b9b1bdce req-3eb78fe2-e558-4cf8-9d52-a2a6dd9a3c87 service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Received unexpected event network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 for instance with vm_state active and task_state rescuing.
Aug 26 08:48:58 user nova-compute[73104]: DEBUG nova.compute.manager [req-5616d5fe-4dc9-44c1-beeb-4625b9b1bdce req-3eb78fe2-e558-4cf8-9d52-a2a6dd9a3c87 service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Received event network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:48:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5616d5fe-4dc9-44c1-beeb-4625b9b1bdce req-3eb78fe2-e558-4cf8-9d52-a2a6dd9a3c87 service nova] Acquiring lock "bef1e493-6b2c-4688-98c2-647261feb571-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:48:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5616d5fe-4dc9-44c1-beeb-4625b9b1bdce req-3eb78fe2-e558-4cf8-9d52-a2a6dd9a3c87 service nova] Lock "bef1e493-6b2c-4688-98c2-647261feb571-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:48:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5616d5fe-4dc9-44c1-beeb-4625b9b1bdce req-3eb78fe2-e558-4cf8-9d52-a2a6dd9a3c87 service nova] Lock "bef1e493-6b2c-4688-98c2-647261feb571-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:48:58 user nova-compute[73104]: DEBUG nova.compute.manager [req-5616d5fe-4dc9-44c1-beeb-4625b9b1bdce req-3eb78fe2-e558-4cf8-9d52-a2a6dd9a3c87 service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] No waiting events found dispatching network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:48:58 user nova-compute[73104]: WARNING nova.compute.manager [req-5616d5fe-4dc9-44c1-beeb-4625b9b1bdce req-3eb78fe2-e558-4cf8-9d52-a2a6dd9a3c87 service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Received unexpected event network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 for instance with vm_state active and task_state rescuing.
Aug 26 08:48:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:48:59 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Removed pending event for bef1e493-6b2c-4688-98c2-647261feb571 due to event {{(pid=73104) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 08:48:59 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039739.6475856, bef1e493-6b2c-4688-98c2-647261feb571 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:48:59 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: bef1e493-6b2c-4688-98c2-647261feb571] VM Resumed (Lifecycle Event)
Aug 26 08:48:59 user nova-compute[73104]: DEBUG nova.compute.manager [None req-fe734238-9122-477d-b11b-ee05a76d4aca tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:48:59 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:48:59 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:48:59 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: bef1e493-6b2c-4688-98c2-647261feb571] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 08:48:59 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039739.6498206, bef1e493-6b2c-4688-98c2-647261feb571 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:48:59 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: bef1e493-6b2c-4688-98c2-647261feb571] VM Started (Lifecycle Event)
Aug 26 08:49:00 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:49:00 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:49:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:00 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:49:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef1e493-6b2c-4688-98c2-647261feb571/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef1e493-6b2c-4688-98c2-647261feb571/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef1e493-6b2c-4688-98c2-647261feb571/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef1e493-6b2c-4688-98c2-647261feb571/disk.rescue --force-share --output=json" returned: 0 in 0.242s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk --force-share --output=json" returned: 0 in 0.304s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:49:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ddeefec-ed4f-4fec-8d1c-02a2ddf65023/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ddeefec-ed4f-4fec-8d1c-02a2ddf65023/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ddeefec-ed4f-4fec-8d1c-02a2ddf65023/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ddeefec-ed4f-4fec-8d1c-02a2ddf65023/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UMlRKZVu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:49:03 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:49:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:49:03 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:49:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:49:03 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7914785-aced-468c-9fb2-d4b49c640d53]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:49:03 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c86c3a6-c2ff-425b-8677-8947d0d668e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b] added
Aug 26 08:49:03 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d191026-aa75-4d84-bf7b-6e9ccc9a422d]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8d80ab-eaaa-43f5-94a0-ded7ca4a71b9]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UMlRKZVu {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UMlRKZVu" returned: 0 in 0.027s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee80d16-c52d-48c2-981b-bd1c9eceea09]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UMlRKZVu'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dc39b5-76b8-49f0-ac69-07a21c14db8c]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b818d5-f1a1-44e7-ba22-ad5e46c7ca46]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:49:03 user nova-compute[73104]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)
Aug 26 08:49:03 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:49:03 user nova-compute[73104]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)
Aug 26 08:49:03 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbdf5fc-1549-4a26-9e24-08b63fe1df3d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b, portal: 172.16.0.220,3260]
Aug 26 08:49:03 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b, portal: 172.16.0.220,3260] successful.
Aug 26 08:49:03 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d121f56-ee51-4282-a32e-8a1bc12ed69c]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6277e19-917c-4b6b-9bef-d6914d31879f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:49:03 user nova-compute[73104]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)
Aug 26 08:49:03 user nova-compute[73104]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b (non-flash)
Aug 26 08:49:03 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:49:03 user nova-compute[73104]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)
Aug 26 08:49:03 user nova-compute[73104]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b (non-flash)
Aug 26 08:49:03 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.455s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ad7562-37ff-4817-9161-1b3048a508f0]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: None {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:04 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:49:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UMlRKZVu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:49:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.626s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:49:04 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] <== connect_volume: return (1629ms) {'type': 'block', 'scsi_wwn': '26336306235343437', 'path': '/dev/sdd'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:49:04 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336306235343437', 'path': '/dev/sdd'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:49:04 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:49:04 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:49:04 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=7485MB free_disk=24.21719741821289GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 08:49:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:49:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:49:04 user nova-compute[73104]: DEBUG nova.objects.instance [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lazy-loading 'flavor' on Instance uuid 02665c70-cf75-44ba-9d90-eb9e5f12e0b7 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:49:04 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 08:49:04 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:49:04 user nova-compute[73104]:   <source dev="/dev/sdd"/>
Aug 26 08:49:04 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:49:04 user nova-compute[73104]:   <serial>e30bc0fc-d957-4e49-83a6-c3db0a223e1b</serial>
Aug 26 08:49:04 user nova-compute[73104]: </disk>
Aug 26 08:49:04 user nova-compute[73104]:  {{(pid=73104) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 08:49:04 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance b5e1f82c-5675-4c37-8ba2-44e6a341a576 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:49:04 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 3cf85d2f-de0d-4e9b-a534-98c799ae8db9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:49:04 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 02665c70-cf75-44ba-9d90-eb9e5f12e0b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:49:04 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance b7f6e347-c1f3-4f56-86c4-3b28c4729964 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:49:04 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance bef1e493-6b2c-4688-98c2-647261feb571 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:49:04 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 55966005-e534-45d3-9bd4-cea5d54b661e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:49:04 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:49:04 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance c3b4c644-f7f3-4304-b732-9f43cfeac2bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:49:04 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 08:49:04 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 08:49:05 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:49:05 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:49:05 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 08:49:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.600s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:49:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:49:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:49:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] No VIF found with MAC fa:16:3e:d9:91:54, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:49:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-6f3d544f-c1a4-4fa8-8505-b3751a6db94c tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.204s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:49:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:06 user nova-compute[73104]: INFO nova.compute.manager [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Rescuing
Aug 26 08:49:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Acquiring lock "refresh_cache-02665c70-cf75-44ba-9d90-eb9e5f12e0b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:49:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Acquired lock "refresh_cache-02665c70-cf75-44ba-9d90-eb9e5f12e0b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:49:06 user nova-compute[73104]: DEBUG nova.network.neutron [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:49:07 user nova-compute[73104]: DEBUG nova.network.neutron [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Updating instance_info_cache with network_info: [{"id": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "address": "fa:16:3e:d9:91:54", "network": {"id": "d09a6d6b-0c92-4bc3-a691-0aa3911d756e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1480336812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "994053e8d737440f8cb22f048a3c1873", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4b7f02-03", "ovs_interfaceid": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:49:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Releasing lock "refresh_cache-02665c70-cf75-44ba-9d90-eb9e5f12e0b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:49:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:08 user nova-compute[73104]: DEBUG nova.compute.manager [req-c82be268-3147-44e6-95bb-15231c53eb34 req-d97f4b37-aa23-4a43-ad90-254b386af7c0 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received event network-vif-unplugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:49:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c82be268-3147-44e6-95bb-15231c53eb34 req-d97f4b37-aa23-4a43-ad90-254b386af7c0 service nova] Acquiring lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:49:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c82be268-3147-44e6-95bb-15231c53eb34 req-d97f4b37-aa23-4a43-ad90-254b386af7c0 service nova] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:49:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c82be268-3147-44e6-95bb-15231c53eb34 req-d97f4b37-aa23-4a43-ad90-254b386af7c0 service nova] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:49:08 user nova-compute[73104]: DEBUG nova.compute.manager [req-c82be268-3147-44e6-95bb-15231c53eb34 req-d97f4b37-aa23-4a43-ad90-254b386af7c0 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] No waiting events found dispatching network-vif-unplugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:49:08 user nova-compute[73104]: WARNING nova.compute.manager [req-c82be268-3147-44e6-95bb-15231c53eb34 req-d97f4b37-aa23-4a43-ad90-254b386af7c0 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received unexpected event network-vif-unplugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 for instance with vm_state active and task_state rescuing.
Aug 26 08:49:08 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Instance destroyed successfully.
Aug 26 08:49:08 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Attempting a stable device rescue
Aug 26 08:49:08 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73104) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 08:49:08 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Instance directory exists: not creating {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 08:49:08 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Creating image(s)
Aug 26 08:49:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Acquiring lock "/opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:49:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "/opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:49:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "/opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:49:08 user nova-compute[73104]: DEBUG nova.objects.instance [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lazy-loading 'trusted_certs' on Instance uuid 02665c70-cf75-44ba-9d90-eb9e5f12e0b7 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:49:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Acquiring lock "2b98aa7479d9550bbbb80268225eb2f28f8188c6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:49:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "2b98aa7479d9550bbbb80268225eb2f28f8188c6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:49:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b98aa7479d9550bbbb80268225eb2f28f8188c6.part --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:09 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:49:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b98aa7479d9550bbbb80268225eb2f28f8188c6.part --force-share --output=json" returned: 0 in 0.204s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:09 user nova-compute[73104]: DEBUG nova.virt.images [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] a5d91e6f-76cf-4bd7-b8a7-2e87da6121ac was qcow2, converting to raw {{(pid=73104) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 08:49:09 user nova-compute[73104]: DEBUG nova.privsep.utils [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73104) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 08:49:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2b98aa7479d9550bbbb80268225eb2f28f8188c6.part /opt/stack/data/nova/instances/_base/2b98aa7479d9550bbbb80268225eb2f28f8188c6.converted {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2b98aa7479d9550bbbb80268225eb2f28f8188c6.part /opt/stack/data/nova/instances/_base/2b98aa7479d9550bbbb80268225eb2f28f8188c6.converted" returned: 0 in 0.347s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b98aa7479d9550bbbb80268225eb2f28f8188c6.converted --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.compute.manager [req-2fcfcd37-38c1-49a5-9f91-fe35fea6ce29 req-1e9bf2df-9be2-4a60-bfa7-72aba4135efb service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received event network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2fcfcd37-38c1-49a5-9f91-fe35fea6ce29 req-1e9bf2df-9be2-4a60-bfa7-72aba4135efb service nova] Acquiring lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2fcfcd37-38c1-49a5-9f91-fe35fea6ce29 req-1e9bf2df-9be2-4a60-bfa7-72aba4135efb service nova] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2fcfcd37-38c1-49a5-9f91-fe35fea6ce29 req-1e9bf2df-9be2-4a60-bfa7-72aba4135efb service nova] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.compute.manager [req-2fcfcd37-38c1-49a5-9f91-fe35fea6ce29 req-1e9bf2df-9be2-4a60-bfa7-72aba4135efb service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] No waiting events found dispatching network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:49:10 user nova-compute[73104]: WARNING nova.compute.manager [req-2fcfcd37-38c1-49a5-9f91-fe35fea6ce29 req-1e9bf2df-9be2-4a60-bfa7-72aba4135efb service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received unexpected event network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 for instance with vm_state active and task_state rescuing.
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b98aa7479d9550bbbb80268225eb2f28f8188c6.converted --force-share --output=json" returned: 0 in 0.219s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "2b98aa7479d9550bbbb80268225eb2f28f8188c6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.717s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Acquiring lock "2b98aa7479d9550bbbb80268225eb2f28f8188c6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "2b98aa7479d9550bbbb80268225eb2f28f8188c6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b98aa7479d9550bbbb80268225eb2f28f8188c6 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b98aa7479d9550bbbb80268225eb2f28f8188c6 --force-share --output=json" returned: 0 in 0.205s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b98aa7479d9550bbbb80268225eb2f28f8188c6,backing_fmt=raw /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk.rescue {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b98aa7479d9550bbbb80268225eb2f28f8188c6,backing_fmt=raw /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk.rescue" returned: 0 in 0.068s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "2b98aa7479d9550bbbb80268225eb2f28f8188c6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.objects.instance [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lazy-loading 'migration_context' on Instance uuid 02665c70-cf75-44ba-9d90-eb9e5f12e0b7 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.objects.base [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Object Instance<02665c70-cf75-44ba-9d90-eb9e5f12e0b7> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Start _get_guest_xml network_info=[{"id": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "address": "fa:16:3e:d9:91:54", "network": {"id": "d09a6d6b-0c92-4bc3-a691-0aa3911d756e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1480336812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1480336812-network", "vif_mac": "fa:16:3e:d9:91:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "994053e8d737440f8cb22f048a3c1873", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4b7f02-03", "ovs_interfaceid": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a5d91e6f-76cf-4bd7-b8a7-2e87da6121ac', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '34aff9cd-4427-4444-991e-d22dd8c9bdc2', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UMlRKZVu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '02665c70-cf75-44ba-9d90-eb9e5f12e0b7', 'attached_at': '', 'detached_at': '', 'volume_id': 'e30bc0fc-d957-4e49-83a6-c3db0a223e1b', 'serial': 'e30bc0fc-d957-4e49-83a6-c3db0a223e1b'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.objects.instance [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lazy-loading 'resources' on Instance uuid 02665c70-cf75-44ba-9d90-eb9e5f12e0b7 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.objects.base [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Object Instance<02665c70-cf75-44ba-9d90-eb9e5f12e0b7> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.objects.instance [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lazy-loading 'numa_topology' on Instance uuid 02665c70-cf75-44ba-9d90-eb9e5f12e0b7 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.objects.base [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Object Instance<02665c70-cf75-44ba-9d90-eb9e5f12e0b7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:49:10 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:49:10 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.objects.instance [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lazy-loading 'vcpu_model' on Instance uuid 02665c70-cf75-44ba-9d90-eb9e5f12e0b7 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.objects.base [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Object Instance<02665c70-cf75-44ba-9d90-eb9e5f12e0b7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UMlRKZVu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:49:10 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:49:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:49:10 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:49:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:49:10 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:49:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b -p 172.16.0.220:3260" returned: 0 in 0.033s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[626d90e4-0efe-4e33-b7fa-9d2e95eddb22]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = UMlRKZVu\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 26 08:49:10 user nova-compute[73104]: node.name = iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b
Aug 26 08:49:10 user nova-compute[73104]: node.tpgt = -1
Aug 26 08:49:10 user nova-compute[73104]: node.startup = automatic
Aug 26 08:49:10 user nova-compute[73104]: node.leading_login = No
Aug 26 08:49:10 user nova-compute[73104]: iface.iscsi_ifacename = default
Aug 26 08:49:10 user nova-compute[73104]: iface.net_ifacename = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.ipaddress = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.prefix_len = 0
Aug 26 08:49:10 user nova-compute[73104]: iface.hwaddress = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.transport_name = tcp
Aug 26 08:49:10 user nova-compute[73104]: iface.initiatorname = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.state = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.vlan_id = 0
Aug 26 08:49:10 user nova-compute[73104]: iface.vlan_priority = 0
Aug 26 08:49:10 user nova-compute[73104]: iface.vlan_state = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.iface_num = 0
Aug 26 08:49:10 user nova-compute[73104]: iface.mtu = 0
Aug 26 08:49:10 user nova-compute[73104]: iface.port = 0
Aug 26 08:49:10 user nova-compute[73104]: iface.bootproto = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.subnet_mask = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.gateway = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.dhcp_alt_client_id_state = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.dhcp_alt_client_id = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.dhcp_dns = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.dhcp_learn_iqn = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.dhcp_req_vendor_id_state = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.dhcp_vendor_id_state = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.dhcp_vendor_id = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.dhcp_slp_da = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.fragmentation = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.gratuitous_arp = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.incoming_forwarding = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.tos_state = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.tos = 0
Aug 26 08:49:10 user nova-compute[73104]: iface.ttl = 0
Aug 26 08:49:10 user nova-compute[73104]: iface.delayed_ack = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.tcp_nagle = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.tcp_wsf_state = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.tcp_wsf = 0
Aug 26 08:49:10 user nova-compute[73104]: iface.tcp_timer_scale = 0
Aug 26 08:49:10 user nova-compute[73104]: iface.tcp_timestamp = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.redirect = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.def_task_mgmt_timeout = 0
Aug 26 08:49:10 user nova-compute[73104]: iface.header_digest = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.data_digest = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.immediate_data = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.initial_r2t = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.data_seq_inorder = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.data_pdu_inorder = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.erl = 0
Aug 26 08:49:10 user nova-compute[73104]: iface.max_receive_data_len = 0
Aug 26 08:49:10 user nova-compute[73104]: iface.first_burst_len = 0
Aug 26 08:49:10 user nova-compute[73104]: iface.max_outstanding_r2t = 0
Aug 26 08:49:10 user nova-compute[73104]: iface.max_burst_len = 0
Aug 26 08:49:10 user nova-compute[73104]: iface.chap_auth = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.bidi_chap = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.strict_login_compliance = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.discovery_auth = <empty>
Aug 26 08:49:10 user nova-compute[73104]: iface.discovery_logout = <empty>
Aug 26 08:49:10 user nova-compute[73104]: node.discovery_address = <empty>
Aug 26 08:49:10 user nova-compute[73104]: node.discovery_port = 0
Aug 26 08:49:10 user nova-compute[73104]: node.discovery_type = static
Aug 26 08:49:10 user nova-compute[73104]: node.session.initial_cmdsn = 0
Aug 26 08:49:10 user nova-compute[73104]: node.session.initial_login_retry_max = 8
Aug 26 08:49:10 user nova-compute[73104]: node.session.xmit_thread_priority = -20
Aug 26 08:49:10 user nova-compute[73104]: node.session.cmds_max = 128
Aug 26 08:49:10 user nova-compute[73104]: node.session.queue_depth = 32
Aug 26 08:49:10 user nova-compute[73104]: node.session.nr_sessions = 1
Aug 26 08:49:10 user nova-compute[73104]: node.session.auth.authmethod = CHAP
Aug 26 08:49:10 user nova-compute[73104]: node.session.auth.username = UMlRKZVu
Aug 26 08:49:10 user nova-compute[73104]: node.session.auth.password = ***
Aug 26 08:49:10 user nova-compute[73104]: node.session.auth.username_in = <empty>
Aug 26 08:49:10 user nova-compute[73104]: node.session.auth.password_in = <empty>
Aug 26 08:49:10 user nova-compute[73104]: node.session.auth.chap_algs = MD5
Aug 26 08:49:10 user nova-compute[73104]: node.session.timeo.replacement_timeout = 120
Aug 26 08:49:10 user nova-compute[73104]: node.session.err_timeo.abort_timeout = 15
Aug 26 08:49:10 user nova-compute[73104]: node.session.err_timeo.lu_reset_timeout = 30
Aug 26 08:49:10 user nova-compute[73104]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 26 08:49:10 user nova-compute[73104]: node.session.err_timeo.host_reset_timeout = 60
Aug 26 08:49:10 user nova-compute[73104]: node.session.iscsi.FastAbort = Yes
Aug 26 08:49:10 user nova-compute[73104]: node.session.iscsi.InitialR2T = No
Aug 26 08:49:10 user nova-compute[73104]: node.session.iscsi.ImmediateData = Yes
Aug 26 08:49:10 user nova-compute[73104]: node.session.iscsi.FirstBurstLength = 262144
Aug 26 08:49:10 user nova-compute[73104]: node.session.iscsi.MaxBurstLength = 16776192
Aug 26 08:49:10 user nova-compute[73104]: node.session.iscsi.DefaultTime2Retain = 0
Aug 26 08:49:10 user nova-compute[73104]: node.session.iscsi.DefaultTime2Wait = 2
Aug 26 08:49:10 user nova-compute[73104]: node.session.iscsi.MaxConnections = 1
Aug 26 08:49:10 user nova-compute[73104]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 26 08:49:10 user nova-compute[73104]: node.session.iscsi.ERL = 0
Aug 26 08:49:10 user nova-compute[73104]: node.session.scan = manual
Aug 26 08:49:10 user nova-compute[73104]: node.session.reopen_max = 0
Aug 26 08:49:10 user nova-compute[73104]: node.conn[0].address = 172.16.0.220
Aug 26 08:49:10 user nova-compute[73104]: node.conn[0].port = 3260
Aug 26 08:49:10 user nova-compute[73104]: node.conn[0].startup = manual
Aug 26 08:49:10 user nova-compute[73104]: node.conn[0].tcp.window_size = 524288
Aug 26 08:49:10 user nova-compute[73104]: node.conn[0].tcp.type_of_service = 0
Aug 26 08:49:10 user nova-compute[73104]: node.conn[0].timeo.logout_timeout = 15
Aug 26 08:49:10 user nova-compute[73104]: node.conn[0].timeo.login_timeout = 15
Aug 26 08:49:10 user nova-compute[73104]: node.conn[0].timeo.auth_timeout = 45
Aug 26 08:49:10 user nova-compute[73104]: node.conn[0].timeo.noop_out_interval = 5
Aug 26 08:49:10 user nova-compute[73104]: node.conn[0].timeo.noop_out_timeout = 5
Aug 26 08:49:10 user nova-compute[73104]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 26 08:49:10 user nova-compute[73104]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 26 08:49:10 user nova-compute[73104]: node.conn[0].iscsi.HeaderDigest = None
Aug 26 08:49:10 user nova-compute[73104]: node.conn[0].iscsi.DataDigest = None
Aug 26 08:49:10 user nova-compute[73104]: node.conn[0].iscsi.IFMarker = No
Aug 26 08:49:10 user nova-compute[73104]: node.conn[0].iscsi.OFMarker = No
Aug 26 08:49:10 user nova-compute[73104]: # END RECORD
Aug 26 08:49:10 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99673a3-d1f0-4777-9d85-bf0c204a253c]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[622064da-a370-4589-8178-f32b59be3d47]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UMlRKZVu {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UMlRKZVu" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c1afe4-1ea9-4e91-891d-dcaaa9e5c0c9]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UMlRKZVu'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[12857eab-62e4-4f6b-ab19-d1a7dc246343]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba38e7e-c159-44fc-9997-57ef680921e6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:49:10 user nova-compute[73104]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)
Aug 26 08:49:10 user nova-compute[73104]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b (non-flash)
Aug 26 08:49:10 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:49:10 user nova-compute[73104]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)
Aug 26 08:49:10 user nova-compute[73104]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b (non-flash)
Aug 26 08:49:10 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.189s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] HCTL ('35', '0', '0', 0) found on session 29 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84664c0-0720-4e07-acf6-807fe6725d61]: (4, ('0 0 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Searching for a device in session 29 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UMlRKZVu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.224s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] <== connect_volume: return (226ms) {'type': 'block', 'scsi_wwn': '26336306235343437', 'path': '/dev/sdd'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336306235343437', 'path': '/dev/sdd'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:45:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-173756414',display_name='tempest-ServerStableDeviceRescueTest-server-173756414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-173756414',id=22,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDA0D9deqQAjrCLJd7vYB9eHa6xBscEdhGpQZkcJVmul30WTV05uYFTJHfePlsMdjM8/w/MauXZ8IM+tEsl3F9Wrd1BEMVqInSiZ7zedxOHCI2tOBe+m4M5LA+fV7gmJQ==',key_name='tempest-keypair-1663477319',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:45:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='994053e8d737440f8cb22f048a3c1873',ramdisk_id='',reservation_id='r-1a4hiypw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1186902489',owner_user_name='tempest-ServerStableDeviceRescueTest-1186902489-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:47:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b62f9580b597480eb0a775a160dadba4',uuid=02665c70-cf75-44ba-9d90-eb9e5f12e0b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "address": "fa:16:3e:d9:91:54", "network": {"id": "d09a6d6b-0c92-4bc3-a691-0aa3911d756e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1480336812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1480336812-network", "vif_mac": "fa:16:3e:d9:91:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "994053e8d737440f8cb22f048a3c1873", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4b7f02-03", "ovs_interfaceid": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Converting VIF {"id": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "address": "fa:16:3e:d9:91:54", "network": {"id": "d09a6d6b-0c92-4bc3-a691-0aa3911d756e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1480336812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1480336812-network", "vif_mac": "fa:16:3e:d9:91:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "994053e8d737440f8cb22f048a3c1873", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4b7f02-03", "ovs_interfaceid": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:91:54,bridge_name='br-int',has_traffic_filtering=True,id=af4b7f02-03f5-492b-9d27-4d7e5523b423,network=Network(d09a6d6b-0c92-4bc3-a691-0aa3911d756e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4b7f02-03') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.objects.instance [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lazy-loading 'pci_devices' on Instance uuid 02665c70-cf75-44ba-9d90-eb9e5f12e0b7 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.objects.base [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Object Instance<02665c70-cf75-44ba-9d90-eb9e5f12e0b7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:49:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:49:10 user nova-compute[73104]:   <uuid>02665c70-cf75-44ba-9d90-eb9e5f12e0b7</uuid>
Aug 26 08:49:10 user nova-compute[73104]:   <name>instance-00000016</name>
Aug 26 08:49:10 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:49:10 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:49:10 user nova-compute[73104]:   <metadata>
Aug 26 08:49:10 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:49:10 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:49:10 user nova-compute[73104]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-173756414</nova:name>
Aug 26 08:49:10 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:49:10</nova:creationTime>
Aug 26 08:49:10 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:49:10 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:49:10 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:49:10 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:49:10 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:49:10 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:49:10 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:49:10 user nova-compute[73104]:       <nova:owner>
Aug 26 08:49:10 user nova-compute[73104]:         <nova:user uuid="b62f9580b597480eb0a775a160dadba4">tempest-ServerStableDeviceRescueTest-1186902489-project-member</nova:user>
Aug 26 08:49:10 user nova-compute[73104]:         <nova:project uuid="994053e8d737440f8cb22f048a3c1873">tempest-ServerStableDeviceRescueTest-1186902489</nova:project>
Aug 26 08:49:10 user nova-compute[73104]:       </nova:owner>
Aug 26 08:49:10 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:49:10 user nova-compute[73104]:       <nova:ports>
Aug 26 08:49:10 user nova-compute[73104]:         <nova:port uuid="af4b7f02-03f5-492b-9d27-4d7e5523b423">
Aug 26 08:49:10 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 08:49:10 user nova-compute[73104]:         </nova:port>
Aug 26 08:49:10 user nova-compute[73104]:       </nova:ports>
Aug 26 08:49:10 user nova-compute[73104]:     </nova:instance>
Aug 26 08:49:10 user nova-compute[73104]:   </metadata>
Aug 26 08:49:10 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:49:10 user nova-compute[73104]:     <system>
Aug 26 08:49:10 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:49:10 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:49:10 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:49:10 user nova-compute[73104]:       <entry name="serial">02665c70-cf75-44ba-9d90-eb9e5f12e0b7</entry>
Aug 26 08:49:10 user nova-compute[73104]:       <entry name="uuid">02665c70-cf75-44ba-9d90-eb9e5f12e0b7</entry>
Aug 26 08:49:10 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:49:10 user nova-compute[73104]:     </system>
Aug 26 08:49:10 user nova-compute[73104]:   </sysinfo>
Aug 26 08:49:10 user nova-compute[73104]:   <os>
Aug 26 08:49:10 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:49:10 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:49:10 user nova-compute[73104]:   </os>
Aug 26 08:49:10 user nova-compute[73104]:   <features>
Aug 26 08:49:10 user nova-compute[73104]:     <acpi/>
Aug 26 08:49:10 user nova-compute[73104]:     <apic/>
Aug 26 08:49:10 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:49:10 user nova-compute[73104]:   </features>
Aug 26 08:49:10 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:49:10 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:49:10 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:49:10 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:49:10 user nova-compute[73104]:   </clock>
Aug 26 08:49:10 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:49:10 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:49:10 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:49:10 user nova-compute[73104]:   </cpu>
Aug 26 08:49:10 user nova-compute[73104]:   <devices>
Aug 26 08:49:10 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:49:10 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:49:10 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk"/>
Aug 26 08:49:10 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:49:10 user nova-compute[73104]:     </disk>
Aug 26 08:49:10 user nova-compute[73104]:     <disk type="block" device="disk">
Aug 26 08:49:10 user nova-compute[73104]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:49:10 user nova-compute[73104]:       <source dev="/dev/sdd"/>
Aug 26 08:49:10 user nova-compute[73104]:       <target dev="vdb" bus="virtio"/>
Aug 26 08:49:10 user nova-compute[73104]:       <serial>e30bc0fc-d957-4e49-83a6-c3db0a223e1b</serial>
Aug 26 08:49:10 user nova-compute[73104]:     </disk>
Aug 26 08:49:10 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:49:10 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:49:10 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk.rescue"/>
Aug 26 08:49:10 user nova-compute[73104]:       <target dev="vdc" bus="virtio"/>
Aug 26 08:49:10 user nova-compute[73104]:       <boot order="1"/>
Aug 26 08:49:10 user nova-compute[73104]:     </disk>
Aug 26 08:49:10 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:49:10 user nova-compute[73104]:       <mac address="fa:16:3e:d9:91:54"/>
Aug 26 08:49:10 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:49:10 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:49:10 user nova-compute[73104]:       <target dev="tapaf4b7f02-03"/>
Aug 26 08:49:10 user nova-compute[73104]:     </interface>
Aug 26 08:49:10 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:49:10 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/console.log" append="off"/>
Aug 26 08:49:10 user nova-compute[73104]:     </serial>
Aug 26 08:49:10 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:49:10 user nova-compute[73104]:     <video>
Aug 26 08:49:10 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:49:10 user nova-compute[73104]:     </video>
Aug 26 08:49:10 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:49:10 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:49:10 user nova-compute[73104]:     </rng>
Aug 26 08:49:10 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:49:10 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:49:10 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:49:10 user nova-compute[73104]:     </memballoon>
Aug 26 08:49:10 user nova-compute[73104]:   </devices>
Aug 26 08:49:10 user nova-compute[73104]: </domain>
Aug 26 08:49:10 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:49:10 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Instance destroyed successfully.
Aug 26 08:49:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] No VIF found with MAC fa:16:3e:d9:91:54, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSexlcJG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:49:11 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:49:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:49:11 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:49:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:49:11 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:49:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc8f231-63f5-4b0d-b433-23f9ea2170af]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:49:11 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd8df25-9224-4e8f-9c98-2a18e8938306]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b] added
Aug 26 08:49:11 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d699f247-8377-441e-b641-97b6009f08a2]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2860159-48ff-41a9-8bae-35b65999ce45]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pSexlcJG {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pSexlcJG" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9431ac4-2d3c-4c14-b67f-d8e77b82a3ee]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pSexlcJG'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc4acf4-e6bf-4507-8e03-196ce28901e2]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4335b37a-14bd-4acc-8f61-41201ecf06cc]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:49:11 user nova-compute[73104]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)
Aug 26 08:49:11 user nova-compute[73104]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b (non-flash)
Aug 26 08:49:11 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:49:11 user nova-compute[73104]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)
Aug 26 08:49:11 user nova-compute[73104]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b (non-flash)
Aug 26 08:49:11 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[40006fda-737b-4d33-98d2-b00774458229]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b, portal: 172.16.0.220,3260]
Aug 26 08:49:11 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b, portal: 172.16.0.220,3260] successful.
Aug 26 08:49:11 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:49:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:12 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f110cc42-0441-472d-8f3e-a5f9df3634bf]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:49:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:12 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[da23ca94-19f2-4f81-847b-5d9c18ba087c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:49:12 user nova-compute[73104]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)
Aug 26 08:49:12 user nova-compute[73104]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b (non-flash)
Aug 26 08:49:12 user nova-compute[73104]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b (non-flash)
Aug 26 08:49:12 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:49:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:49:12 user nova-compute[73104]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)
Aug 26 08:49:12 user nova-compute[73104]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b (non-flash)
Aug 26 08:49:12 user nova-compute[73104]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b (non-flash)
Aug 26 08:49:12 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:49:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:49:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:49:12 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:49:12 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:49:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.027s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:12 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a8d383-a751-4c05-9c13-b4b1206cc4b2]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:12 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:49:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSexlcJG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:49:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:13 user nova-compute[73104]: DEBUG nova.compute.manager [req-466295a6-efde-4670-941d-31236d459faf req-1ac6740e-c5e7-46f0-a810-e7c106ceeb74 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received event network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:49:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-466295a6-efde-4670-941d-31236d459faf req-1ac6740e-c5e7-46f0-a810-e7c106ceeb74 service nova] Acquiring lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:49:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-466295a6-efde-4670-941d-31236d459faf req-1ac6740e-c5e7-46f0-a810-e7c106ceeb74 service nova] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:49:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-466295a6-efde-4670-941d-31236d459faf req-1ac6740e-c5e7-46f0-a810-e7c106ceeb74 service nova] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:49:13 user nova-compute[73104]: DEBUG nova.compute.manager [req-466295a6-efde-4670-941d-31236d459faf req-1ac6740e-c5e7-46f0-a810-e7c106ceeb74 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] No waiting events found dispatching network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:49:13 user nova-compute[73104]: WARNING nova.compute.manager [req-466295a6-efde-4670-941d-31236d459faf req-1ac6740e-c5e7-46f0-a810-e7c106ceeb74 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received unexpected event network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 for instance with vm_state active and task_state rescuing.
Aug 26 08:49:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:49:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '23935636531396636', 'path': '/dev/sde'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:49:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935636531396636', 'path': '/dev/sde'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:49:13 user nova-compute[73104]: DEBUG nova.objects.instance [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lazy-loading 'flavor' on Instance uuid 55966005-e534-45d3-9bd4-cea5d54b661e {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:49:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 08:49:13 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:49:13 user nova-compute[73104]:   <source dev="/dev/sde"/>
Aug 26 08:49:13 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:49:13 user nova-compute[73104]:   <serial>4be7d96a-c45e-406e-8250-75fba2d5553b</serial>
Aug 26 08:49:13 user nova-compute[73104]: </disk>
Aug 26 08:49:13 user nova-compute[73104]:  {{(pid=73104) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 08:49:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:49:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] No BDM found with device name hda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:49:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] No VIF found with MAC fa:16:3e:b8:26:eb, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:49:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-aeb500f4-0a88-4ed7-9af5-994256615fd9 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lock "55966005-e534-45d3-9bd4-cea5d54b661e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.321s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:49:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:15 user nova-compute[73104]: DEBUG nova.compute.manager [req-950761af-3096-4cf0-9e78-da68656cdba6 req-ef2c395a-0efc-4bd1-b40e-8dbfb20536d9 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received event network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:49:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-950761af-3096-4cf0-9e78-da68656cdba6 req-ef2c395a-0efc-4bd1-b40e-8dbfb20536d9 service nova] Acquiring lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:49:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-950761af-3096-4cf0-9e78-da68656cdba6 req-ef2c395a-0efc-4bd1-b40e-8dbfb20536d9 service nova] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:49:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-950761af-3096-4cf0-9e78-da68656cdba6 req-ef2c395a-0efc-4bd1-b40e-8dbfb20536d9 service nova] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:49:15 user nova-compute[73104]: DEBUG nova.compute.manager [req-950761af-3096-4cf0-9e78-da68656cdba6 req-ef2c395a-0efc-4bd1-b40e-8dbfb20536d9 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] No waiting events found dispatching network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:49:15 user nova-compute[73104]: WARNING nova.compute.manager [req-950761af-3096-4cf0-9e78-da68656cdba6 req-ef2c395a-0efc-4bd1-b40e-8dbfb20536d9 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received unexpected event network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 for instance with vm_state active and task_state rescuing.
Aug 26 08:49:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b47f4ba3-2ed1-4b06-a468-1fff4e5e2800 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Acquiring lock "55966005-e534-45d3-9bd4-cea5d54b661e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:49:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b47f4ba3-2ed1-4b06-a468-1fff4e5e2800 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lock "55966005-e534-45d3-9bd4-cea5d54b661e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:49:15 user nova-compute[73104]: INFO nova.compute.manager [None req-b47f4ba3-2ed1-4b06-a468-1fff4e5e2800 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Detaching volume 4be7d96a-c45e-406e-8250-75fba2d5553b
Aug 26 08:49:15 user nova-compute[73104]: INFO nova.virt.block_device [None req-b47f4ba3-2ed1-4b06-a468-1fff4e5e2800 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Attempting to driver detach volume 4be7d96a-c45e-406e-8250-75fba2d5553b from mountpoint /dev/vdb
Aug 26 08:49:15 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b47f4ba3-2ed1-4b06-a468-1fff4e5e2800 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Attempting to detach device vdb from instance 55966005-e534-45d3-9bd4-cea5d54b661e from the persistent domain config. {{(pid=73104) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 08:49:15 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-b47f4ba3-2ed1-4b06-a468-1fff4e5e2800 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:49:15 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:49:15 user nova-compute[73104]:   <source dev="/dev/sde"/>
Aug 26 08:49:15 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:49:15 user nova-compute[73104]:   <serial>4be7d96a-c45e-406e-8250-75fba2d5553b</serial>
Aug 26 08:49:15 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 08:49:15 user nova-compute[73104]: </disk>
Aug 26 08:49:15 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:49:15 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-b47f4ba3-2ed1-4b06-a468-1fff4e5e2800 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Successfully detached device vdb from instance 55966005-e534-45d3-9bd4-cea5d54b661e from the persistent domain config.
Aug 26 08:49:15 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b47f4ba3-2ed1-4b06-a468-1fff4e5e2800 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 55966005-e534-45d3-9bd4-cea5d54b661e from the live domain config. {{(pid=73104) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 08:49:15 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-b47f4ba3-2ed1-4b06-a468-1fff4e5e2800 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:49:15 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:49:15 user nova-compute[73104]:   <source dev="/dev/sde"/>
Aug 26 08:49:15 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:49:15 user nova-compute[73104]:   <serial>4be7d96a-c45e-406e-8250-75fba2d5553b</serial>
Aug 26 08:49:15 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 08:49:15 user nova-compute[73104]: </disk>
Aug 26 08:49:15 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:49:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:15 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Removed pending event for 02665c70-cf75-44ba-9d90-eb9e5f12e0b7 due to event {{(pid=73104) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 08:49:15 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039755.7983341, 02665c70-cf75-44ba-9d90-eb9e5f12e0b7 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:49:15 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] VM Resumed (Lifecycle Event)
Aug 26 08:49:15 user nova-compute[73104]: DEBUG nova.compute.manager [None req-c2b704e9-7baf-43fd-b163-a2975448e072 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:49:15 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:49:15 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:49:15 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 08:49:15 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039755.8050354, 02665c70-cf75-44ba-9d90-eb9e5f12e0b7 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:49:15 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] VM Started (Lifecycle Event)
Aug 26 08:49:15 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:49:15 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Received event <DeviceRemovedEvent: 1693039756.0061545, 55966005-e534-45d3-9bd4-cea5d54b661e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73104) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b47f4ba3-2ed1-4b06-a468-1fff4e5e2800 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 55966005-e534-45d3-9bd4-cea5d54b661e {{(pid=73104) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 08:49:16 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-b47f4ba3-2ed1-4b06-a468-1fff4e5e2800 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Successfully detached device vdb from instance 55966005-e534-45d3-9bd4-cea5d54b661e from the live domain config.
Aug 26 08:49:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b47f4ba3-2ed1-4b06-a468-1fff4e5e2800 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f4ba3-2ed1-4b06-a468-1fff4e5e2800 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pSexlcJG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:49:16 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-b47f4ba3-2ed1-4b06-a468-1fff4e5e2800 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:49:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b47f4ba3-2ed1-4b06-a468-1fff4e5e2800 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b47f4ba3-2ed1-4b06-a468-1fff4e5e2800 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f4ba3-2ed1-4b06-a468-1fff4e5e2800 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf46169-c4cc-4211-af01-5a570800021b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9964865c-505f-4683-a3d3-2a538116c9ba]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f4ba3-2ed1-4b06-a468-1fff4e5e2800 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:49:16 user nova-compute[73104]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)
Aug 26 08:49:16 user nova-compute[73104]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b (non-flash)
Aug 26 08:49:16 user nova-compute[73104]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b (non-flash)
Aug 26 08:49:16 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f4ba3-2ed1-4b06-a468-1fff4e5e2800 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:49:16 user nova-compute[73104]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)
Aug 26 08:49:16 user nova-compute[73104]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b (non-flash)
Aug 26 08:49:16 user nova-compute[73104]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b (non-flash)
Aug 26 08:49:16 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f4ba3-2ed1-4b06-a468-1fff4e5e2800 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0cf541510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b'): ({'sde'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b47f4ba3-2ed1-4b06-a468-1fff4e5e2800 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Removing single pathed devices sde {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae85399b-8268-42db-9796-5ccdaf0782d0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abd067b-c634-433d-8da6-1d0f961afc25]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b47f4ba3-2ed1-4b06-a468-1fff4e5e2800 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Flushing IO for device /dev/sde {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcaa8f5-2b7c-4ce3-9204-1da8182c47a9]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b47f4ba3-2ed1-4b06-a468-1fff4e5e2800 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b84fedb-3f2a-4ff7-bd54-703252250467]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b47f4ba3-2ed1-4b06-a468-1fff4e5e2800 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b47f4ba3-2ed1-4b06-a468-1fff4e5e2800 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] SCSI volumes sde have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f4ba3-2ed1-4b06-a468-1fff4e5e2800 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1a6f09-8918-4711-9521-390c6bfef792]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f4ba3-2ed1-4b06-a468-1fff4e5e2800 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfc7c72-fa1a-49ed-9540-17bad891acee]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f4ba3-2ed1-4b06-a468-1fff4e5e2800 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b, portal: 172.16.0.220,3260]
Aug 26 08:49:16 user nova-compute[73104]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b, portal: 172.16.0.220,3260] successful.
Aug 26 08:49:16 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4be7d96a-c45e-406e-8250-75fba2d5553b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbb746b-cf3e-4754-b7ac-68a0522ed966]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f4ba3-2ed1-4b06-a468-1fff4e5e2800 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b47f4ba3-2ed1-4b06-a468-1fff4e5e2800 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f4ba3-2ed1-4b06-a468-1fff4e5e2800 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] <== disconnect_volume: return (307ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:49:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b47f4ba3-2ed1-4b06-a468-1fff4e5e2800 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:49:17 user nova-compute[73104]: DEBUG nova.objects.instance [None req-b47f4ba3-2ed1-4b06-a468-1fff4e5e2800 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lazy-loading 'flavor' on Instance uuid 55966005-e534-45d3-9bd4-cea5d54b661e {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:49:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b47f4ba3-2ed1-4b06-a468-1fff4e5e2800 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lock "55966005-e534-45d3-9bd4-cea5d54b661e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.863s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:49:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cedd9450-a69c-4efe-aa50-e6e633c926e2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Acquiring lock "interface-55966005-e534-45d3-9bd4-cea5d54b661e-84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:49:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cedd9450-a69c-4efe-aa50-e6e633c926e2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lock "interface-55966005-e534-45d3-9bd4-cea5d54b661e-84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:49:17 user nova-compute[73104]: DEBUG nova.objects.instance [None req-cedd9450-a69c-4efe-aa50-e6e633c926e2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lazy-loading 'flavor' on Instance uuid 55966005-e534-45d3-9bd4-cea5d54b661e {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:49:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-cedd9450-a69c-4efe-aa50-e6e633c926e2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-829727057',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-829727057',id=25,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPrtw2uPRe9G8zyYK3ARIY3AfX0RzLppVCcvlKoAgXZOG4qTaMTx2cx9wO1C4CoqjxJ4W8gRg9Ex00VbBz9tkcQ5fjhSqrrzBpVdl1qo6UlzDiYX6hf0JXW1ZaomcLxiQ==',key_name='tempest-keypair-1580684820',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:47:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b8190893dbd48a083cc8dba20db0e35',ramdisk_id='',reservation_id='r-kl6196e4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1715069850',owner_user_name='tempest-TaggedAttachmentsTest-1715069850-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:47:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1fd1bc8d58240e89ed980aa9760cbfe',uuid=55966005-e534-45d3-9bd4-cea5d54b661e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3", "address": "fa:16:3e:01:da:bd", "network": {"id": "00ba0bd2-fa5c-432e-b569-f345ad827158", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-447437431", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8b8190893dbd48a083cc8dba20db0e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c9d528-26", "ovs_interfaceid": "84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:49:17 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-cedd9450-a69c-4efe-aa50-e6e633c926e2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Converting VIF {"id": "84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3", "address": "fa:16:3e:01:da:bd", "network": {"id": "00ba0bd2-fa5c-432e-b569-f345ad827158", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-447437431", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8b8190893dbd48a083cc8dba20db0e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c9d528-26", "ovs_interfaceid": "84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:49:17 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-cedd9450-a69c-4efe-aa50-e6e633c926e2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:da:bd,bridge_name='br-int',has_traffic_filtering=True,id=84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3,network=Network(00ba0bd2-fa5c-432e-b569-f345ad827158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c9d528-26') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:49:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-cedd9450-a69c-4efe-aa50-e6e633c926e2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:01:da:bd"/><model type="virtio"/><mtu size="1442"/><target dev="tap84c9d528-26"/></interface> {{(pid=73104) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 08:49:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-cedd9450-a69c-4efe-aa50-e6e633c926e2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:01:da:bd"/><model type="virtio"/><mtu size="1442"/><target dev="tap84c9d528-26"/></interface> {{(pid=73104) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 08:49:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cedd9450-a69c-4efe-aa50-e6e633c926e2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Attempting to detach device tap84c9d528-26 from instance 55966005-e534-45d3-9bd4-cea5d54b661e from the persistent domain config. {{(pid=73104) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 08:49:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-cedd9450-a69c-4efe-aa50-e6e633c926e2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] detach device xml: <interface type="ethernet">
Aug 26 08:49:17 user nova-compute[73104]:   <mac address="fa:16:3e:01:da:bd"/>
Aug 26 08:49:17 user nova-compute[73104]:   <model type="virtio"/>
Aug 26 08:49:17 user nova-compute[73104]:   <mtu size="1442"/>
Aug 26 08:49:17 user nova-compute[73104]:   <target dev="tap84c9d528-26"/>
Aug 26 08:49:17 user nova-compute[73104]: </interface>
Aug 26 08:49:17 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:49:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-cedd9450-a69c-4efe-aa50-e6e633c926e2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:01:da:bd"/><model type="virtio"/><mtu size="1442"/><target dev="tap84c9d528-26"/></interface> {{(pid=73104) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 08:49:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-cedd9450-a69c-4efe-aa50-e6e633c926e2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:01:da:bd"/><model type="virtio"/><mtu size="1442"/><target dev="tap84c9d528-26"/></interface>not found in domain: <domain type='kvm' id='28'>
Aug 26 08:49:17 user nova-compute[73104]:   <name>instance-00000019</name>
Aug 26 08:49:17 user nova-compute[73104]:   <uuid>55966005-e534-45d3-9bd4-cea5d54b661e</uuid>
Aug 26 08:49:17 user nova-compute[73104]:   <metadata>
Aug 26 08:49:17 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:49:17 user nova-compute[73104]:   <nova:package version="0.0.0"/>
Aug 26 08:49:17 user nova-compute[73104]:   <nova:name>tempest-device-tagging-server-829727057</nova:name>
Aug 26 08:49:17 user nova-compute[73104]:   <nova:creationTime>2023-08-26 08:48:56</nova:creationTime>
Aug 26 08:49:17 user nova-compute[73104]:   <nova:flavor name="m1.tiny">
Aug 26 08:49:17 user nova-compute[73104]:     <nova:memory>512</nova:memory>
Aug 26 08:49:17 user nova-compute[73104]:     <nova:disk>1</nova:disk>
Aug 26 08:49:17 user nova-compute[73104]:     <nova:swap>0</nova:swap>
Aug 26 08:49:17 user nova-compute[73104]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:49:17 user nova-compute[73104]:     <nova:vcpus>1</nova:vcpus>
Aug 26 08:49:17 user nova-compute[73104]:   </nova:flavor>
Aug 26 08:49:17 user nova-compute[73104]:   <nova:owner>
Aug 26 08:49:17 user nova-compute[73104]:     <nova:user uuid="a1fd1bc8d58240e89ed980aa9760cbfe">tempest-TaggedAttachmentsTest-1715069850-project-member</nova:user>
Aug 26 08:49:17 user nova-compute[73104]:     <nova:project uuid="8b8190893dbd48a083cc8dba20db0e35">tempest-TaggedAttachmentsTest-1715069850</nova:project>
Aug 26 08:49:17 user nova-compute[73104]:   </nova:owner>
Aug 26 08:49:17 user nova-compute[73104]:   <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:49:17 user nova-compute[73104]:   <nova:ports>
Aug 26 08:49:17 user nova-compute[73104]:     <nova:port uuid="b646e439-ff88-4f5b-9fa6-f9a1eac84f08">
Aug 26 08:49:17 user nova-compute[73104]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 08:49:17 user nova-compute[73104]:     </nova:port>
Aug 26 08:49:17 user nova-compute[73104]:     <nova:port uuid="84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3">
Aug 26 08:49:17 user nova-compute[73104]:       <nova:ip type="fixed" address="10.10.10.103" ipVersion="4"/>
Aug 26 08:49:17 user nova-compute[73104]:     </nova:port>
Aug 26 08:49:17 user nova-compute[73104]:   </nova:ports>
Aug 26 08:49:17 user nova-compute[73104]: </nova:instance>
Aug 26 08:49:17 user nova-compute[73104]:   </metadata>
Aug 26 08:49:17 user nova-compute[73104]:   <memory unit='KiB'>524288</memory>
Aug 26 08:49:17 user nova-compute[73104]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 26 08:49:17 user nova-compute[73104]:   <vcpu placement='static'>1</vcpu>
Aug 26 08:49:17 user nova-compute[73104]:   <resource>
Aug 26 08:49:17 user nova-compute[73104]:     <partition>/machine</partition>
Aug 26 08:49:17 user nova-compute[73104]:   </resource>
Aug 26 08:49:17 user nova-compute[73104]:   <sysinfo type='smbios'>
Aug 26 08:49:17 user nova-compute[73104]:     <system>
Aug 26 08:49:17 user nova-compute[73104]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 26 08:49:17 user nova-compute[73104]:       <entry name='product'>OpenStack Nova</entry>
Aug 26 08:49:17 user nova-compute[73104]:       <entry name='version'>0.0.0</entry>
Aug 26 08:49:17 user nova-compute[73104]:       <entry name='serial'>55966005-e534-45d3-9bd4-cea5d54b661e</entry>
Aug 26 08:49:17 user nova-compute[73104]:       <entry name='uuid'>55966005-e534-45d3-9bd4-cea5d54b661e</entry>
Aug 26 08:49:17 user nova-compute[73104]:       <entry name='family'>Virtual Machine</entry>
Aug 26 08:49:17 user nova-compute[73104]:     </system>
Aug 26 08:49:17 user nova-compute[73104]:   </sysinfo>
Aug 26 08:49:17 user nova-compute[73104]:   <os>
Aug 26 08:49:17 user nova-compute[73104]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 26 08:49:17 user nova-compute[73104]:     <boot dev='hd'/>
Aug 26 08:49:17 user nova-compute[73104]:     <smbios mode='sysinfo'/>
Aug 26 08:49:17 user nova-compute[73104]:   </os>
Aug 26 08:49:17 user nova-compute[73104]:   <features>
Aug 26 08:49:17 user nova-compute[73104]:     <acpi/>
Aug 26 08:49:17 user nova-compute[73104]:     <apic/>
Aug 26 08:49:17 user nova-compute[73104]:     <vmcoreinfo state='on'/>
Aug 26 08:49:17 user nova-compute[73104]:   </features>
Aug 26 08:49:17 user nova-compute[73104]:   <cpu mode='custom' match='exact' check='full'>
Aug 26 08:49:17 user nova-compute[73104]:     <model fallback='forbid'>Nehalem</model>
Aug 26 08:49:17 user nova-compute[73104]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 26 08:49:17 user nova-compute[73104]:     <feature policy='require' name='vme'/>
Aug 26 08:49:17 user nova-compute[73104]:     <feature policy='require' name='x2apic'/>
Aug 26 08:49:17 user nova-compute[73104]:     <feature policy='require' name='hypervisor'/>
Aug 26 08:49:17 user nova-compute[73104]:   </cpu>
Aug 26 08:49:17 user nova-compute[73104]:   <clock offset='utc'>
Aug 26 08:49:17 user nova-compute[73104]:     <timer name='pit' tickpolicy='delay'/>
Aug 26 08:49:17 user nova-compute[73104]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 26 08:49:17 user nova-compute[73104]:     <timer name='hpet' present='no'/>
Aug 26 08:49:17 user nova-compute[73104]:   </clock>
Aug 26 08:49:17 user nova-compute[73104]:   <on_poweroff>destroy</on_poweroff>
Aug 26 08:49:17 user nova-compute[73104]:   <on_reboot>restart</on_reboot>
Aug 26 08:49:17 user nova-compute[73104]:   <on_crash>destroy</on_crash>
Aug 26 08:49:17 user nova-compute[73104]:   <devices>
Aug 26 08:49:17 user nova-compute[73104]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 08:49:17 user nova-compute[73104]:     <disk type='file' device='disk'>
Aug 26 08:49:17 user nova-compute[73104]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 26 08:49:17 user nova-compute[73104]:       <source file='/opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/disk' index='2'/>
Aug 26 08:49:17 user nova-compute[73104]:       <backingStore type='file' index='3'>
Aug 26 08:49:17 user nova-compute[73104]:         <format type='raw'/>
Aug 26 08:49:17 user nova-compute[73104]:         <source file='/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5'/>
Aug 26 08:49:17 user nova-compute[73104]:         <backingStore/>
Aug 26 08:49:17 user nova-compute[73104]:       </backingStore>
Aug 26 08:49:17 user nova-compute[73104]:       <target dev='vda' bus='virtio'/>
Aug 26 08:49:17 user nova-compute[73104]:       <alias name='virtio-disk0'/>
Aug 26 08:49:17 user nova-compute[73104]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 26 08:49:17 user nova-compute[73104]:     </disk>
Aug 26 08:49:17 user nova-compute[73104]:     <disk type='file' device='cdrom'>
Aug 26 08:49:17 user nova-compute[73104]:       <driver name='qemu' type='raw' cache='none'/>
Aug 26 08:49:17 user nova-compute[73104]:       <source file='/opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/disk.config' index='1'/>
Aug 26 08:49:17 user nova-compute[73104]:       <backingStore/>
Aug 26 08:49:17 user nova-compute[73104]:       <target dev='hda' bus='ide'/>
Aug 26 08:49:17 user nova-compute[73104]:       <readonly/>
Aug 26 08:49:17 user nova-compute[73104]:       <alias name='ide0-0-0'/>
Aug 26 08:49:17 user nova-compute[73104]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 26 08:49:17 user nova-compute[73104]:     </disk>
Aug 26 08:49:17 user nova-compute[73104]:     <controller type='usb' index='0' model='none'>
Aug 26 08:49:17 user nova-compute[73104]:       <alias name='usb'/>
Aug 26 08:49:17 user nova-compute[73104]:     </controller>
Aug 26 08:49:17 user nova-compute[73104]:     <controller type='pci' index='0' model='pci-root'>
Aug 26 08:49:17 user nova-compute[73104]:       <alias name='pci.0'/>
Aug 26 08:49:17 user nova-compute[73104]:     </controller>
Aug 26 08:49:17 user nova-compute[73104]:     <controller type='ide' index='0'>
Aug 26 08:49:17 user nova-compute[73104]:       <alias name='ide'/>
Aug 26 08:49:17 user nova-compute[73104]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 26 08:49:17 user nova-compute[73104]:     </controller>
Aug 26 08:49:17 user nova-compute[73104]:     <interface type='ethernet'>
Aug 26 08:49:17 user nova-compute[73104]:       <mac address='fa:16:3e:b8:26:eb'/>
Aug 26 08:49:17 user nova-compute[73104]:       <target dev='tapb646e439-ff'/>
Aug 26 08:49:17 user nova-compute[73104]:       <model type='virtio'/>
Aug 26 08:49:17 user nova-compute[73104]:       <mtu size='1442'/>
Aug 26 08:49:17 user nova-compute[73104]:       <alias name='net0'/>
Aug 26 08:49:17 user nova-compute[73104]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 26 08:49:17 user nova-compute[73104]:     </interface>
Aug 26 08:49:17 user nova-compute[73104]:     <interface type='ethernet'>
Aug 26 08:49:17 user nova-compute[73104]:       <mac address='fa:16:3e:01:da:bd'/>
Aug 26 08:49:17 user nova-compute[73104]:       <target dev='tap84c9d528-26'/>
Aug 26 08:49:17 user nova-compute[73104]:       <model type='virtio'/>
Aug 26 08:49:17 user nova-compute[73104]:       <mtu size='1442'/>
Aug 26 08:49:17 user nova-compute[73104]:       <alias name='net1'/>
Aug 26 08:49:17 user nova-compute[73104]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 26 08:49:17 user nova-compute[73104]:     </interface>
Aug 26 08:49:17 user nova-compute[73104]:     <serial type='pty'>
Aug 26 08:49:17 user nova-compute[73104]:       <source path='/dev/pts/2'/>
Aug 26 08:49:17 user nova-compute[73104]:       <log file='/opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/console.log' append='off'/>
Aug 26 08:49:17 user nova-compute[73104]:       <target type='isa-serial' port='0'>
Aug 26 08:49:17 user nova-compute[73104]:         <model name='isa-serial'/>
Aug 26 08:49:17 user nova-compute[73104]:       </target>
Aug 26 08:49:17 user nova-compute[73104]:       <alias name='serial0'/>
Aug 26 08:49:17 user nova-compute[73104]:     </serial>
Aug 26 08:49:17 user nova-compute[73104]:     <console type='pty' tty='/dev/pts/2'>
Aug 26 08:49:17 user nova-compute[73104]:       <source path='/dev/pts/2'/>
Aug 26 08:49:17 user nova-compute[73104]:       <log file='/opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/console.log' append='off'/>
Aug 26 08:49:17 user nova-compute[73104]:       <target type='serial' port='0'/>
Aug 26 08:49:17 user nova-compute[73104]:       <alias name='serial0'/>
Aug 26 08:49:17 user nova-compute[73104]:     </console>
Aug 26 08:49:17 user nova-compute[73104]:     <input type='mouse' bus='ps2'>
Aug 26 08:49:17 user nova-compute[73104]:       <alias name='input0'/>
Aug 26 08:49:17 user nova-compute[73104]:     </input>
Aug 26 08:49:17 user nova-compute[73104]:     <input type='keyboard' bus='ps2'>
Aug 26 08:49:17 user nova-compute[73104]:       <alias name='input1'/>
Aug 26 08:49:17 user nova-compute[73104]:     </input>
Aug 26 08:49:17 user nova-compute[73104]:     <graphics type='vnc' port='5902' autoport='yes' listen='0.0.0.0'>
Aug 26 08:49:17 user nova-compute[73104]:       <listen type='address' address='0.0.0.0'/>
Aug 26 08:49:17 user nova-compute[73104]:     </graphics>
Aug 26 08:49:17 user nova-compute[73104]:     <audio id='1' type='none'/>
Aug 26 08:49:17 user nova-compute[73104]:     <video>
Aug 26 08:49:17 user nova-compute[73104]:       <model type='virtio' heads='1' primary='yes'/>
Aug 26 08:49:17 user nova-compute[73104]:       <alias name='video0'/>
Aug 26 08:49:17 user nova-compute[73104]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 26 08:49:17 user nova-compute[73104]:     </video>
Aug 26 08:49:17 user nova-compute[73104]:     <memballoon model='virtio'>
Aug 26 08:49:17 user nova-compute[73104]:       <stats period='10'/>
Aug 26 08:49:17 user nova-compute[73104]:       <alias name='balloon0'/>
Aug 26 08:49:17 user nova-compute[73104]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 26 08:49:17 user nova-compute[73104]:     </memballoon>
Aug 26 08:49:17 user nova-compute[73104]:     <rng model='virtio'>
Aug 26 08:49:17 user nova-compute[73104]:       <backend model='random'>/dev/urandom</backend>
Aug 26 08:49:17 user nova-compute[73104]:       <alias name='rng0'/>
Aug 26 08:49:17 user nova-compute[73104]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 26 08:49:17 user nova-compute[73104]:     </rng>
Aug 26 08:49:17 user nova-compute[73104]:   </devices>
Aug 26 08:49:17 user nova-compute[73104]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 26 08:49:17 user nova-compute[73104]:     <label>libvirt-55966005-e534-45d3-9bd4-cea5d54b661e</label>
Aug 26 08:49:17 user nova-compute[73104]:     <imagelabel>libvirt-55966005-e534-45d3-9bd4-cea5d54b661e</imagelabel>
Aug 26 08:49:17 user nova-compute[73104]:   </seclabel>
Aug 26 08:49:17 user nova-compute[73104]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 26 08:49:17 user nova-compute[73104]:     <label>+64055:+108</label>
Aug 26 08:49:17 user nova-compute[73104]:     <imagelabel>+64055:+108</imagelabel>
Aug 26 08:49:17 user nova-compute[73104]:   </seclabel>
Aug 26 08:49:17 user nova-compute[73104]: </domain>
Aug 26 08:49:17 user nova-compute[73104]:  {{(pid=73104) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 26 08:49:17 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-cedd9450-a69c-4efe-aa50-e6e633c926e2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Successfully detached device tap84c9d528-26 from instance 55966005-e534-45d3-9bd4-cea5d54b661e from the persistent domain config.
Aug 26 08:49:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cedd9450-a69c-4efe-aa50-e6e633c926e2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] (1/8): Attempting to detach device tap84c9d528-26 with device alias net1 from instance 55966005-e534-45d3-9bd4-cea5d54b661e from the live domain config. {{(pid=73104) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 08:49:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-cedd9450-a69c-4efe-aa50-e6e633c926e2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] detach device xml: <interface type="ethernet">
Aug 26 08:49:17 user nova-compute[73104]:   <mac address="fa:16:3e:01:da:bd"/>
Aug 26 08:49:17 user nova-compute[73104]:   <model type="virtio"/>
Aug 26 08:49:17 user nova-compute[73104]:   <mtu size="1442"/>
Aug 26 08:49:17 user nova-compute[73104]:   <target dev="tap84c9d528-26"/>
Aug 26 08:49:17 user nova-compute[73104]: </interface>
Aug 26 08:49:17 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:49:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Received event <DeviceRemovedEvent: 1693039758.1527739, 55966005-e534-45d3-9bd4-cea5d54b661e => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73104) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 08:49:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cedd9450-a69c-4efe-aa50-e6e633c926e2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Start waiting for the detach event from libvirt for device tap84c9d528-26 with device alias net1 for instance 55966005-e534-45d3-9bd4-cea5d54b661e {{(pid=73104) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 08:49:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-cedd9450-a69c-4efe-aa50-e6e633c926e2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:01:da:bd"/><model type="virtio"/><mtu size="1442"/><target dev="tap84c9d528-26"/></interface> {{(pid=73104) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 08:49:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-cedd9450-a69c-4efe-aa50-e6e633c926e2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:01:da:bd"/><model type="virtio"/><mtu size="1442"/><target dev="tap84c9d528-26"/></interface>not found in domain: <domain type='kvm' id='28'>
Aug 26 08:49:18 user nova-compute[73104]:   <name>instance-00000019</name>
Aug 26 08:49:18 user nova-compute[73104]:   <uuid>55966005-e534-45d3-9bd4-cea5d54b661e</uuid>
Aug 26 08:49:18 user nova-compute[73104]:   <metadata>
Aug 26 08:49:18 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:49:18 user nova-compute[73104]:   <nova:package version="0.0.0"/>
Aug 26 08:49:18 user nova-compute[73104]:   <nova:name>tempest-device-tagging-server-829727057</nova:name>
Aug 26 08:49:18 user nova-compute[73104]:   <nova:creationTime>2023-08-26 08:48:56</nova:creationTime>
Aug 26 08:49:18 user nova-compute[73104]:   <nova:flavor name="m1.tiny">
Aug 26 08:49:18 user nova-compute[73104]:     <nova:memory>512</nova:memory>
Aug 26 08:49:18 user nova-compute[73104]:     <nova:disk>1</nova:disk>
Aug 26 08:49:18 user nova-compute[73104]:     <nova:swap>0</nova:swap>
Aug 26 08:49:18 user nova-compute[73104]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:49:18 user nova-compute[73104]:     <nova:vcpus>1</nova:vcpus>
Aug 26 08:49:18 user nova-compute[73104]:   </nova:flavor>
Aug 26 08:49:18 user nova-compute[73104]:   <nova:owner>
Aug 26 08:49:18 user nova-compute[73104]:     <nova:user uuid="a1fd1bc8d58240e89ed980aa9760cbfe">tempest-TaggedAttachmentsTest-1715069850-project-member</nova:user>
Aug 26 08:49:18 user nova-compute[73104]:     <nova:project uuid="8b8190893dbd48a083cc8dba20db0e35">tempest-TaggedAttachmentsTest-1715069850</nova:project>
Aug 26 08:49:18 user nova-compute[73104]:   </nova:owner>
Aug 26 08:49:18 user nova-compute[73104]:   <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:49:18 user nova-compute[73104]:   <nova:ports>
Aug 26 08:49:18 user nova-compute[73104]:     <nova:port uuid="b646e439-ff88-4f5b-9fa6-f9a1eac84f08">
Aug 26 08:49:18 user nova-compute[73104]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 08:49:18 user nova-compute[73104]:     </nova:port>
Aug 26 08:49:18 user nova-compute[73104]:     <nova:port uuid="84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3">
Aug 26 08:49:18 user nova-compute[73104]:       <nova:ip type="fixed" address="10.10.10.103" ipVersion="4"/>
Aug 26 08:49:18 user nova-compute[73104]:     </nova:port>
Aug 26 08:49:18 user nova-compute[73104]:   </nova:ports>
Aug 26 08:49:18 user nova-compute[73104]: </nova:instance>
Aug 26 08:49:18 user nova-compute[73104]:   </metadata>
Aug 26 08:49:18 user nova-compute[73104]:   <memory unit='KiB'>524288</memory>
Aug 26 08:49:18 user nova-compute[73104]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 26 08:49:18 user nova-compute[73104]:   <vcpu placement='static'>1</vcpu>
Aug 26 08:49:18 user nova-compute[73104]:   <resource>
Aug 26 08:49:18 user nova-compute[73104]:     <partition>/machine</partition>
Aug 26 08:49:18 user nova-compute[73104]:   </resource>
Aug 26 08:49:18 user nova-compute[73104]:   <sysinfo type='smbios'>
Aug 26 08:49:18 user nova-compute[73104]:     <system>
Aug 26 08:49:18 user nova-compute[73104]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 26 08:49:18 user nova-compute[73104]:       <entry name='product'>OpenStack Nova</entry>
Aug 26 08:49:18 user nova-compute[73104]:       <entry name='version'>0.0.0</entry>
Aug 26 08:49:18 user nova-compute[73104]:       <entry name='serial'>55966005-e534-45d3-9bd4-cea5d54b661e</entry>
Aug 26 08:49:18 user nova-compute[73104]:       <entry name='uuid'>55966005-e534-45d3-9bd4-cea5d54b661e</entry>
Aug 26 08:49:18 user nova-compute[73104]:       <entry name='family'>Virtual Machine</entry>
Aug 26 08:49:18 user nova-compute[73104]:     </system>
Aug 26 08:49:18 user nova-compute[73104]:   </sysinfo>
Aug 26 08:49:18 user nova-compute[73104]:   <os>
Aug 26 08:49:18 user nova-compute[73104]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 26 08:49:18 user nova-compute[73104]:     <boot dev='hd'/>
Aug 26 08:49:18 user nova-compute[73104]:     <smbios mode='sysinfo'/>
Aug 26 08:49:18 user nova-compute[73104]:   </os>
Aug 26 08:49:18 user nova-compute[73104]:   <features>
Aug 26 08:49:18 user nova-compute[73104]:     <acpi/>
Aug 26 08:49:18 user nova-compute[73104]:     <apic/>
Aug 26 08:49:18 user nova-compute[73104]:     <vmcoreinfo state='on'/>
Aug 26 08:49:18 user nova-compute[73104]:   </features>
Aug 26 08:49:18 user nova-compute[73104]:   <cpu mode='custom' match='exact' check='full'>
Aug 26 08:49:18 user nova-compute[73104]:     <model fallback='forbid'>Nehalem</model>
Aug 26 08:49:18 user nova-compute[73104]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 26 08:49:18 user nova-compute[73104]:     <feature policy='require' name='vme'/>
Aug 26 08:49:18 user nova-compute[73104]:     <feature policy='require' name='x2apic'/>
Aug 26 08:49:18 user nova-compute[73104]:     <feature policy='require' name='hypervisor'/>
Aug 26 08:49:18 user nova-compute[73104]:   </cpu>
Aug 26 08:49:18 user nova-compute[73104]:   <clock offset='utc'>
Aug 26 08:49:18 user nova-compute[73104]:     <timer name='pit' tickpolicy='delay'/>
Aug 26 08:49:18 user nova-compute[73104]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 26 08:49:18 user nova-compute[73104]:     <timer name='hpet' present='no'/>
Aug 26 08:49:18 user nova-compute[73104]:   </clock>
Aug 26 08:49:18 user nova-compute[73104]:   <on_poweroff>destroy</on_poweroff>
Aug 26 08:49:18 user nova-compute[73104]:   <on_reboot>restart</on_reboot>
Aug 26 08:49:18 user nova-compute[73104]:   <on_crash>destroy</on_crash>
Aug 26 08:49:18 user nova-compute[73104]:   <devices>
Aug 26 08:49:18 user nova-compute[73104]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 08:49:18 user nova-compute[73104]:     <disk type='file' device='disk'>
Aug 26 08:49:18 user nova-compute[73104]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 26 08:49:18 user nova-compute[73104]:       <source file='/opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/disk' index='2'/>
Aug 26 08:49:18 user nova-compute[73104]:       <backingStore type='file' index='3'>
Aug 26 08:49:18 user nova-compute[73104]:         <format type='raw'/>
Aug 26 08:49:18 user nova-compute[73104]:         <source file='/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5'/>
Aug 26 08:49:18 user nova-compute[73104]:         <backingStore/>
Aug 26 08:49:18 user nova-compute[73104]:       </backingStore>
Aug 26 08:49:18 user nova-compute[73104]:       <target dev='vda' bus='virtio'/>
Aug 26 08:49:18 user nova-compute[73104]:       <alias name='virtio-disk0'/>
Aug 26 08:49:18 user nova-compute[73104]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 26 08:49:18 user nova-compute[73104]:     </disk>
Aug 26 08:49:18 user nova-compute[73104]:     <disk type='file' device='cdrom'>
Aug 26 08:49:18 user nova-compute[73104]:       <driver name='qemu' type='raw' cache='none'/>
Aug 26 08:49:18 user nova-compute[73104]:       <source file='/opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/disk.config' index='1'/>
Aug 26 08:49:18 user nova-compute[73104]:       <backingStore/>
Aug 26 08:49:18 user nova-compute[73104]:       <target dev='hda' bus='ide'/>
Aug 26 08:49:18 user nova-compute[73104]:       <readonly/>
Aug 26 08:49:18 user nova-compute[73104]:       <alias name='ide0-0-0'/>
Aug 26 08:49:18 user nova-compute[73104]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 26 08:49:18 user nova-compute[73104]:     </disk>
Aug 26 08:49:18 user nova-compute[73104]:     <controller type='usb' index='0' model='none'>
Aug 26 08:49:18 user nova-compute[73104]:       <alias name='usb'/>
Aug 26 08:49:18 user nova-compute[73104]:     </controller>
Aug 26 08:49:18 user nova-compute[73104]:     <controller type='pci' index='0' model='pci-root'>
Aug 26 08:49:18 user nova-compute[73104]:       <alias name='pci.0'/>
Aug 26 08:49:18 user nova-compute[73104]:     </controller>
Aug 26 08:49:18 user nova-compute[73104]:     <controller type='ide' index='0'>
Aug 26 08:49:18 user nova-compute[73104]:       <alias name='ide'/>
Aug 26 08:49:18 user nova-compute[73104]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 26 08:49:18 user nova-compute[73104]:     </controller>
Aug 26 08:49:18 user nova-compute[73104]:     <interface type='ethernet'>
Aug 26 08:49:18 user nova-compute[73104]:       <mac address='fa:16:3e:b8:26:eb'/>
Aug 26 08:49:18 user nova-compute[73104]:       <target dev='tapb646e439-ff'/>
Aug 26 08:49:18 user nova-compute[73104]:       <model type='virtio'/>
Aug 26 08:49:18 user nova-compute[73104]:       <mtu size='1442'/>
Aug 26 08:49:18 user nova-compute[73104]:       <alias name='net0'/>
Aug 26 08:49:18 user nova-compute[73104]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 26 08:49:18 user nova-compute[73104]:     </interface>
Aug 26 08:49:18 user nova-compute[73104]:     <serial type='pty'>
Aug 26 08:49:18 user nova-compute[73104]:       <source path='/dev/pts/2'/>
Aug 26 08:49:18 user nova-compute[73104]:       <log file='/opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/console.log' append='off'/>
Aug 26 08:49:18 user nova-compute[73104]:       <target type='isa-serial' port='0'>
Aug 26 08:49:18 user nova-compute[73104]:         <model name='isa-serial'/>
Aug 26 08:49:18 user nova-compute[73104]:       </target>
Aug 26 08:49:18 user nova-compute[73104]:       <alias name='serial0'/>
Aug 26 08:49:18 user nova-compute[73104]:     </serial>
Aug 26 08:49:18 user nova-compute[73104]:     <console type='pty' tty='/dev/pts/2'>
Aug 26 08:49:18 user nova-compute[73104]:       <source path='/dev/pts/2'/>
Aug 26 08:49:18 user nova-compute[73104]:       <log file='/opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/console.log' append='off'/>
Aug 26 08:49:18 user nova-compute[73104]:       <target type='serial' port='0'/>
Aug 26 08:49:18 user nova-compute[73104]:       <alias name='serial0'/>
Aug 26 08:49:18 user nova-compute[73104]:     </console>
Aug 26 08:49:18 user nova-compute[73104]:     <input type='mouse' bus='ps2'>
Aug 26 08:49:18 user nova-compute[73104]:       <alias name='input0'/>
Aug 26 08:49:18 user nova-compute[73104]:     </input>
Aug 26 08:49:18 user nova-compute[73104]:     <input type='keyboard' bus='ps2'>
Aug 26 08:49:18 user nova-compute[73104]:       <alias name='input1'/>
Aug 26 08:49:18 user nova-compute[73104]:     </input>
Aug 26 08:49:18 user nova-compute[73104]:     <graphics type='vnc' port='5902' autoport='yes' listen='0.0.0.0'>
Aug 26 08:49:18 user nova-compute[73104]:       <listen type='address' address='0.0.0.0'/>
Aug 26 08:49:18 user nova-compute[73104]:     </graphics>
Aug 26 08:49:18 user nova-compute[73104]:     <audio id='1' type='none'/>
Aug 26 08:49:18 user nova-compute[73104]:     <video>
Aug 26 08:49:18 user nova-compute[73104]:       <model type='virtio' heads='1' primary='yes'/>
Aug 26 08:49:18 user nova-compute[73104]:       <alias name='video0'/>
Aug 26 08:49:18 user nova-compute[73104]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 26 08:49:18 user nova-compute[73104]:     </video>
Aug 26 08:49:18 user nova-compute[73104]:     <memballoon model='virtio'>
Aug 26 08:49:18 user nova-compute[73104]:       <stats period='10'/>
Aug 26 08:49:18 user nova-compute[73104]:       <alias name='balloon0'/>
Aug 26 08:49:18 user nova-compute[73104]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 26 08:49:18 user nova-compute[73104]:     </memballoon>
Aug 26 08:49:18 user nova-compute[73104]:     <rng model='virtio'>
Aug 26 08:49:18 user nova-compute[73104]:       <backend model='random'>/dev/urandom</backend>
Aug 26 08:49:18 user nova-compute[73104]:       <alias name='rng0'/>
Aug 26 08:49:18 user nova-compute[73104]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 26 08:49:18 user nova-compute[73104]:     </rng>
Aug 26 08:49:18 user nova-compute[73104]:   </devices>
Aug 26 08:49:18 user nova-compute[73104]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 26 08:49:18 user nova-compute[73104]:     <label>libvirt-55966005-e534-45d3-9bd4-cea5d54b661e</label>
Aug 26 08:49:18 user nova-compute[73104]:     <imagelabel>libvirt-55966005-e534-45d3-9bd4-cea5d54b661e</imagelabel>
Aug 26 08:49:18 user nova-compute[73104]:   </seclabel>
Aug 26 08:49:18 user nova-compute[73104]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 26 08:49:18 user nova-compute[73104]:     <label>+64055:+108</label>
Aug 26 08:49:18 user nova-compute[73104]:     <imagelabel>+64055:+108</imagelabel>
Aug 26 08:49:18 user nova-compute[73104]:   </seclabel>
Aug 26 08:49:18 user nova-compute[73104]: </domain>
Aug 26 08:49:18 user nova-compute[73104]:  {{(pid=73104) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 26 08:49:18 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-cedd9450-a69c-4efe-aa50-e6e633c926e2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Successfully detached device tap84c9d528-26 from instance 55966005-e534-45d3-9bd4-cea5d54b661e from the live domain config.
Aug 26 08:49:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-cedd9450-a69c-4efe-aa50-e6e633c926e2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-829727057',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-829727057',id=25,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPrtw2uPRe9G8zyYK3ARIY3AfX0RzLppVCcvlKoAgXZOG4qTaMTx2cx9wO1C4CoqjxJ4W8gRg9Ex00VbBz9tkcQ5fjhSqrrzBpVdl1qo6UlzDiYX6hf0JXW1ZaomcLxiQ==',key_name='tempest-keypair-1580684820',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:47:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b8190893dbd48a083cc8dba20db0e35',ramdisk_id='',reservation_id='r-kl6196e4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1715069850',owner_user_name='tempest-TaggedAttachmentsTest-1715069850-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:47:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1fd1bc8d58240e89ed980aa9760cbfe',uuid=55966005-e534-45d3-9bd4-cea5d54b661e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3", "address": "fa:16:3e:01:da:bd", "network": {"id": "00ba0bd2-fa5c-432e-b569-f345ad827158", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-447437431", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8b8190893dbd48a083cc8dba20db0e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c9d528-26", "ovs_interfaceid": "84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:49:18 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-cedd9450-a69c-4efe-aa50-e6e633c926e2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Converting VIF {"id": "84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3", "address": "fa:16:3e:01:da:bd", "network": {"id": "00ba0bd2-fa5c-432e-b569-f345ad827158", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-447437431", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8b8190893dbd48a083cc8dba20db0e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c9d528-26", "ovs_interfaceid": "84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:49:18 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-cedd9450-a69c-4efe-aa50-e6e633c926e2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:da:bd,bridge_name='br-int',has_traffic_filtering=True,id=84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3,network=Network(00ba0bd2-fa5c-432e-b569-f345ad827158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c9d528-26') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:49:18 user nova-compute[73104]: DEBUG os_vif [None req-cedd9450-a69c-4efe-aa50-e6e633c926e2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:da:bd,bridge_name='br-int',has_traffic_filtering=True,id=84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3,network=Network(00ba0bd2-fa5c-432e-b569-f345ad827158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c9d528-26') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:49:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84c9d528-26, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:49:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:49:18 user nova-compute[73104]: INFO os_vif [None req-cedd9450-a69c-4efe-aa50-e6e633c926e2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:da:bd,bridge_name='br-int',has_traffic_filtering=True,id=84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3,network=Network(00ba0bd2-fa5c-432e-b569-f345ad827158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c9d528-26')
Aug 26 08:49:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-cedd9450-a69c-4efe-aa50-e6e633c926e2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:49:18 user nova-compute[73104]:   <nova:package version="0.0.0"/>
Aug 26 08:49:18 user nova-compute[73104]:   <nova:name>tempest-device-tagging-server-829727057</nova:name>
Aug 26 08:49:18 user nova-compute[73104]:   <nova:creationTime>2023-08-26 08:49:18</nova:creationTime>
Aug 26 08:49:18 user nova-compute[73104]:   <nova:flavor name="m1.tiny">
Aug 26 08:49:18 user nova-compute[73104]:     <nova:memory>512</nova:memory>
Aug 26 08:49:18 user nova-compute[73104]:     <nova:disk>1</nova:disk>
Aug 26 08:49:18 user nova-compute[73104]:     <nova:swap>0</nova:swap>
Aug 26 08:49:18 user nova-compute[73104]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:49:18 user nova-compute[73104]:     <nova:vcpus>1</nova:vcpus>
Aug 26 08:49:18 user nova-compute[73104]:   </nova:flavor>
Aug 26 08:49:18 user nova-compute[73104]:   <nova:owner>
Aug 26 08:49:18 user nova-compute[73104]:     <nova:user uuid="a1fd1bc8d58240e89ed980aa9760cbfe">tempest-TaggedAttachmentsTest-1715069850-project-member</nova:user>
Aug 26 08:49:18 user nova-compute[73104]:     <nova:project uuid="8b8190893dbd48a083cc8dba20db0e35">tempest-TaggedAttachmentsTest-1715069850</nova:project>
Aug 26 08:49:18 user nova-compute[73104]:   </nova:owner>
Aug 26 08:49:18 user nova-compute[73104]:   <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:49:18 user nova-compute[73104]:   <nova:ports>
Aug 26 08:49:18 user nova-compute[73104]:     <nova:port uuid="b646e439-ff88-4f5b-9fa6-f9a1eac84f08">
Aug 26 08:49:18 user nova-compute[73104]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 08:49:18 user nova-compute[73104]:     </nova:port>
Aug 26 08:49:18 user nova-compute[73104]:   </nova:ports>
Aug 26 08:49:18 user nova-compute[73104]: </nova:instance>
Aug 26 08:49:18 user nova-compute[73104]:  {{(pid=73104) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 26 08:49:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:18 user nova-compute[73104]: DEBUG nova.compute.manager [req-e445aceb-d25c-4209-8bdf-7411d6c6ec2c req-c3599bea-83c2-48dc-9855-e6869a4d6cf7 service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Received event network-vif-unplugged-84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:49:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e445aceb-d25c-4209-8bdf-7411d6c6ec2c req-c3599bea-83c2-48dc-9855-e6869a4d6cf7 service nova] Acquiring lock "55966005-e534-45d3-9bd4-cea5d54b661e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:49:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e445aceb-d25c-4209-8bdf-7411d6c6ec2c req-c3599bea-83c2-48dc-9855-e6869a4d6cf7 service nova] Lock "55966005-e534-45d3-9bd4-cea5d54b661e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:49:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e445aceb-d25c-4209-8bdf-7411d6c6ec2c req-c3599bea-83c2-48dc-9855-e6869a4d6cf7 service nova] Lock "55966005-e534-45d3-9bd4-cea5d54b661e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:49:18 user nova-compute[73104]: DEBUG nova.compute.manager [req-e445aceb-d25c-4209-8bdf-7411d6c6ec2c req-c3599bea-83c2-48dc-9855-e6869a4d6cf7 service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] No waiting events found dispatching network-vif-unplugged-84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:49:18 user nova-compute[73104]: WARNING nova.compute.manager [req-e445aceb-d25c-4209-8bdf-7411d6c6ec2c req-c3599bea-83c2-48dc-9855-e6869a4d6cf7 service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Received unexpected event network-vif-unplugged-84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3 for instance with vm_state active and task_state None.
Aug 26 08:49:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cedd9450-a69c-4efe-aa50-e6e633c926e2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Acquiring lock "refresh_cache-55966005-e534-45d3-9bd4-cea5d54b661e" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:49:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cedd9450-a69c-4efe-aa50-e6e633c926e2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Acquired lock "refresh_cache-55966005-e534-45d3-9bd4-cea5d54b661e" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:49:19 user nova-compute[73104]: DEBUG nova.network.neutron [None req-cedd9450-a69c-4efe-aa50-e6e633c926e2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:49:20 user nova-compute[73104]: INFO nova.network.neutron [None req-cedd9450-a69c-4efe-aa50-e6e633c926e2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Port 84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 26 08:49:20 user nova-compute[73104]: DEBUG nova.network.neutron [None req-cedd9450-a69c-4efe-aa50-e6e633c926e2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Updating instance_info_cache with network_info: [{"id": "b646e439-ff88-4f5b-9fa6-f9a1eac84f08", "address": "fa:16:3e:b8:26:eb", "network": {"id": "edbebe23-8fc4-4a39-b4e8-d32d00d25c7f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2016586720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8190893dbd48a083cc8dba20db0e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb646e439-ff", "ovs_interfaceid": "b646e439-ff88-4f5b-9fa6-f9a1eac84f08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:49:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cedd9450-a69c-4efe-aa50-e6e633c926e2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Releasing lock "refresh_cache-55966005-e534-45d3-9bd4-cea5d54b661e" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:49:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cedd9450-a69c-4efe-aa50-e6e633c926e2 tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lock "interface-55966005-e534-45d3-9bd4-cea5d54b661e-84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.682s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:49:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:21 user nova-compute[73104]: DEBUG nova.compute.manager [req-6c62e646-2b17-4d3a-92e5-d5245c0af8a7 req-afbdf530-0300-4bfa-bfca-c15d2632d5c3 service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Received event network-vif-deleted-84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:49:21 user nova-compute[73104]: DEBUG nova.compute.manager [req-6c62e646-2b17-4d3a-92e5-d5245c0af8a7 req-afbdf530-0300-4bfa-bfca-c15d2632d5c3 service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Received event network-vif-plugged-84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:49:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6c62e646-2b17-4d3a-92e5-d5245c0af8a7 req-afbdf530-0300-4bfa-bfca-c15d2632d5c3 service nova] Acquiring lock "55966005-e534-45d3-9bd4-cea5d54b661e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:49:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6c62e646-2b17-4d3a-92e5-d5245c0af8a7 req-afbdf530-0300-4bfa-bfca-c15d2632d5c3 service nova] Lock "55966005-e534-45d3-9bd4-cea5d54b661e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:49:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6c62e646-2b17-4d3a-92e5-d5245c0af8a7 req-afbdf530-0300-4bfa-bfca-c15d2632d5c3 service nova] Lock "55966005-e534-45d3-9bd4-cea5d54b661e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:49:21 user nova-compute[73104]: DEBUG nova.compute.manager [req-6c62e646-2b17-4d3a-92e5-d5245c0af8a7 req-afbdf530-0300-4bfa-bfca-c15d2632d5c3 service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] No waiting events found dispatching network-vif-plugged-84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:49:21 user nova-compute[73104]: WARNING nova.compute.manager [req-6c62e646-2b17-4d3a-92e5-d5245c0af8a7 req-afbdf530-0300-4bfa-bfca-c15d2632d5c3 service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Received unexpected event network-vif-plugged-84c9d528-2610-4bc3-aab7-ce3f8dfa9ea3 for instance with vm_state active and task_state None.
Aug 26 08:49:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:26 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:49:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:49:42 user nova-compute[73104]: DEBUG nova.compute.manager [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:49:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:49:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:49:42 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:49:42 user nova-compute[73104]: INFO nova.compute.claims [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Claim successful on node user
Aug 26 08:49:42 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:49:42 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:49:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:49:42 user nova-compute[73104]: DEBUG nova.compute.manager [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:49:42 user nova-compute[73104]: DEBUG nova.compute.manager [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:49:42 user nova-compute[73104]: DEBUG nova.network.neutron [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:49:42 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:49:42 user nova-compute[73104]: DEBUG nova.compute.manager [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:49:43 user nova-compute[73104]: DEBUG nova.policy [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6fd47a4b6ae846a79a378d6ed543fd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718e3cb41d5342069cd73b96bade97e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:49:43 user nova-compute[73104]: DEBUG nova.compute.manager [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:49:43 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:49:43 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Creating image(s)
Aug 26 08:49:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "/opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:49:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "/opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:49:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "/opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:49:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "44cb1fa5c00d8d1d4cd98702e1537f28f822a859" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:49:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "44cb1fa5c00d8d1d4cd98702e1537f28f822a859" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:49:43 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44cb1fa5c00d8d1d4cd98702e1537f28f822a859.part --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:43 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44cb1fa5c00d8d1d4cd98702e1537f28f822a859.part --force-share --output=json" returned: 0 in 0.199s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:43 user nova-compute[73104]: DEBUG nova.virt.images [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] caf1cead-10a3-4849-8ac8-41228db7483f was qcow2, converting to raw {{(pid=73104) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 08:49:43 user nova-compute[73104]: DEBUG nova.privsep.utils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73104) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 08:49:43 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/44cb1fa5c00d8d1d4cd98702e1537f28f822a859.part /opt/stack/data/nova/instances/_base/44cb1fa5c00d8d1d4cd98702e1537f28f822a859.converted {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:43 user nova-compute[73104]: DEBUG nova.network.neutron [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Successfully created port: a2c66a9f-398a-4f45-a821-5105e68bb4f4 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:49:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/44cb1fa5c00d8d1d4cd98702e1537f28f822a859.part /opt/stack/data/nova/instances/_base/44cb1fa5c00d8d1d4cd98702e1537f28f822a859.converted" returned: 0 in 0.299s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44cb1fa5c00d8d1d4cd98702e1537f28f822a859.converted --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44cb1fa5c00d8d1d4cd98702e1537f28f822a859.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "44cb1fa5c00d8d1d4cd98702e1537f28f822a859" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.164s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:49:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44cb1fa5c00d8d1d4cd98702e1537f28f822a859 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44cb1fa5c00d8d1d4cd98702e1537f28f822a859 --force-share --output=json" returned: 0 in 0.190s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "44cb1fa5c00d8d1d4cd98702e1537f28f822a859" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:49:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "44cb1fa5c00d8d1d4cd98702e1537f28f822a859" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:49:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44cb1fa5c00d8d1d4cd98702e1537f28f822a859 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:44 user nova-compute[73104]: DEBUG nova.network.neutron [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Successfully updated port: a2c66a9f-398a-4f45-a821-5105e68bb4f4 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:49:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "refresh_cache-e7ac6a94-05a2-4b11-a541-26b1d1dae070" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:49:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquired lock "refresh_cache-e7ac6a94-05a2-4b11-a541-26b1d1dae070" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:49:44 user nova-compute[73104]: DEBUG nova.network.neutron [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:49:44 user nova-compute[73104]: DEBUG nova.compute.manager [req-ae2e2af8-efbf-4455-bd3a-9777ebcc4f3d req-ae1a5919-b823-4326-8622-cb61afbb30a0 service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Received event network-changed-a2c66a9f-398a-4f45-a821-5105e68bb4f4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:49:44 user nova-compute[73104]: DEBUG nova.compute.manager [req-ae2e2af8-efbf-4455-bd3a-9777ebcc4f3d req-ae1a5919-b823-4326-8622-cb61afbb30a0 service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Refreshing instance network info cache due to event network-changed-a2c66a9f-398a-4f45-a821-5105e68bb4f4. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:49:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ae2e2af8-efbf-4455-bd3a-9777ebcc4f3d req-ae1a5919-b823-4326-8622-cb61afbb30a0 service nova] Acquiring lock "refresh_cache-e7ac6a94-05a2-4b11-a541-26b1d1dae070" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:49:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44cb1fa5c00d8d1d4cd98702e1537f28f822a859 --force-share --output=json" returned: 0 in 0.179s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44cb1fa5c00d8d1d4cd98702e1537f28f822a859,backing_fmt=raw /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:44 user nova-compute[73104]: DEBUG nova.network.neutron [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:49:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44cb1fa5c00d8d1d4cd98702e1537f28f822a859,backing_fmt=raw /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk 1073741824" returned: 0 in 0.049s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "44cb1fa5c00d8d1d4cd98702e1537f28f822a859" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:49:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44cb1fa5c00d8d1d4cd98702e1537f28f822a859 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44cb1fa5c00d8d1d4cd98702e1537f28f822a859 --force-share --output=json" returned: 0 in 0.184s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:44 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 08:49:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.network.neutron [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Updating instance_info_cache with network_info: [{"id": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "address": "fa:16:3e:12:ae:4a", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c66a9f-39", "ovs_interfaceid": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Releasing lock "refresh_cache-e7ac6a94-05a2-4b11-a541-26b1d1dae070" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.compute.manager [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Instance network_info: |[{"id": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "address": "fa:16:3e:12:ae:4a", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c66a9f-39", "ovs_interfaceid": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ae2e2af8-efbf-4455-bd3a-9777ebcc4f3d req-ae1a5919-b823-4326-8622-cb61afbb30a0 service nova] Acquired lock "refresh_cache-e7ac6a94-05a2-4b11-a541-26b1d1dae070" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.network.neutron [req-ae2e2af8-efbf-4455-bd3a-9777ebcc4f3d req-ae1a5919-b823-4326-8622-cb61afbb30a0 service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Refreshing network info cache for port a2c66a9f-398a-4f45-a821-5105e68bb4f4 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Cannot resize image /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Ensure instance console log exists: /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Start _get_guest_xml network_info=[{"id": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "address": "fa:16:3e:12:ae:4a", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c66a9f-39", "ovs_interfaceid": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:49:39Z,direct_url=<?>,disk_format='qcow2',id=caf1cead-10a3-4849-8ac8-41228db7483f,min_disk=0,min_ram=0,name='tempest-scenario-img--89861645',owner='718e3cb41d5342069cd73b96bade97e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:49:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'caf1cead-10a3-4849-8ac8-41228db7483f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:49:45 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:49:45 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:49:39Z,direct_url=<?>,disk_format='qcow2',id=caf1cead-10a3-4849-8ac8-41228db7483f,min_disk=0,min_ram=0,name='tempest-scenario-img--89861645',owner='718e3cb41d5342069cd73b96bade97e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:49:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:49:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2138351221',display_name='tempest-TestMinimumBasicScenario-server-2138351221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2138351221',id=27,image_ref='caf1cead-10a3-4849-8ac8-41228db7483f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDf00vmyBYw2P7QhlbDbc1fxtWuQ5FRLimltxpKURXRzn5zjIkyr4ORgtHBY8o9wAiBvVJ9BzrGsFCqEeA1uJ71YqknXVzsYW5BkhDEkS/bhJees5zknqzrUGDIQpFutQ==',key_name='tempest-TestMinimumBasicScenario-523425789',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='718e3cb41d5342069cd73b96bade97e7',ramdisk_id='',reservation_id='r-ceg6sez0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='caf1cead-10a3-4849-8ac8-41228db7483f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1112860810',owner_user_name='tempest-TestMinimumBasicScenario-1112860810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:49:43Z,user_data=None,user_id='6fd47a4b6ae846a79a378d6ed543fd1c',uuid=e7ac6a94-05a2-4b11-a541-26b1d1dae070,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "address": "fa:16:3e:12:ae:4a", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c66a9f-39", "ovs_interfaceid": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Converting VIF {"id": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "address": "fa:16:3e:12:ae:4a", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c66a9f-39", "ovs_interfaceid": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:ae:4a,bridge_name='br-int',has_traffic_filtering=True,id=a2c66a9f-398a-4f45-a821-5105e68bb4f4,network=Network(85684c43-d34e-47e3-a067-9c4fb1520baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2c66a9f-39') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.objects.instance [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lazy-loading 'pci_devices' on Instance uuid e7ac6a94-05a2-4b11-a541-26b1d1dae070 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:49:45 user nova-compute[73104]:   <uuid>e7ac6a94-05a2-4b11-a541-26b1d1dae070</uuid>
Aug 26 08:49:45 user nova-compute[73104]:   <name>instance-0000001b</name>
Aug 26 08:49:45 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:49:45 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:49:45 user nova-compute[73104]:   <metadata>
Aug 26 08:49:45 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:49:45 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:49:45 user nova-compute[73104]:       <nova:name>tempest-TestMinimumBasicScenario-server-2138351221</nova:name>
Aug 26 08:49:45 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:49:45</nova:creationTime>
Aug 26 08:49:45 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:49:45 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:49:45 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:49:45 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:49:45 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:49:45 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:49:45 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:49:45 user nova-compute[73104]:       <nova:owner>
Aug 26 08:49:45 user nova-compute[73104]:         <nova:user uuid="6fd47a4b6ae846a79a378d6ed543fd1c">tempest-TestMinimumBasicScenario-1112860810-project-member</nova:user>
Aug 26 08:49:45 user nova-compute[73104]:         <nova:project uuid="718e3cb41d5342069cd73b96bade97e7">tempest-TestMinimumBasicScenario-1112860810</nova:project>
Aug 26 08:49:45 user nova-compute[73104]:       </nova:owner>
Aug 26 08:49:45 user nova-compute[73104]:       <nova:root type="image" uuid="caf1cead-10a3-4849-8ac8-41228db7483f"/>
Aug 26 08:49:45 user nova-compute[73104]:       <nova:ports>
Aug 26 08:49:45 user nova-compute[73104]:         <nova:port uuid="a2c66a9f-398a-4f45-a821-5105e68bb4f4">
Aug 26 08:49:45 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 08:49:45 user nova-compute[73104]:         </nova:port>
Aug 26 08:49:45 user nova-compute[73104]:       </nova:ports>
Aug 26 08:49:45 user nova-compute[73104]:     </nova:instance>
Aug 26 08:49:45 user nova-compute[73104]:   </metadata>
Aug 26 08:49:45 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:49:45 user nova-compute[73104]:     <system>
Aug 26 08:49:45 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:49:45 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:49:45 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:49:45 user nova-compute[73104]:       <entry name="serial">e7ac6a94-05a2-4b11-a541-26b1d1dae070</entry>
Aug 26 08:49:45 user nova-compute[73104]:       <entry name="uuid">e7ac6a94-05a2-4b11-a541-26b1d1dae070</entry>
Aug 26 08:49:45 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:49:45 user nova-compute[73104]:     </system>
Aug 26 08:49:45 user nova-compute[73104]:   </sysinfo>
Aug 26 08:49:45 user nova-compute[73104]:   <os>
Aug 26 08:49:45 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:49:45 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:49:45 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:49:45 user nova-compute[73104]:   </os>
Aug 26 08:49:45 user nova-compute[73104]:   <features>
Aug 26 08:49:45 user nova-compute[73104]:     <acpi/>
Aug 26 08:49:45 user nova-compute[73104]:     <apic/>
Aug 26 08:49:45 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:49:45 user nova-compute[73104]:   </features>
Aug 26 08:49:45 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:49:45 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:49:45 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:49:45 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:49:45 user nova-compute[73104]:   </clock>
Aug 26 08:49:45 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:49:45 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:49:45 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:49:45 user nova-compute[73104]:   </cpu>
Aug 26 08:49:45 user nova-compute[73104]:   <devices>
Aug 26 08:49:45 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:49:45 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:49:45 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk"/>
Aug 26 08:49:45 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:49:45 user nova-compute[73104]:     </disk>
Aug 26 08:49:45 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:49:45 user nova-compute[73104]:       <mac address="fa:16:3e:12:ae:4a"/>
Aug 26 08:49:45 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:49:45 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:49:45 user nova-compute[73104]:       <target dev="tapa2c66a9f-39"/>
Aug 26 08:49:45 user nova-compute[73104]:     </interface>
Aug 26 08:49:45 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:49:45 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/console.log" append="off"/>
Aug 26 08:49:45 user nova-compute[73104]:     </serial>
Aug 26 08:49:45 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:49:45 user nova-compute[73104]:     <video>
Aug 26 08:49:45 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:49:45 user nova-compute[73104]:     </video>
Aug 26 08:49:45 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:49:45 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:49:45 user nova-compute[73104]:     </rng>
Aug 26 08:49:45 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:49:45 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:49:45 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:49:45 user nova-compute[73104]:     </memballoon>
Aug 26 08:49:45 user nova-compute[73104]:   </devices>
Aug 26 08:49:45 user nova-compute[73104]: </domain>
Aug 26 08:49:45 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:49:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2138351221',display_name='tempest-TestMinimumBasicScenario-server-2138351221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2138351221',id=27,image_ref='caf1cead-10a3-4849-8ac8-41228db7483f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDf00vmyBYw2P7QhlbDbc1fxtWuQ5FRLimltxpKURXRzn5zjIkyr4ORgtHBY8o9wAiBvVJ9BzrGsFCqEeA1uJ71YqknXVzsYW5BkhDEkS/bhJees5zknqzrUGDIQpFutQ==',key_name='tempest-TestMinimumBasicScenario-523425789',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='718e3cb41d5342069cd73b96bade97e7',ramdisk_id='',reservation_id='r-ceg6sez0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='caf1cead-10a3-4849-8ac8-41228db7483f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1112860810',owner_user_name='tempest-TestMinimumBasicScenario-1112860810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:49:43Z,user_data=None,user_id='6fd47a4b6ae846a79a378d6ed543fd1c',uuid=e7ac6a94-05a2-4b11-a541-26b1d1dae070,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "address": "fa:16:3e:12:ae:4a", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c66a9f-39", "ovs_interfaceid": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Converting VIF {"id": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "address": "fa:16:3e:12:ae:4a", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c66a9f-39", "ovs_interfaceid": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:ae:4a,bridge_name='br-int',has_traffic_filtering=True,id=a2c66a9f-398a-4f45-a821-5105e68bb4f4,network=Network(85684c43-d34e-47e3-a067-9c4fb1520baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2c66a9f-39') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG os_vif [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:ae:4a,bridge_name='br-int',has_traffic_filtering=True,id=a2c66a9f-398a-4f45-a821-5105e68bb4f4,network=Network(85684c43-d34e-47e3-a067-9c4fb1520baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2c66a9f-39') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2c66a9f-39, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa2c66a9f-39, col_values=(('external_ids', {'iface-id': 'a2c66a9f-398a-4f45-a821-5105e68bb4f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:ae:4a', 'vm-uuid': 'e7ac6a94-05a2-4b11-a541-26b1d1dae070'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:45 user nova-compute[73104]: INFO os_vif [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:ae:4a,bridge_name='br-int',has_traffic_filtering=True,id=a2c66a9f-398a-4f45-a821-5105e68bb4f4,network=Network(85684c43-d34e-47e3-a067-9c4fb1520baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2c66a9f-39')
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] No VIF found with MAC fa:16:3e:12:ae:4a, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.network.neutron [req-ae2e2af8-efbf-4455-bd3a-9777ebcc4f3d req-ae1a5919-b823-4326-8622-cb61afbb30a0 service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Updated VIF entry in instance network info cache for port a2c66a9f-398a-4f45-a821-5105e68bb4f4. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG nova.network.neutron [req-ae2e2af8-efbf-4455-bd3a-9777ebcc4f3d req-ae1a5919-b823-4326-8622-cb61afbb30a0 service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Updating instance_info_cache with network_info: [{"id": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "address": "fa:16:3e:12:ae:4a", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c66a9f-39", "ovs_interfaceid": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:49:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ae2e2af8-efbf-4455-bd3a-9777ebcc4f3d req-ae1a5919-b823-4326-8622-cb61afbb30a0 service nova] Releasing lock "refresh_cache-e7ac6a94-05a2-4b11-a541-26b1d1dae070" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:49:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:46 user nova-compute[73104]: DEBUG nova.compute.manager [req-3ce5d4eb-1460-4473-8650-339bdc5400cc req-a2797760-0984-4dfc-930c-c82a6d6062f1 service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Received event network-vif-plugged-a2c66a9f-398a-4f45-a821-5105e68bb4f4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:49:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3ce5d4eb-1460-4473-8650-339bdc5400cc req-a2797760-0984-4dfc-930c-c82a6d6062f1 service nova] Acquiring lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:49:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3ce5d4eb-1460-4473-8650-339bdc5400cc req-a2797760-0984-4dfc-930c-c82a6d6062f1 service nova] Lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:49:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3ce5d4eb-1460-4473-8650-339bdc5400cc req-a2797760-0984-4dfc-930c-c82a6d6062f1 service nova] Lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:49:46 user nova-compute[73104]: DEBUG nova.compute.manager [req-3ce5d4eb-1460-4473-8650-339bdc5400cc req-a2797760-0984-4dfc-930c-c82a6d6062f1 service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] No waiting events found dispatching network-vif-plugged-a2c66a9f-398a-4f45-a821-5105e68bb4f4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:49:46 user nova-compute[73104]: WARNING nova.compute.manager [req-3ce5d4eb-1460-4473-8650-339bdc5400cc req-a2797760-0984-4dfc-930c-c82a6d6062f1 service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Received unexpected event network-vif-plugged-a2c66a9f-398a-4f45-a821-5105e68bb4f4 for instance with vm_state building and task_state spawning.
Aug 26 08:49:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:48 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039788.6788728, e7ac6a94-05a2-4b11-a541-26b1d1dae070 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:49:48 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] VM Resumed (Lifecycle Event)
Aug 26 08:49:48 user nova-compute[73104]: DEBUG nova.compute.manager [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:49:48 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:49:48 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Instance spawned successfully.
Aug 26 08:49:48 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:49:48 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:49:48 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:49:48 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:49:48 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:49:48 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:49:48 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:49:48 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:49:48 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:49:48 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:49:48 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039788.6804388, e7ac6a94-05a2-4b11-a541-26b1d1dae070 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:49:48 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] VM Started (Lifecycle Event)
Aug 26 08:49:48 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:49:48 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:49:48 user nova-compute[73104]: INFO nova.compute.manager [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Took 5.70 seconds to spawn the instance on the hypervisor.
Aug 26 08:49:48 user nova-compute[73104]: DEBUG nova.compute.manager [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:49:48 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:49:48 user nova-compute[73104]: DEBUG nova.compute.manager [req-f7e3d220-3e2f-40e9-9045-2655af7c25c8 req-627bef7e-1710-4a74-a368-10aa2dde660c service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Received event network-vif-plugged-a2c66a9f-398a-4f45-a821-5105e68bb4f4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:49:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f7e3d220-3e2f-40e9-9045-2655af7c25c8 req-627bef7e-1710-4a74-a368-10aa2dde660c service nova] Acquiring lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:49:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f7e3d220-3e2f-40e9-9045-2655af7c25c8 req-627bef7e-1710-4a74-a368-10aa2dde660c service nova] Lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:49:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f7e3d220-3e2f-40e9-9045-2655af7c25c8 req-627bef7e-1710-4a74-a368-10aa2dde660c service nova] Lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:49:48 user nova-compute[73104]: DEBUG nova.compute.manager [req-f7e3d220-3e2f-40e9-9045-2655af7c25c8 req-627bef7e-1710-4a74-a368-10aa2dde660c service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] No waiting events found dispatching network-vif-plugged-a2c66a9f-398a-4f45-a821-5105e68bb4f4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:49:48 user nova-compute[73104]: WARNING nova.compute.manager [req-f7e3d220-3e2f-40e9-9045-2655af7c25c8 req-627bef7e-1710-4a74-a368-10aa2dde660c service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Received unexpected event network-vif-plugged-a2c66a9f-398a-4f45-a821-5105e68bb4f4 for instance with vm_state building and task_state spawning.
Aug 26 08:49:48 user nova-compute[73104]: INFO nova.compute.manager [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Took 6.56 seconds to build instance.
Aug 26 08:49:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d7b58b3a-0bdd-45c0-9e1c-3b8ebffc5ea1 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.663s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:49:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:50 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:53 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:49:53 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:49:53 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:49:53 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 08:49:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:54 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:49:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:55 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:49:55 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:49:55 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:49:55 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:49:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:49:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:49:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:49:55 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 08:49:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:55 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:49:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef1e493-6b2c-4688-98c2-647261feb571/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef1e493-6b2c-4688-98c2-647261feb571/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef1e493-6b2c-4688-98c2-647261feb571/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef1e493-6b2c-4688-98c2-647261feb571/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:57 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:49:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ddeefec-ed4f-4fec-8d1c-02a2ddf65023/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ddeefec-ed4f-4fec-8d1c-02a2ddf65023/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ddeefec-ed4f-4fec-8d1c-02a2ddf65023/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ddeefec-ed4f-4fec-8d1c-02a2ddf65023/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:59 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:49:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:49:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:49:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk.rescue --force-share --output=json" returned: 0 in 0.225s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:49:59 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:49:59 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:49:59 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=7508MB free_disk=24.052230834960938GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 08:49:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:49:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:50:00 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance b5e1f82c-5675-4c37-8ba2-44e6a341a576 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:50:00 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 3cf85d2f-de0d-4e9b-a534-98c799ae8db9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:50:00 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 02665c70-cf75-44ba-9d90-eb9e5f12e0b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:50:00 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance b7f6e347-c1f3-4f56-86c4-3b28c4729964 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:50:00 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance bef1e493-6b2c-4688-98c2-647261feb571 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:50:00 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 55966005-e534-45d3-9bd4-cea5d54b661e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:50:00 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:50:00 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance c3b4c644-f7f3-4304-b732-9f43cfeac2bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:50:00 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance e7ac6a94-05a2-4b11-a541-26b1d1dae070 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:50:00 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 08:50:00 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 08:50:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:00 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:50:00 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:50:00 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 08:50:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.489s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:50:01 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:50:01 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 08:50:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-b7f6e347-c1f3-4f56-86c4-3b28c4729964" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:50:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-b7f6e347-c1f3-4f56-86c4-3b28c4729964" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:50:01 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 08:50:02 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Updating instance_info_cache with network_info: [{"id": "68e8044e-0d86-4309-938c-f00d2c392440", "address": "fa:16:3e:8e:1c:6e", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68e8044e-0d", "ovs_interfaceid": "68e8044e-0d86-4309-938c-f00d2c392440", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:50:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-b7f6e347-c1f3-4f56-86c4-3b28c4729964" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:50:02 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 08:50:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:50:07 user nova-compute[73104]: DEBUG nova.compute.manager [req-daeb0cc6-af5b-4bc7-9185-b7b2896a3dc1 req-3cce54a1-4cc3-4906-ad26-62e90a83544b service nova] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Received event network-changed-06ff3140-31c9-478c-9d4e-c2a4ee346df4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:50:07 user nova-compute[73104]: DEBUG nova.compute.manager [req-daeb0cc6-af5b-4bc7-9185-b7b2896a3dc1 req-3cce54a1-4cc3-4906-ad26-62e90a83544b service nova] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Refreshing instance network info cache due to event network-changed-06ff3140-31c9-478c-9d4e-c2a4ee346df4. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:50:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-daeb0cc6-af5b-4bc7-9185-b7b2896a3dc1 req-3cce54a1-4cc3-4906-ad26-62e90a83544b service nova] Acquiring lock "refresh_cache-5ddeefec-ed4f-4fec-8d1c-02a2ddf65023" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:50:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-daeb0cc6-af5b-4bc7-9185-b7b2896a3dc1 req-3cce54a1-4cc3-4906-ad26-62e90a83544b service nova] Acquired lock "refresh_cache-5ddeefec-ed4f-4fec-8d1c-02a2ddf65023" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:50:07 user nova-compute[73104]: DEBUG nova.network.neutron [req-daeb0cc6-af5b-4bc7-9185-b7b2896a3dc1 req-3cce54a1-4cc3-4906-ad26-62e90a83544b service nova] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Refreshing network info cache for port 06ff3140-31c9-478c-9d4e-c2a4ee346df4 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:50:07 user nova-compute[73104]: DEBUG nova.network.neutron [req-daeb0cc6-af5b-4bc7-9185-b7b2896a3dc1 req-3cce54a1-4cc3-4906-ad26-62e90a83544b service nova] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Updated VIF entry in instance network info cache for port 06ff3140-31c9-478c-9d4e-c2a4ee346df4. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:50:07 user nova-compute[73104]: DEBUG nova.network.neutron [req-daeb0cc6-af5b-4bc7-9185-b7b2896a3dc1 req-3cce54a1-4cc3-4906-ad26-62e90a83544b service nova] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Updating instance_info_cache with network_info: [{"id": "06ff3140-31c9-478c-9d4e-c2a4ee346df4", "address": "fa:16:3e:e2:2f:c2", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06ff3140-31", "ovs_interfaceid": "06ff3140-31c9-478c-9d4e-c2a4ee346df4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:50:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-daeb0cc6-af5b-4bc7-9185-b7b2896a3dc1 req-3cce54a1-4cc3-4906-ad26-62e90a83544b service nova] Releasing lock "refresh_cache-5ddeefec-ed4f-4fec-8d1c-02a2ddf65023" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:50:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-822e0c96-48a0-4707-bb20-05eb288957de tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Acquiring lock "55966005-e534-45d3-9bd4-cea5d54b661e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:50:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-822e0c96-48a0-4707-bb20-05eb288957de tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lock "55966005-e534-45d3-9bd4-cea5d54b661e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:50:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-822e0c96-48a0-4707-bb20-05eb288957de tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Acquiring lock "55966005-e534-45d3-9bd4-cea5d54b661e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:50:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-822e0c96-48a0-4707-bb20-05eb288957de tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lock "55966005-e534-45d3-9bd4-cea5d54b661e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:50:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-822e0c96-48a0-4707-bb20-05eb288957de tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lock "55966005-e534-45d3-9bd4-cea5d54b661e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:50:08 user nova-compute[73104]: INFO nova.compute.manager [None req-822e0c96-48a0-4707-bb20-05eb288957de tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Terminating instance
Aug 26 08:50:08 user nova-compute[73104]: DEBUG nova.compute.manager [None req-822e0c96-48a0-4707-bb20-05eb288957de tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 08:50:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:08 user nova-compute[73104]: DEBUG nova.compute.manager [req-7c177f77-6a9f-4a17-8503-59a83de090eb req-ce58066b-3d92-49bf-b49d-189b6e8629de service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Received event network-vif-unplugged-b646e439-ff88-4f5b-9fa6-f9a1eac84f08 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:50:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-7c177f77-6a9f-4a17-8503-59a83de090eb req-ce58066b-3d92-49bf-b49d-189b6e8629de service nova] Acquiring lock "55966005-e534-45d3-9bd4-cea5d54b661e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:50:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-7c177f77-6a9f-4a17-8503-59a83de090eb req-ce58066b-3d92-49bf-b49d-189b6e8629de service nova] Lock "55966005-e534-45d3-9bd4-cea5d54b661e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:50:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-7c177f77-6a9f-4a17-8503-59a83de090eb req-ce58066b-3d92-49bf-b49d-189b6e8629de service nova] Lock "55966005-e534-45d3-9bd4-cea5d54b661e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:50:08 user nova-compute[73104]: DEBUG nova.compute.manager [req-7c177f77-6a9f-4a17-8503-59a83de090eb req-ce58066b-3d92-49bf-b49d-189b6e8629de service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] No waiting events found dispatching network-vif-unplugged-b646e439-ff88-4f5b-9fa6-f9a1eac84f08 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:50:08 user nova-compute[73104]: DEBUG nova.compute.manager [req-7c177f77-6a9f-4a17-8503-59a83de090eb req-ce58066b-3d92-49bf-b49d-189b6e8629de service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Received event network-vif-unplugged-b646e439-ff88-4f5b-9fa6-f9a1eac84f08 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:50:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:09 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Instance destroyed successfully.
Aug 26 08:50:09 user nova-compute[73104]: DEBUG nova.objects.instance [None req-822e0c96-48a0-4707-bb20-05eb288957de tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lazy-loading 'resources' on Instance uuid 55966005-e534-45d3-9bd4-cea5d54b661e {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:50:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-822e0c96-48a0-4707-bb20-05eb288957de tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T08:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-829727057',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-829727057',id=25,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPrtw2uPRe9G8zyYK3ARIY3AfX0RzLppVCcvlKoAgXZOG4qTaMTx2cx9wO1C4CoqjxJ4W8gRg9Ex00VbBz9tkcQ5fjhSqrrzBpVdl1qo6UlzDiYX6hf0JXW1ZaomcLxiQ==',key_name='tempest-keypair-1580684820',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:47:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b8190893dbd48a083cc8dba20db0e35',ramdisk_id='',reservation_id='r-kl6196e4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1715069850',owner_user_name='tempest-TaggedAttachmentsTest-1715069850-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:47:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1fd1bc8d58240e89ed980aa9760cbfe',uuid=55966005-e534-45d3-9bd4-cea5d54b661e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b646e439-ff88-4f5b-9fa6-f9a1eac84f08", "address": "fa:16:3e:b8:26:eb", "network": {"id": "edbebe23-8fc4-4a39-b4e8-d32d00d25c7f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2016586720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8190893dbd48a083cc8dba20db0e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb646e439-ff", "ovs_interfaceid": "b646e439-ff88-4f5b-9fa6-f9a1eac84f08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:50:09 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-822e0c96-48a0-4707-bb20-05eb288957de tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Converting VIF {"id": "b646e439-ff88-4f5b-9fa6-f9a1eac84f08", "address": "fa:16:3e:b8:26:eb", "network": {"id": "edbebe23-8fc4-4a39-b4e8-d32d00d25c7f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2016586720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8190893dbd48a083cc8dba20db0e35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb646e439-ff", "ovs_interfaceid": "b646e439-ff88-4f5b-9fa6-f9a1eac84f08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:50:09 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-822e0c96-48a0-4707-bb20-05eb288957de tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:26:eb,bridge_name='br-int',has_traffic_filtering=True,id=b646e439-ff88-4f5b-9fa6-f9a1eac84f08,network=Network(edbebe23-8fc4-4a39-b4e8-d32d00d25c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb646e439-ff') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:50:09 user nova-compute[73104]: DEBUG os_vif [None req-822e0c96-48a0-4707-bb20-05eb288957de tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:26:eb,bridge_name='br-int',has_traffic_filtering=True,id=b646e439-ff88-4f5b-9fa6-f9a1eac84f08,network=Network(edbebe23-8fc4-4a39-b4e8-d32d00d25c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb646e439-ff') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:50:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb646e439-ff, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:50:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:50:09 user nova-compute[73104]: INFO os_vif [None req-822e0c96-48a0-4707-bb20-05eb288957de tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:26:eb,bridge_name='br-int',has_traffic_filtering=True,id=b646e439-ff88-4f5b-9fa6-f9a1eac84f08,network=Network(edbebe23-8fc4-4a39-b4e8-d32d00d25c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb646e439-ff')
Aug 26 08:50:09 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-822e0c96-48a0-4707-bb20-05eb288957de tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Deleting instance files /opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e_del
Aug 26 08:50:09 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-822e0c96-48a0-4707-bb20-05eb288957de tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Deletion of /opt/stack/data/nova/instances/55966005-e534-45d3-9bd4-cea5d54b661e_del complete
Aug 26 08:50:09 user nova-compute[73104]: INFO nova.compute.manager [None req-822e0c96-48a0-4707-bb20-05eb288957de tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 26 08:50:09 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-822e0c96-48a0-4707-bb20-05eb288957de tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 08:50:09 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 08:50:09 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 08:50:10 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:50:10 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Took 1.18 seconds to deallocate network for instance.
Aug 26 08:50:10 user nova-compute[73104]: DEBUG nova.compute.manager [req-0995337f-9c2e-4df5-9ea9-51c40fc2e55b req-0e47056e-9e47-4be5-bc58-07e423801d73 service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Received event network-vif-deleted-b646e439-ff88-4f5b-9fa6-f9a1eac84f08 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:50:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-822e0c96-48a0-4707-bb20-05eb288957de tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:50:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-822e0c96-48a0-4707-bb20-05eb288957de tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:50:11 user nova-compute[73104]: DEBUG nova.compute.manager [req-970fc8ad-a9a5-439d-8d86-c945423c857c req-6cc37a05-b7f4-4ab4-825d-e5203d70a8b7 service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Received event network-vif-plugged-b646e439-ff88-4f5b-9fa6-f9a1eac84f08 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:50:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-970fc8ad-a9a5-439d-8d86-c945423c857c req-6cc37a05-b7f4-4ab4-825d-e5203d70a8b7 service nova] Acquiring lock "55966005-e534-45d3-9bd4-cea5d54b661e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:50:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-970fc8ad-a9a5-439d-8d86-c945423c857c req-6cc37a05-b7f4-4ab4-825d-e5203d70a8b7 service nova] Lock "55966005-e534-45d3-9bd4-cea5d54b661e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:50:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-970fc8ad-a9a5-439d-8d86-c945423c857c req-6cc37a05-b7f4-4ab4-825d-e5203d70a8b7 service nova] Lock "55966005-e534-45d3-9bd4-cea5d54b661e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:50:11 user nova-compute[73104]: DEBUG nova.compute.manager [req-970fc8ad-a9a5-439d-8d86-c945423c857c req-6cc37a05-b7f4-4ab4-825d-e5203d70a8b7 service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] No waiting events found dispatching network-vif-plugged-b646e439-ff88-4f5b-9fa6-f9a1eac84f08 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:50:11 user nova-compute[73104]: WARNING nova.compute.manager [req-970fc8ad-a9a5-439d-8d86-c945423c857c req-6cc37a05-b7f4-4ab4-825d-e5203d70a8b7 service nova] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Received unexpected event network-vif-plugged-b646e439-ff88-4f5b-9fa6-f9a1eac84f08 for instance with vm_state deleted and task_state None.
Aug 26 08:50:11 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-822e0c96-48a0-4707-bb20-05eb288957de tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:50:11 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-822e0c96-48a0-4707-bb20-05eb288957de tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:50:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-822e0c96-48a0-4707-bb20-05eb288957de tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:50:11 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-822e0c96-48a0-4707-bb20-05eb288957de tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Deleted allocations for instance 55966005-e534-45d3-9bd4-cea5d54b661e
Aug 26 08:50:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-822e0c96-48a0-4707-bb20-05eb288957de tempest-TaggedAttachmentsTest-1715069850 tempest-TaggedAttachmentsTest-1715069850-project-member] Lock "55966005-e534-45d3-9bd4-cea5d54b661e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.663s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:50:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fa084375-7767-4b3d-a2dc-0deb51761f89 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:50:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fa084375-7767-4b3d-a2dc-0deb51761f89 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:50:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fa084375-7767-4b3d-a2dc-0deb51761f89 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:50:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fa084375-7767-4b3d-a2dc-0deb51761f89 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:50:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fa084375-7767-4b3d-a2dc-0deb51761f89 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:50:13 user nova-compute[73104]: INFO nova.compute.manager [None req-fa084375-7767-4b3d-a2dc-0deb51761f89 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Terminating instance
Aug 26 08:50:13 user nova-compute[73104]: DEBUG nova.compute.manager [None req-fa084375-7767-4b3d-a2dc-0deb51761f89 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 08:50:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:13 user nova-compute[73104]: DEBUG nova.compute.manager [req-b17cc732-2fcc-43d1-860e-011e2c9d7fe2 req-be4b9bf5-8c55-4c74-bd7d-ff1d12d8d05b service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Received event network-vif-unplugged-cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:50:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b17cc732-2fcc-43d1-860e-011e2c9d7fe2 req-be4b9bf5-8c55-4c74-bd7d-ff1d12d8d05b service nova] Acquiring lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:50:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b17cc732-2fcc-43d1-860e-011e2c9d7fe2 req-be4b9bf5-8c55-4c74-bd7d-ff1d12d8d05b service nova] Lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:50:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b17cc732-2fcc-43d1-860e-011e2c9d7fe2 req-be4b9bf5-8c55-4c74-bd7d-ff1d12d8d05b service nova] Lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:50:13 user nova-compute[73104]: DEBUG nova.compute.manager [req-b17cc732-2fcc-43d1-860e-011e2c9d7fe2 req-be4b9bf5-8c55-4c74-bd7d-ff1d12d8d05b service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] No waiting events found dispatching network-vif-unplugged-cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:50:13 user nova-compute[73104]: DEBUG nova.compute.manager [req-b17cc732-2fcc-43d1-860e-011e2c9d7fe2 req-be4b9bf5-8c55-4c74-bd7d-ff1d12d8d05b service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Received event network-vif-unplugged-cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:50:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:13 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Instance destroyed successfully.
Aug 26 08:50:13 user nova-compute[73104]: DEBUG nova.objects.instance [None req-fa084375-7767-4b3d-a2dc-0deb51761f89 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lazy-loading 'resources' on Instance uuid c3b4c644-f7f3-4304-b732-9f43cfeac2bb {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:50:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-fa084375-7767-4b3d-a2dc-0deb51761f89 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T08:44:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-516733243',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-516733243',id=21,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/7E5NQLF0ppBSnaA5b97ACZ8aWxUr5RccERUW17fZtRLsaJRhM0S8cb6rnetzLx3STt8VOP73OPi/ha6ToIlMMPvS1XIkwRhm3xKLaXSSyF1T2XJJ2lMAfE/pUPfKxGA==',key_name='tempest-keypair-1461483520',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:48:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='770daa2e8b274a9b828e489c1573ced4',ramdisk_id='',reservation_id='r-7sybpznn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2062858766',owner_user_name='tempest-AttachVolumeShelveTestJSON-2062858766-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:48:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db3ae37701df47a5b35026fe3857bc51',uuid=c3b4c644-f7f3-4304-b732-9f43cfeac2bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "address": "fa:16:3e:4c:c9:02", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc2c1a60-58", "ovs_interfaceid": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:50:13 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-fa084375-7767-4b3d-a2dc-0deb51761f89 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Converting VIF {"id": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "address": "fa:16:3e:4c:c9:02", "network": {"id": "38f7ec35-12eb-46fe-a425-51ee854d804d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1787448036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770daa2e8b274a9b828e489c1573ced4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc2c1a60-58", "ovs_interfaceid": "cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:50:13 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-fa084375-7767-4b3d-a2dc-0deb51761f89 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c9:02,bridge_name='br-int',has_traffic_filtering=True,id=cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03,network=Network(38f7ec35-12eb-46fe-a425-51ee854d804d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc2c1a60-58') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:50:13 user nova-compute[73104]: DEBUG os_vif [None req-fa084375-7767-4b3d-a2dc-0deb51761f89 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c9:02,bridge_name='br-int',has_traffic_filtering=True,id=cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03,network=Network(38f7ec35-12eb-46fe-a425-51ee854d804d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc2c1a60-58') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:50:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc2c1a60-58, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:50:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:50:13 user nova-compute[73104]: INFO os_vif [None req-fa084375-7767-4b3d-a2dc-0deb51761f89 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c9:02,bridge_name='br-int',has_traffic_filtering=True,id=cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03,network=Network(38f7ec35-12eb-46fe-a425-51ee854d804d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc2c1a60-58')
Aug 26 08:50:13 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-fa084375-7767-4b3d-a2dc-0deb51761f89 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Deleting instance files /opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb_del
Aug 26 08:50:13 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-fa084375-7767-4b3d-a2dc-0deb51761f89 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Deletion of /opt/stack/data/nova/instances/c3b4c644-f7f3-4304-b732-9f43cfeac2bb_del complete
Aug 26 08:50:13 user nova-compute[73104]: INFO nova.compute.manager [None req-fa084375-7767-4b3d-a2dc-0deb51761f89 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Took 0.70 seconds to destroy the instance on the hypervisor.
Aug 26 08:50:13 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-fa084375-7767-4b3d-a2dc-0deb51761f89 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 08:50:13 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 08:50:13 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 08:50:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:14 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:50:14 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Took 0.88 seconds to deallocate network for instance.
Aug 26 08:50:14 user nova-compute[73104]: DEBUG nova.compute.manager [req-6b3579c1-b657-4b84-bfc0-a2001de1a6b7 req-5a788f6b-108b-40b9-9889-bda27a144f0d service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Received event network-vif-deleted-cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:50:14 user nova-compute[73104]: INFO nova.compute.manager [req-6b3579c1-b657-4b84-bfc0-a2001de1a6b7 req-5a788f6b-108b-40b9-9889-bda27a144f0d service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Neutron deleted interface cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03; detaching it from the instance and deleting it from the info cache
Aug 26 08:50:14 user nova-compute[73104]: DEBUG nova.network.neutron [req-6b3579c1-b657-4b84-bfc0-a2001de1a6b7 req-5a788f6b-108b-40b9-9889-bda27a144f0d service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:50:14 user nova-compute[73104]: DEBUG nova.compute.manager [req-6b3579c1-b657-4b84-bfc0-a2001de1a6b7 req-5a788f6b-108b-40b9-9889-bda27a144f0d service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Detach interface failed, port_id=cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03, reason: Instance c3b4c644-f7f3-4304-b732-9f43cfeac2bb could not be found. {{(pid=73104) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 08:50:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fa084375-7767-4b3d-a2dc-0deb51761f89 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:50:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fa084375-7767-4b3d-a2dc-0deb51761f89 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:50:15 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-fa084375-7767-4b3d-a2dc-0deb51761f89 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:50:15 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-fa084375-7767-4b3d-a2dc-0deb51761f89 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:50:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fa084375-7767-4b3d-a2dc-0deb51761f89 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:50:15 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-fa084375-7767-4b3d-a2dc-0deb51761f89 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Deleted allocations for instance c3b4c644-f7f3-4304-b732-9f43cfeac2bb
Aug 26 08:50:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fa084375-7767-4b3d-a2dc-0deb51761f89 tempest-AttachVolumeShelveTestJSON-2062858766 tempest-AttachVolumeShelveTestJSON-2062858766-project-member] Lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.063s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:50:15 user nova-compute[73104]: DEBUG nova.compute.manager [req-5bf38f1e-38af-40db-a88f-63b9bbe79aee req-0c6631bf-b904-444d-8344-8ae6cd46f7f7 service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Received event network-vif-plugged-cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:50:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5bf38f1e-38af-40db-a88f-63b9bbe79aee req-0c6631bf-b904-444d-8344-8ae6cd46f7f7 service nova] Acquiring lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:50:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5bf38f1e-38af-40db-a88f-63b9bbe79aee req-0c6631bf-b904-444d-8344-8ae6cd46f7f7 service nova] Lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:50:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5bf38f1e-38af-40db-a88f-63b9bbe79aee req-0c6631bf-b904-444d-8344-8ae6cd46f7f7 service nova] Lock "c3b4c644-f7f3-4304-b732-9f43cfeac2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:50:15 user nova-compute[73104]: DEBUG nova.compute.manager [req-5bf38f1e-38af-40db-a88f-63b9bbe79aee req-0c6631bf-b904-444d-8344-8ae6cd46f7f7 service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] No waiting events found dispatching network-vif-plugged-cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:50:15 user nova-compute[73104]: WARNING nova.compute.manager [req-5bf38f1e-38af-40db-a88f-63b9bbe79aee req-0c6631bf-b904-444d-8344-8ae6cd46f7f7 service nova] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Received unexpected event network-vif-plugged-cc2c1a60-58eb-4d8b-aa7d-07e487bf8e03 for instance with vm_state deleted and task_state None.
Aug 26 08:50:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "5ddeefec-ed4f-4fec-8d1c-02a2ddf65023" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:50:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "5ddeefec-ed4f-4fec-8d1c-02a2ddf65023" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:50:18 user nova-compute[73104]: DEBUG nova.objects.instance [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lazy-loading 'flavor' on Instance uuid 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:50:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "5ddeefec-ed4f-4fec-8d1c-02a2ddf65023" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:50:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "5ddeefec-ed4f-4fec-8d1c-02a2ddf65023" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:50:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "5ddeefec-ed4f-4fec-8d1c-02a2ddf65023" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:50:18 user nova-compute[73104]: INFO nova.compute.manager [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Attaching volume ae7c39c9-c940-4d0c-a4db-93a9a51016b6 to /dev/vdb
Aug 26 08:50:18 user nova-compute[73104]: DEBUG os_brick.utils [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:50:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac3253f-4606-44cc-ab2d-8fd1af5ac7ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:50:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a13dfc-3beb-40c4-942a-d63383eeb91f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:50:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[04629c6a-9264-498b-b4c6-6e5a151e60d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:50:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0530bcd1-1746-4c28-8b06-a85145b69d95]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:50:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:50:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:50:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:50:18 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:50:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e24d9d-94b0-4ba2-b2f8-9f38e2755d9e]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:50:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:50:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:50:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:50:18 user nova-compute[73104]: DEBUG os_brick.utils [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:50:18 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Updating existing volume attachment record: 83269aca-0683-49b4-aa76-6abe0a4ea3bc {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 08:50:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:24 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693039809.4453514, 55966005-e534-45d3-9bd4-cea5d54b661e => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:50:24 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] VM Stopped (Lifecycle Event)
Aug 26 08:50:24 user nova-compute[73104]: DEBUG nova.compute.manager [None req-4f24a178-3128-43c4-98b7-b1c385905a92 None None] [instance: 55966005-e534-45d3-9bd4-cea5d54b661e] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:50:28 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693039813.7655659, c3b4c644-f7f3-4304-b732-9f43cfeac2bb => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:50:28 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] VM Stopped (Lifecycle Event)
Aug 26 08:50:28 user nova-compute[73104]: DEBUG nova.compute.manager [None req-a318aef4-e1f6-43a7-b3d0-eb4c60387e6a None None] [instance: c3b4c644-f7f3-4304-b732-9f43cfeac2bb] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:50:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQWsMVAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:50:29 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:50:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:50:29 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:50:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:50:29 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:50:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6e57be-50fa-4245-ac1b-52b50c4fbccd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:50:29 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3c3a05-9ad2-470a-96a9-4e1165cbb1fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6] added
Aug 26 08:50:29 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd811d4-3b92-4793-9b14-795bcfadc7f8]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f78afb2-429f-4569-99b3-0ade92cf49b9]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SQWsMVAH {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SQWsMVAH" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2451e2-c5d9-497b-a5f9-cfdd15e2bf81]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SQWsMVAH'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64fda0e-4d45-4b3c-843c-603ae81d8b84]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4040f994-5f54-42b0-8f46-12f31803184c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:50:29 user nova-compute[73104]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)
Aug 26 08:50:29 user nova-compute[73104]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b (non-flash)
Aug 26 08:50:29 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:50:29 user nova-compute[73104]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)
Aug 26 08:50:29 user nova-compute[73104]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b (non-flash)
Aug 26 08:50:29 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6b7a33-69d2-4b90-894a-5162dcf401a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6, portal: 172.16.0.220,3260]
Aug 26 08:50:29 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6, portal: 172.16.0.220,3260] successful.
Aug 26 08:50:29 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f30e57-cee3-4dff-a40b-efe6902f94e2]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6914ad3c-18aa-4c21-9cc0-89a20bfe5623]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:50:29 user nova-compute[73104]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)
Aug 26 08:50:29 user nova-compute[73104]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b (non-flash)
Aug 26 08:50:29 user nova-compute[73104]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6 (non-flash)
Aug 26 08:50:29 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:50:29 user nova-compute[73104]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)
Aug 26 08:50:29 user nova-compute[73104]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b (non-flash)
Aug 26 08:50:29 user nova-compute[73104]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6 (non-flash)
Aug 26 08:50:29 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4836e941-940e-404b-a387-c9b3118fba62]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:50:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQWsMVAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:50:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:50:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23061393961373563', 'path': '/dev/sde'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:50:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061393961373563', 'path': '/dev/sde'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:50:30 user nova-compute[73104]: DEBUG nova.objects.instance [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lazy-loading 'flavor' on Instance uuid 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:50:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 08:50:30 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:50:30 user nova-compute[73104]:   <source dev="/dev/sde"/>
Aug 26 08:50:30 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:50:30 user nova-compute[73104]:   <serial>ae7c39c9-c940-4d0c-a4db-93a9a51016b6</serial>
Aug 26 08:50:30 user nova-compute[73104]: </disk>
Aug 26 08:50:30 user nova-compute[73104]:  {{(pid=73104) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 08:50:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:50:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:50:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] No VIF found with MAC fa:16:3e:e2:2f:c2, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:50:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-61109cb5-879c-4729-8581-23754a481b14 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "5ddeefec-ed4f-4fec-8d1c-02a2ddf65023" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.091s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:50:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7d092a81-387d-448a-99ee-75a95c338aa7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "5ddeefec-ed4f-4fec-8d1c-02a2ddf65023" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:50:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7d092a81-387d-448a-99ee-75a95c338aa7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "5ddeefec-ed4f-4fec-8d1c-02a2ddf65023" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:50:32 user nova-compute[73104]: INFO nova.compute.manager [None req-7d092a81-387d-448a-99ee-75a95c338aa7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Detaching volume ae7c39c9-c940-4d0c-a4db-93a9a51016b6
Aug 26 08:50:32 user nova-compute[73104]: INFO nova.virt.block_device [None req-7d092a81-387d-448a-99ee-75a95c338aa7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Attempting to driver detach volume ae7c39c9-c940-4d0c-a4db-93a9a51016b6 from mountpoint /dev/vdb
Aug 26 08:50:32 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-7d092a81-387d-448a-99ee-75a95c338aa7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Attempting to detach device vdb from instance 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023 from the persistent domain config. {{(pid=73104) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 08:50:32 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-7d092a81-387d-448a-99ee-75a95c338aa7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:50:32 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:50:32 user nova-compute[73104]:   <source dev="/dev/sde"/>
Aug 26 08:50:32 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:50:32 user nova-compute[73104]:   <serial>ae7c39c9-c940-4d0c-a4db-93a9a51016b6</serial>
Aug 26 08:50:32 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 08:50:32 user nova-compute[73104]: </disk>
Aug 26 08:50:32 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:50:32 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-7d092a81-387d-448a-99ee-75a95c338aa7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Successfully detached device vdb from instance 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023 from the persistent domain config.
Aug 26 08:50:32 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-7d092a81-387d-448a-99ee-75a95c338aa7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023 from the live domain config. {{(pid=73104) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 08:50:32 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-7d092a81-387d-448a-99ee-75a95c338aa7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:50:32 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:50:32 user nova-compute[73104]:   <source dev="/dev/sde"/>
Aug 26 08:50:32 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:50:32 user nova-compute[73104]:   <serial>ae7c39c9-c940-4d0c-a4db-93a9a51016b6</serial>
Aug 26 08:50:32 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 08:50:32 user nova-compute[73104]: </disk>
Aug 26 08:50:32 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Received event <DeviceRemovedEvent: 1693039833.2120168, 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73104) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-7d092a81-387d-448a-99ee-75a95c338aa7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023 {{(pid=73104) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 08:50:33 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-7d092a81-387d-448a-99ee-75a95c338aa7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Successfully detached device vdb from instance 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023 from the live domain config.
Aug 26 08:50:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d092a81-387d-448a-99ee-75a95c338aa7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d092a81-387d-448a-99ee-75a95c338aa7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQWsMVAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:50:33 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-7d092a81-387d-448a-99ee-75a95c338aa7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:50:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-7d092a81-387d-448a-99ee-75a95c338aa7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-7d092a81-387d-448a-99ee-75a95c338aa7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d092a81-387d-448a-99ee-75a95c338aa7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4336331c-6fb5-4e7d-a020-961fcd8b9069]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ed4434-d119-4ba8-aff7-4c05ca8466fc]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d092a81-387d-448a-99ee-75a95c338aa7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:50:33 user nova-compute[73104]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)
Aug 26 08:50:33 user nova-compute[73104]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b (non-flash)
Aug 26 08:50:33 user nova-compute[73104]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6 (non-flash)
Aug 26 08:50:33 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d092a81-387d-448a-99ee-75a95c338aa7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:50:33 user nova-compute[73104]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)
Aug 26 08:50:33 user nova-compute[73104]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b (non-flash)
Aug 26 08:50:33 user nova-compute[73104]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6 (non-flash)
Aug 26 08:50:33 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d092a81-387d-448a-99ee-75a95c338aa7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0c418e170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6'): ({'sde'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-7d092a81-387d-448a-99ee-75a95c338aa7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Removing single pathed devices sde {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.062s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b327b0-039d-458c-9a3e-e653c2d4cd6e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b50d14a-ba1c-4f22-a81d-5ef8f8339d58]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-7d092a81-387d-448a-99ee-75a95c338aa7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Flushing IO for device /dev/sde {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d66f83-a60e-4c20-8bdd-6c9e7ced498d]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-7d092a81-387d-448a-99ee-75a95c338aa7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.033s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b437d4-21c9-43e7-8219-8a7b345cfce1]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-7d092a81-387d-448a-99ee-75a95c338aa7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-7d092a81-387d-448a-99ee-75a95c338aa7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] SCSI volumes sde have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d092a81-387d-448a-99ee-75a95c338aa7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ba864b-0c00-48e9-90c2-00248c0f5fc6]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d092a81-387d-448a-99ee-75a95c338aa7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa5d600-47da-41fd-86c0-fc1cb1ac2989]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d092a81-387d-448a-99ee-75a95c338aa7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6, portal: 172.16.0.220,3260]
Aug 26 08:50:33 user nova-compute[73104]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6, portal: 172.16.0.220,3260] successful.
Aug 26 08:50:33 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae7c39c9-c940-4d0c-a4db-93a9a51016b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc101257-2ca3-45da-9cf1-4a9a5f9a76c0]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d092a81-387d-448a-99ee-75a95c338aa7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-7d092a81-387d-448a-99ee-75a95c338aa7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d092a81-387d-448a-99ee-75a95c338aa7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] <== disconnect_volume: return (318ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d092a81-387d-448a-99ee-75a95c338aa7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 08:50:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:34 user nova-compute[73104]: DEBUG nova.objects.instance [None req-7d092a81-387d-448a-99ee-75a95c338aa7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lazy-loading 'flavor' on Instance uuid 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:50:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7d092a81-387d-448a-99ee-75a95c338aa7 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "5ddeefec-ed4f-4fec-8d1c-02a2ddf65023" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.760s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:50:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:41 user nova-compute[73104]: INFO nova.compute.manager [None req-8273b93e-5d48-4d67-bb6e-58ca3d3a86ee tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Unrescuing
Aug 26 08:50:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8273b93e-5d48-4d67-bb6e-58ca3d3a86ee tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "refresh_cache-bef1e493-6b2c-4688-98c2-647261feb571" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:50:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8273b93e-5d48-4d67-bb6e-58ca3d3a86ee tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquired lock "refresh_cache-bef1e493-6b2c-4688-98c2-647261feb571" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:50:41 user nova-compute[73104]: DEBUG nova.network.neutron [None req-8273b93e-5d48-4d67-bb6e-58ca3d3a86ee tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:50:42 user nova-compute[73104]: DEBUG nova.network.neutron [None req-8273b93e-5d48-4d67-bb6e-58ca3d3a86ee tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Updating instance_info_cache with network_info: [{"id": "6ddebd25-cfe6-4b0e-8b2d-746fae9f8685", "address": "fa:16:3e:03:fd:b2", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddebd25-cf", "ovs_interfaceid": "6ddebd25-cfe6-4b0e-8b2d-746fae9f8685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:50:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8273b93e-5d48-4d67-bb6e-58ca3d3a86ee tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Releasing lock "refresh_cache-bef1e493-6b2c-4688-98c2-647261feb571" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:50:42 user nova-compute[73104]: DEBUG nova.objects.instance [None req-8273b93e-5d48-4d67-bb6e-58ca3d3a86ee tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lazy-loading 'flavor' on Instance uuid bef1e493-6b2c-4688-98c2-647261feb571 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:50:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:42 user nova-compute[73104]: DEBUG nova.compute.manager [req-f480f69d-90e2-45e9-b527-7f23e8ad3ff4 req-1c772827-1afb-4e14-988a-9650fe46b58c service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Received event network-vif-unplugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:50:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f480f69d-90e2-45e9-b527-7f23e8ad3ff4 req-1c772827-1afb-4e14-988a-9650fe46b58c service nova] Acquiring lock "bef1e493-6b2c-4688-98c2-647261feb571-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:50:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f480f69d-90e2-45e9-b527-7f23e8ad3ff4 req-1c772827-1afb-4e14-988a-9650fe46b58c service nova] Lock "bef1e493-6b2c-4688-98c2-647261feb571-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:50:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f480f69d-90e2-45e9-b527-7f23e8ad3ff4 req-1c772827-1afb-4e14-988a-9650fe46b58c service nova] Lock "bef1e493-6b2c-4688-98c2-647261feb571-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:50:42 user nova-compute[73104]: DEBUG nova.compute.manager [req-f480f69d-90e2-45e9-b527-7f23e8ad3ff4 req-1c772827-1afb-4e14-988a-9650fe46b58c service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] No waiting events found dispatching network-vif-unplugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:50:42 user nova-compute[73104]: WARNING nova.compute.manager [req-f480f69d-90e2-45e9-b527-7f23e8ad3ff4 req-1c772827-1afb-4e14-988a-9650fe46b58c service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Received unexpected event network-vif-unplugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 for instance with vm_state rescued and task_state unrescuing.
Aug 26 08:50:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:42 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Instance destroyed successfully.
Aug 26 08:50:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:44 user nova-compute[73104]: DEBUG nova.compute.manager [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Received event network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:50:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] Acquiring lock "bef1e493-6b2c-4688-98c2-647261feb571-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:50:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] Lock "bef1e493-6b2c-4688-98c2-647261feb571-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:50:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] Lock "bef1e493-6b2c-4688-98c2-647261feb571-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:50:44 user nova-compute[73104]: DEBUG nova.compute.manager [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] No waiting events found dispatching network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:50:44 user nova-compute[73104]: WARNING nova.compute.manager [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Received unexpected event network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 for instance with vm_state rescued and task_state unrescuing.
Aug 26 08:50:44 user nova-compute[73104]: DEBUG nova.compute.manager [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Received event network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:50:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] Acquiring lock "bef1e493-6b2c-4688-98c2-647261feb571-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:50:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] Lock "bef1e493-6b2c-4688-98c2-647261feb571-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:50:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] Lock "bef1e493-6b2c-4688-98c2-647261feb571-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:50:44 user nova-compute[73104]: DEBUG nova.compute.manager [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] No waiting events found dispatching network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:50:44 user nova-compute[73104]: WARNING nova.compute.manager [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Received unexpected event network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 for instance with vm_state rescued and task_state unrescuing.
Aug 26 08:50:44 user nova-compute[73104]: DEBUG nova.compute.manager [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Received event network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:50:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] Acquiring lock "bef1e493-6b2c-4688-98c2-647261feb571-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:50:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] Lock "bef1e493-6b2c-4688-98c2-647261feb571-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:50:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] Lock "bef1e493-6b2c-4688-98c2-647261feb571-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:50:44 user nova-compute[73104]: DEBUG nova.compute.manager [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] No waiting events found dispatching network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:50:44 user nova-compute[73104]: WARNING nova.compute.manager [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Received unexpected event network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 for instance with vm_state rescued and task_state unrescuing.
Aug 26 08:50:44 user nova-compute[73104]: DEBUG nova.compute.manager [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Received event network-vif-unplugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:50:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] Acquiring lock "bef1e493-6b2c-4688-98c2-647261feb571-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:50:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] Lock "bef1e493-6b2c-4688-98c2-647261feb571-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:50:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] Lock "bef1e493-6b2c-4688-98c2-647261feb571-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:50:44 user nova-compute[73104]: DEBUG nova.compute.manager [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] No waiting events found dispatching network-vif-unplugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:50:44 user nova-compute[73104]: WARNING nova.compute.manager [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Received unexpected event network-vif-unplugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 for instance with vm_state rescued and task_state unrescuing.
Aug 26 08:50:44 user nova-compute[73104]: DEBUG nova.compute.manager [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Received event network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:50:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] Acquiring lock "bef1e493-6b2c-4688-98c2-647261feb571-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:50:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] Lock "bef1e493-6b2c-4688-98c2-647261feb571-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:50:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] Lock "bef1e493-6b2c-4688-98c2-647261feb571-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:50:44 user nova-compute[73104]: DEBUG nova.compute.manager [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] No waiting events found dispatching network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:50:44 user nova-compute[73104]: WARNING nova.compute.manager [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Received unexpected event network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 for instance with vm_state rescued and task_state unrescuing.
Aug 26 08:50:44 user nova-compute[73104]: DEBUG nova.compute.manager [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Received event network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:50:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] Acquiring lock "bef1e493-6b2c-4688-98c2-647261feb571-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:50:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] Lock "bef1e493-6b2c-4688-98c2-647261feb571-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:50:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] Lock "bef1e493-6b2c-4688-98c2-647261feb571-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:50:44 user nova-compute[73104]: DEBUG nova.compute.manager [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] No waiting events found dispatching network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:50:44 user nova-compute[73104]: WARNING nova.compute.manager [req-ac0ae260-0a0b-43ab-9b42-692686724373 req-986753f3-d0bd-4ffc-90e2-d5940ecde55b service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Received unexpected event network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 for instance with vm_state rescued and task_state unrescuing.
Aug 26 08:50:46 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Removed pending event for bef1e493-6b2c-4688-98c2-647261feb571 due to event {{(pid=73104) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 08:50:46 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039846.1872995, bef1e493-6b2c-4688-98c2-647261feb571 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:50:46 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: bef1e493-6b2c-4688-98c2-647261feb571] VM Resumed (Lifecycle Event)
Aug 26 08:50:46 user nova-compute[73104]: DEBUG nova.compute.manager [None req-8273b93e-5d48-4d67-bb6e-58ca3d3a86ee tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:50:46 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:50:46 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:50:46 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: bef1e493-6b2c-4688-98c2-647261feb571] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 08:50:46 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039846.189715, bef1e493-6b2c-4688-98c2-647261feb571 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:50:46 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: bef1e493-6b2c-4688-98c2-647261feb571] VM Started (Lifecycle Event)
Aug 26 08:50:46 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:50:46 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:50:46 user nova-compute[73104]: DEBUG nova.compute.manager [req-c813dd5d-22fb-4eeb-9c97-03b638254b5e req-0574692e-a839-422b-842d-1edd4106a60a service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Received event network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:50:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c813dd5d-22fb-4eeb-9c97-03b638254b5e req-0574692e-a839-422b-842d-1edd4106a60a service nova] Acquiring lock "bef1e493-6b2c-4688-98c2-647261feb571-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:50:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c813dd5d-22fb-4eeb-9c97-03b638254b5e req-0574692e-a839-422b-842d-1edd4106a60a service nova] Lock "bef1e493-6b2c-4688-98c2-647261feb571-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:50:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c813dd5d-22fb-4eeb-9c97-03b638254b5e req-0574692e-a839-422b-842d-1edd4106a60a service nova] Lock "bef1e493-6b2c-4688-98c2-647261feb571-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:50:46 user nova-compute[73104]: DEBUG nova.compute.manager [req-c813dd5d-22fb-4eeb-9c97-03b638254b5e req-0574692e-a839-422b-842d-1edd4106a60a service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] No waiting events found dispatching network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:50:46 user nova-compute[73104]: WARNING nova.compute.manager [req-c813dd5d-22fb-4eeb-9c97-03b638254b5e req-0574692e-a839-422b-842d-1edd4106a60a service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Received unexpected event network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 for instance with vm_state active and task_state None.
Aug 26 08:50:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:53 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:50:53 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 08:50:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:54 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:50:55 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:50:55 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:50:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-555b79cb-cea0-4fb8-b402-018a58f470c7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:50:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-555b79cb-cea0-4fb8-b402-018a58f470c7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:50:55 user nova-compute[73104]: INFO nova.compute.manager [None req-555b79cb-cea0-4fb8-b402-018a58f470c7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Detaching volume e0162bff-65f9-448e-9744-0d52eb0fbfe9
Aug 26 08:50:55 user nova-compute[73104]: INFO nova.virt.block_device [None req-555b79cb-cea0-4fb8-b402-018a58f470c7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Attempting to driver detach volume e0162bff-65f9-448e-9744-0d52eb0fbfe9 from mountpoint /dev/vdb
Aug 26 08:50:55 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-555b79cb-cea0-4fb8-b402-018a58f470c7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Attempting to detach device vdb from instance b7f6e347-c1f3-4f56-86c4-3b28c4729964 from the persistent domain config. {{(pid=73104) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 08:50:55 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-555b79cb-cea0-4fb8-b402-018a58f470c7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:50:55 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:50:55 user nova-compute[73104]:   <source dev="/dev/sdc"/>
Aug 26 08:50:55 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:50:55 user nova-compute[73104]:   <serial>e0162bff-65f9-448e-9744-0d52eb0fbfe9</serial>
Aug 26 08:50:55 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 08:50:55 user nova-compute[73104]: </disk>
Aug 26 08:50:55 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:50:55 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-555b79cb-cea0-4fb8-b402-018a58f470c7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Successfully detached device vdb from instance b7f6e347-c1f3-4f56-86c4-3b28c4729964 from the persistent domain config.
Aug 26 08:50:55 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-555b79cb-cea0-4fb8-b402-018a58f470c7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b7f6e347-c1f3-4f56-86c4-3b28c4729964 from the live domain config. {{(pid=73104) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 08:50:55 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-555b79cb-cea0-4fb8-b402-018a58f470c7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:50:55 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:50:55 user nova-compute[73104]:   <source dev="/dev/sdc"/>
Aug 26 08:50:55 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:50:55 user nova-compute[73104]:   <serial>e0162bff-65f9-448e-9744-0d52eb0fbfe9</serial>
Aug 26 08:50:55 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 08:50:55 user nova-compute[73104]: </disk>
Aug 26 08:50:55 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:50:55 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Received event <DeviceRemovedEvent: 1693039855.843956, b7f6e347-c1f3-4f56-86c4-3b28c4729964 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73104) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 08:50:55 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-555b79cb-cea0-4fb8-b402-018a58f470c7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b7f6e347-c1f3-4f56-86c4-3b28c4729964 {{(pid=73104) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 08:50:55 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-555b79cb-cea0-4fb8-b402-018a58f470c7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Successfully detached device vdb from instance b7f6e347-c1f3-4f56-86c4-3b28c4729964 from the live domain config.
Aug 26 08:50:55 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-555b79cb-cea0-4fb8-b402-018a58f470c7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:50:55 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-555b79cb-cea0-4fb8-b402-018a58f470c7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkWilbGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:50:55 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-555b79cb-cea0-4fb8-b402-018a58f470c7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:50:55 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-555b79cb-cea0-4fb8-b402-018a58f470c7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:50:55 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-555b79cb-cea0-4fb8-b402-018a58f470c7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:50:55 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-555b79cb-cea0-4fb8-b402-018a58f470c7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:50:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:55 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cb8a69-c1fe-4c98-b1fe-68e4a41b6d3f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:50:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:55 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c61c4a-c7c8-4878-9fe7-b91629ce287a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:50:55 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-555b79cb-cea0-4fb8-b402-018a58f470c7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:50:55 user nova-compute[73104]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)
Aug 26 08:50:55 user nova-compute[73104]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b (non-flash)
Aug 26 08:50:55 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:50:55 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-555b79cb-cea0-4fb8-b402-018a58f470c7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:50:55 user nova-compute[73104]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 (non-flash)
Aug 26 08:50:55 user nova-compute[73104]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b (non-flash)
Aug 26 08:50:55 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:50:55 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-555b79cb-cea0-4fb8-b402-018a58f470c7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0c468b760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9'): ({'sdc'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:50:55 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-555b79cb-cea0-4fb8-b402-018a58f470c7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Removing single pathed devices sdc {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:50:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:55 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4594dd-e07a-40bd-8a73-bde2eaceed24]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:50:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:55 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ee9797-3855-4c76-8b33-b66c70de7516]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:50:55 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-555b79cb-cea0-4fb8-b402-018a58f470c7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Flushing IO for device /dev/sdc {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:50:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:55 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8adfa5-5870-4bd6-9b61-ea3c358765fa]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:50:55 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-555b79cb-cea0-4fb8-b402-018a58f470c7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:50:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:56 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92467f0-5c28-4b50-9896-ab6d2acfb1fb]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:50:56 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-555b79cb-cea0-4fb8-b402-018a58f470c7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:50:56 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-555b79cb-cea0-4fb8-b402-018a58f470c7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] SCSI volumes sdc have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:50:56 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-555b79cb-cea0-4fb8-b402-018a58f470c7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:50:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:56 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4935bfa6-7240-4fce-ab39-db45b7cd17ba]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:50:56 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-555b79cb-cea0-4fb8-b402-018a58f470c7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:50:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:56 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a57b37-7003-44ee-9803-7a41f5a277d5]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:50:56 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-555b79cb-cea0-4fb8-b402-018a58f470c7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9, portal: 172.16.0.220,3260]
Aug 26 08:50:56 user nova-compute[73104]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9, portal: 172.16.0.220,3260] successful.
Aug 26 08:50:56 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:50:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0162bff-65f9-448e-9744-0d52eb0fbfe9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:56 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2360de5d-f6ed-4608-a7fa-4b5b80e6729a]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:50:56 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-555b79cb-cea0-4fb8-b402-018a58f470c7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:50:56 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-555b79cb-cea0-4fb8-b402-018a58f470c7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:50:56 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-555b79cb-cea0-4fb8-b402-018a58f470c7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] <== disconnect_volume: return (289ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:50:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-555b79cb-cea0-4fb8-b402-018a58f470c7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:50:56 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:50:56 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:50:56 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:50:56 user nova-compute[73104]: DEBUG nova.objects.instance [None req-555b79cb-cea0-4fb8-b402-018a58f470c7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lazy-loading 'flavor' on Instance uuid b7f6e347-c1f3-4f56-86c4-3b28c4729964 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:50:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-555b79cb-cea0-4fb8-b402-018a58f470c7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.602s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:50:57 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:50:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:50:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:50:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:50:57 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 08:50:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:57 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:50:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:58 user nova-compute[73104]: INFO nova.compute.manager [None req-ee5b6223-d5d8-4dc2-9b6b-06728b0d27f7 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Unrescuing
Aug 26 08:50:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ee5b6223-d5d8-4dc2-9b6b-06728b0d27f7 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Acquiring lock "refresh_cache-02665c70-cf75-44ba-9d90-eb9e5f12e0b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:50:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ee5b6223-d5d8-4dc2-9b6b-06728b0d27f7 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Acquired lock "refresh_cache-02665c70-cf75-44ba-9d90-eb9e5f12e0b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:50:58 user nova-compute[73104]: DEBUG nova.network.neutron [None req-ee5b6223-d5d8-4dc2-9b6b-06728b0d27f7 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:50:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:58 user nova-compute[73104]: DEBUG nova.network.neutron [None req-ee5b6223-d5d8-4dc2-9b6b-06728b0d27f7 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Updating instance_info_cache with network_info: [{"id": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "address": "fa:16:3e:d9:91:54", "network": {"id": "d09a6d6b-0c92-4bc3-a691-0aa3911d756e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1480336812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "994053e8d737440f8cb22f048a3c1873", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4b7f02-03", "ovs_interfaceid": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:50:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ddeefec-ed4f-4fec-8d1c-02a2ddf65023/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ee5b6223-d5d8-4dc2-9b6b-06728b0d27f7 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Releasing lock "refresh_cache-02665c70-cf75-44ba-9d90-eb9e5f12e0b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:50:58 user nova-compute[73104]: DEBUG nova.objects.instance [None req-ee5b6223-d5d8-4dc2-9b6b-06728b0d27f7 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lazy-loading 'flavor' on Instance uuid 02665c70-cf75-44ba-9d90-eb9e5f12e0b7 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:50:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ddeefec-ed4f-4fec-8d1c-02a2ddf65023/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ddeefec-ed4f-4fec-8d1c-02a2ddf65023/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:50:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ddeefec-ed4f-4fec-8d1c-02a2ddf65023/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:59 user nova-compute[73104]: DEBUG nova.compute.manager [req-12cf7cdd-d5ed-4ced-b950-fb906cd83a3c req-13cf7775-6407-48a8-924e-c8a5e129b569 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received event network-vif-unplugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:50:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-12cf7cdd-d5ed-4ced-b950-fb906cd83a3c req-13cf7775-6407-48a8-924e-c8a5e129b569 service nova] Acquiring lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:50:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-12cf7cdd-d5ed-4ced-b950-fb906cd83a3c req-13cf7775-6407-48a8-924e-c8a5e129b569 service nova] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:50:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-12cf7cdd-d5ed-4ced-b950-fb906cd83a3c req-13cf7775-6407-48a8-924e-c8a5e129b569 service nova] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:50:59 user nova-compute[73104]: DEBUG nova.compute.manager [req-12cf7cdd-d5ed-4ced-b950-fb906cd83a3c req-13cf7775-6407-48a8-924e-c8a5e129b569 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] No waiting events found dispatching network-vif-unplugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:50:59 user nova-compute[73104]: WARNING nova.compute.manager [req-12cf7cdd-d5ed-4ced-b950-fb906cd83a3c req-13cf7775-6407-48a8-924e-c8a5e129b569 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received unexpected event network-vif-unplugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 for instance with vm_state rescued and task_state unrescuing.
Aug 26 08:50:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:59 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Instance destroyed successfully.
Aug 26 08:50:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:59 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:50:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:50:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:50:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:03 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Removed pending event for 02665c70-cf75-44ba-9d90-eb9e5f12e0b7 due to event {{(pid=73104) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 08:51:03 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039863.1555436, 02665c70-cf75-44ba-9d90-eb9e5f12e0b7 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:51:03 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] VM Resumed (Lifecycle Event)
Aug 26 08:51:03 user nova-compute[73104]: DEBUG nova.compute.manager [req-4642e7b1-c41c-43f3-9ec7-477573a76b0a req-12c2d81c-4b70-4c9c-9875-b5f8869fc50e service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received event network-changed-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:51:03 user nova-compute[73104]: DEBUG nova.compute.manager [req-4642e7b1-c41c-43f3-9ec7-477573a76b0a req-12c2d81c-4b70-4c9c-9875-b5f8869fc50e service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Refreshing instance network info cache due to event network-changed-af4b7f02-03f5-492b-9d27-4d7e5523b423. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:51:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4642e7b1-c41c-43f3-9ec7-477573a76b0a req-12c2d81c-4b70-4c9c-9875-b5f8869fc50e service nova] Acquiring lock "refresh_cache-02665c70-cf75-44ba-9d90-eb9e5f12e0b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:51:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4642e7b1-c41c-43f3-9ec7-477573a76b0a req-12c2d81c-4b70-4c9c-9875-b5f8869fc50e service nova] Acquired lock "refresh_cache-02665c70-cf75-44ba-9d90-eb9e5f12e0b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:51:03 user nova-compute[73104]: DEBUG nova.network.neutron [req-4642e7b1-c41c-43f3-9ec7-477573a76b0a req-12c2d81c-4b70-4c9c-9875-b5f8869fc50e service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Refreshing network info cache for port af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:51:03 user nova-compute[73104]: DEBUG nova.compute.manager [req-4bc39b4a-101d-44d5-a298-291d796dc8fe req-0540e5e3-ee08-401e-91d1-f4e631211611 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received event network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:51:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4bc39b4a-101d-44d5-a298-291d796dc8fe req-0540e5e3-ee08-401e-91d1-f4e631211611 service nova] Acquiring lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:51:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4bc39b4a-101d-44d5-a298-291d796dc8fe req-0540e5e3-ee08-401e-91d1-f4e631211611 service nova] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:51:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4bc39b4a-101d-44d5-a298-291d796dc8fe req-0540e5e3-ee08-401e-91d1-f4e631211611 service nova] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:51:03 user nova-compute[73104]: DEBUG nova.compute.manager [req-4bc39b4a-101d-44d5-a298-291d796dc8fe req-0540e5e3-ee08-401e-91d1-f4e631211611 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] No waiting events found dispatching network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:51:03 user nova-compute[73104]: WARNING nova.compute.manager [req-4bc39b4a-101d-44d5-a298-291d796dc8fe req-0540e5e3-ee08-401e-91d1-f4e631211611 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received unexpected event network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 for instance with vm_state rescued and task_state unrescuing.
Aug 26 08:51:03 user nova-compute[73104]: DEBUG nova.compute.manager [req-4bc39b4a-101d-44d5-a298-291d796dc8fe req-0540e5e3-ee08-401e-91d1-f4e631211611 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received event network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:51:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4bc39b4a-101d-44d5-a298-291d796dc8fe req-0540e5e3-ee08-401e-91d1-f4e631211611 service nova] Acquiring lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:51:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4bc39b4a-101d-44d5-a298-291d796dc8fe req-0540e5e3-ee08-401e-91d1-f4e631211611 service nova] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:51:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4bc39b4a-101d-44d5-a298-291d796dc8fe req-0540e5e3-ee08-401e-91d1-f4e631211611 service nova] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:51:03 user nova-compute[73104]: DEBUG nova.compute.manager [req-4bc39b4a-101d-44d5-a298-291d796dc8fe req-0540e5e3-ee08-401e-91d1-f4e631211611 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] No waiting events found dispatching network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:51:03 user nova-compute[73104]: WARNING nova.compute.manager [req-4bc39b4a-101d-44d5-a298-291d796dc8fe req-0540e5e3-ee08-401e-91d1-f4e631211611 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received unexpected event network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 for instance with vm_state rescued and task_state unrescuing.
Aug 26 08:51:03 user nova-compute[73104]: DEBUG nova.compute.manager [None req-ee5b6223-d5d8-4dc2-9b6b-06728b0d27f7 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:51:03 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:51:03 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:51:03 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:51:03 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:51:03 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=7827MB free_disk=24.07056427001953GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 08:51:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:51:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:51:03 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 08:51:03 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039863.1564786, 02665c70-cf75-44ba-9d90-eb9e5f12e0b7 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:51:03 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] VM Started (Lifecycle Event)
Aug 26 08:51:03 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:51:03 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:51:03 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance b5e1f82c-5675-4c37-8ba2-44e6a341a576 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:51:03 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 3cf85d2f-de0d-4e9b-a534-98c799ae8db9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:51:03 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 02665c70-cf75-44ba-9d90-eb9e5f12e0b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:51:03 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance b7f6e347-c1f3-4f56-86c4-3b28c4729964 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:51:03 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance bef1e493-6b2c-4688-98c2-647261feb571 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:51:03 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:51:03 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance e7ac6a94-05a2-4b11-a541-26b1d1dae070 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:51:03 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 08:51:03 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 08:51:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:04 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:51:04 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:51:04 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 08:51:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.600s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:51:04 user nova-compute[73104]: DEBUG nova.network.neutron [req-4642e7b1-c41c-43f3-9ec7-477573a76b0a req-12c2d81c-4b70-4c9c-9875-b5f8869fc50e service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Updated VIF entry in instance network info cache for port af4b7f02-03f5-492b-9d27-4d7e5523b423. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:51:04 user nova-compute[73104]: DEBUG nova.network.neutron [req-4642e7b1-c41c-43f3-9ec7-477573a76b0a req-12c2d81c-4b70-4c9c-9875-b5f8869fc50e service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Updating instance_info_cache with network_info: [{"id": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "address": "fa:16:3e:d9:91:54", "network": {"id": "d09a6d6b-0c92-4bc3-a691-0aa3911d756e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1480336812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "994053e8d737440f8cb22f048a3c1873", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4b7f02-03", "ovs_interfaceid": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:51:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4642e7b1-c41c-43f3-9ec7-477573a76b0a req-12c2d81c-4b70-4c9c-9875-b5f8869fc50e service nova] Releasing lock "refresh_cache-02665c70-cf75-44ba-9d90-eb9e5f12e0b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:51:04 user nova-compute[73104]: DEBUG nova.compute.manager [req-4642e7b1-c41c-43f3-9ec7-477573a76b0a req-12c2d81c-4b70-4c9c-9875-b5f8869fc50e service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received event network-changed-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:51:04 user nova-compute[73104]: DEBUG nova.compute.manager [req-4642e7b1-c41c-43f3-9ec7-477573a76b0a req-12c2d81c-4b70-4c9c-9875-b5f8869fc50e service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Refreshing instance network info cache due to event network-changed-af4b7f02-03f5-492b-9d27-4d7e5523b423. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:51:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4642e7b1-c41c-43f3-9ec7-477573a76b0a req-12c2d81c-4b70-4c9c-9875-b5f8869fc50e service nova] Acquiring lock "refresh_cache-02665c70-cf75-44ba-9d90-eb9e5f12e0b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:51:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4642e7b1-c41c-43f3-9ec7-477573a76b0a req-12c2d81c-4b70-4c9c-9875-b5f8869fc50e service nova] Acquired lock "refresh_cache-02665c70-cf75-44ba-9d90-eb9e5f12e0b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:51:04 user nova-compute[73104]: DEBUG nova.network.neutron [req-4642e7b1-c41c-43f3-9ec7-477573a76b0a req-12c2d81c-4b70-4c9c-9875-b5f8869fc50e service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Refreshing network info cache for port af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:51:04 user nova-compute[73104]: DEBUG nova.network.neutron [req-4642e7b1-c41c-43f3-9ec7-477573a76b0a req-12c2d81c-4b70-4c9c-9875-b5f8869fc50e service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Updated VIF entry in instance network info cache for port af4b7f02-03f5-492b-9d27-4d7e5523b423. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:51:04 user nova-compute[73104]: DEBUG nova.network.neutron [req-4642e7b1-c41c-43f3-9ec7-477573a76b0a req-12c2d81c-4b70-4c9c-9875-b5f8869fc50e service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Updating instance_info_cache with network_info: [{"id": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "address": "fa:16:3e:d9:91:54", "network": {"id": "d09a6d6b-0c92-4bc3-a691-0aa3911d756e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1480336812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "994053e8d737440f8cb22f048a3c1873", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4b7f02-03", "ovs_interfaceid": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:51:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4642e7b1-c41c-43f3-9ec7-477573a76b0a req-12c2d81c-4b70-4c9c-9875-b5f8869fc50e service nova] Releasing lock "refresh_cache-02665c70-cf75-44ba-9d90-eb9e5f12e0b7" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:51:04 user nova-compute[73104]: DEBUG nova.compute.manager [req-4642e7b1-c41c-43f3-9ec7-477573a76b0a req-12c2d81c-4b70-4c9c-9875-b5f8869fc50e service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received event network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:51:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4642e7b1-c41c-43f3-9ec7-477573a76b0a req-12c2d81c-4b70-4c9c-9875-b5f8869fc50e service nova] Acquiring lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:51:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4642e7b1-c41c-43f3-9ec7-477573a76b0a req-12c2d81c-4b70-4c9c-9875-b5f8869fc50e service nova] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:51:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4642e7b1-c41c-43f3-9ec7-477573a76b0a req-12c2d81c-4b70-4c9c-9875-b5f8869fc50e service nova] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:51:04 user nova-compute[73104]: DEBUG nova.compute.manager [req-4642e7b1-c41c-43f3-9ec7-477573a76b0a req-12c2d81c-4b70-4c9c-9875-b5f8869fc50e service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] No waiting events found dispatching network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:51:04 user nova-compute[73104]: WARNING nova.compute.manager [req-4642e7b1-c41c-43f3-9ec7-477573a76b0a req-12c2d81c-4b70-4c9c-9875-b5f8869fc50e service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received unexpected event network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 for instance with vm_state rescued and task_state unrescuing.
Aug 26 08:51:05 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:51:05 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:51:05 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 08:51:05 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Rebuilding the list of instances to heal {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 08:51:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-b5e1f82c-5675-4c37-8ba2-44e6a341a576" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:51:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-b5e1f82c-5675-4c37-8ba2-44e6a341a576" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:51:05 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 08:51:05 user nova-compute[73104]: DEBUG nova.objects.instance [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lazy-loading 'info_cache' on Instance uuid b5e1f82c-5675-4c37-8ba2-44e6a341a576 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:51:06 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Updating instance_info_cache with network_info: [{"id": "3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96", "address": "fa:16:3e:c0:56:86", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3913bdf7-1f", "ovs_interfaceid": "3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:51:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-b5e1f82c-5675-4c37-8ba2-44e6a341a576" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:51:06 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 08:51:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-dc8ecbee-94c1-46e7-a9fc-2f1549caf964 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "5ddeefec-ed4f-4fec-8d1c-02a2ddf65023" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:51:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-dc8ecbee-94c1-46e7-a9fc-2f1549caf964 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "5ddeefec-ed4f-4fec-8d1c-02a2ddf65023" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:51:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-dc8ecbee-94c1-46e7-a9fc-2f1549caf964 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "5ddeefec-ed4f-4fec-8d1c-02a2ddf65023-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:51:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-dc8ecbee-94c1-46e7-a9fc-2f1549caf964 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "5ddeefec-ed4f-4fec-8d1c-02a2ddf65023-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:51:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-dc8ecbee-94c1-46e7-a9fc-2f1549caf964 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "5ddeefec-ed4f-4fec-8d1c-02a2ddf65023-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:51:23 user nova-compute[73104]: INFO nova.compute.manager [None req-dc8ecbee-94c1-46e7-a9fc-2f1549caf964 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Terminating instance
Aug 26 08:51:23 user nova-compute[73104]: DEBUG nova.compute.manager [None req-dc8ecbee-94c1-46e7-a9fc-2f1549caf964 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 08:51:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-c8cfa5d2-a373-4ccc-b7f2-1a04d393a085 req-ef5854a4-514c-4279-ab17-6fd0cabf823c service nova] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Received event network-vif-unplugged-06ff3140-31c9-478c-9d4e-c2a4ee346df4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:51:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c8cfa5d2-a373-4ccc-b7f2-1a04d393a085 req-ef5854a4-514c-4279-ab17-6fd0cabf823c service nova] Acquiring lock "5ddeefec-ed4f-4fec-8d1c-02a2ddf65023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:51:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c8cfa5d2-a373-4ccc-b7f2-1a04d393a085 req-ef5854a4-514c-4279-ab17-6fd0cabf823c service nova] Lock "5ddeefec-ed4f-4fec-8d1c-02a2ddf65023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:51:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c8cfa5d2-a373-4ccc-b7f2-1a04d393a085 req-ef5854a4-514c-4279-ab17-6fd0cabf823c service nova] Lock "5ddeefec-ed4f-4fec-8d1c-02a2ddf65023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:51:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-c8cfa5d2-a373-4ccc-b7f2-1a04d393a085 req-ef5854a4-514c-4279-ab17-6fd0cabf823c service nova] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] No waiting events found dispatching network-vif-unplugged-06ff3140-31c9-478c-9d4e-c2a4ee346df4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:51:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-c8cfa5d2-a373-4ccc-b7f2-1a04d393a085 req-ef5854a4-514c-4279-ab17-6fd0cabf823c service nova] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Received event network-vif-unplugged-06ff3140-31c9-478c-9d4e-c2a4ee346df4 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:51:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:23 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Instance destroyed successfully.
Aug 26 08:51:23 user nova-compute[73104]: DEBUG nova.objects.instance [None req-dc8ecbee-94c1-46e7-a9fc-2f1549caf964 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lazy-loading 'resources' on Instance uuid 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:51:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-dc8ecbee-94c1-46e7-a9fc-2f1549caf964 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:48:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1947806886',display_name='tempest-AttachVolumeNegativeTest-server-1947806886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1947806886',id=26,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3zEFdjwtyy3z3V9yFt/ad6c0VMW1+BT5tG/K8PStg58n0jMcAMvcGQUArDzPCM/e971SPyjfjEKpdiZRBzjCYz/LB4F24ZZaHnw5l+84MLmZvyLQJWhy6mfupasy1WWQ==',key_name='tempest-keypair-1404848892',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:48:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ad68e5623014e2fb3f10ba92d388291',ramdisk_id='',reservation_id='r-20uwd4qd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1286694855',owner_user_name='tempest-AttachVolumeNegativeTest-1286694855-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:48:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='062587ed00ae457889f884346c99e11b',uuid=5ddeefec-ed4f-4fec-8d1c-02a2ddf65023,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06ff3140-31c9-478c-9d4e-c2a4ee346df4", "address": "fa:16:3e:e2:2f:c2", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06ff3140-31", "ovs_interfaceid": "06ff3140-31c9-478c-9d4e-c2a4ee346df4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:51:23 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-dc8ecbee-94c1-46e7-a9fc-2f1549caf964 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Converting VIF {"id": "06ff3140-31c9-478c-9d4e-c2a4ee346df4", "address": "fa:16:3e:e2:2f:c2", "network": {"id": "ea6c6ce0-85a4-40db-96e2-ca078887ab66", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1578316454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad68e5623014e2fb3f10ba92d388291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06ff3140-31", "ovs_interfaceid": "06ff3140-31c9-478c-9d4e-c2a4ee346df4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:51:23 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-dc8ecbee-94c1-46e7-a9fc-2f1549caf964 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:2f:c2,bridge_name='br-int',has_traffic_filtering=True,id=06ff3140-31c9-478c-9d4e-c2a4ee346df4,network=Network(ea6c6ce0-85a4-40db-96e2-ca078887ab66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06ff3140-31') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:51:23 user nova-compute[73104]: DEBUG os_vif [None req-dc8ecbee-94c1-46e7-a9fc-2f1549caf964 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:2f:c2,bridge_name='br-int',has_traffic_filtering=True,id=06ff3140-31c9-478c-9d4e-c2a4ee346df4,network=Network(ea6c6ce0-85a4-40db-96e2-ca078887ab66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06ff3140-31') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:51:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06ff3140-31, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:51:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:51:23 user nova-compute[73104]: INFO os_vif [None req-dc8ecbee-94c1-46e7-a9fc-2f1549caf964 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:2f:c2,bridge_name='br-int',has_traffic_filtering=True,id=06ff3140-31c9-478c-9d4e-c2a4ee346df4,network=Network(ea6c6ce0-85a4-40db-96e2-ca078887ab66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06ff3140-31')
Aug 26 08:51:23 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-dc8ecbee-94c1-46e7-a9fc-2f1549caf964 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Deleting instance files /opt/stack/data/nova/instances/5ddeefec-ed4f-4fec-8d1c-02a2ddf65023_del
Aug 26 08:51:23 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-dc8ecbee-94c1-46e7-a9fc-2f1549caf964 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Deletion of /opt/stack/data/nova/instances/5ddeefec-ed4f-4fec-8d1c-02a2ddf65023_del complete
Aug 26 08:51:23 user nova-compute[73104]: INFO nova.compute.manager [None req-dc8ecbee-94c1-46e7-a9fc-2f1549caf964 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 26 08:51:23 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-dc8ecbee-94c1-46e7-a9fc-2f1549caf964 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 08:51:23 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 08:51:23 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 08:51:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:25 user nova-compute[73104]: DEBUG nova.compute.manager [req-aefaec3e-5d7e-4979-a8e4-5e1a43e00151 req-3f51f0ba-1d0d-4cd3-9bf2-4bc99111f440 service nova] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Received event network-vif-plugged-06ff3140-31c9-478c-9d4e-c2a4ee346df4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:51:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-aefaec3e-5d7e-4979-a8e4-5e1a43e00151 req-3f51f0ba-1d0d-4cd3-9bf2-4bc99111f440 service nova] Acquiring lock "5ddeefec-ed4f-4fec-8d1c-02a2ddf65023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:51:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-aefaec3e-5d7e-4979-a8e4-5e1a43e00151 req-3f51f0ba-1d0d-4cd3-9bf2-4bc99111f440 service nova] Lock "5ddeefec-ed4f-4fec-8d1c-02a2ddf65023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:51:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-aefaec3e-5d7e-4979-a8e4-5e1a43e00151 req-3f51f0ba-1d0d-4cd3-9bf2-4bc99111f440 service nova] Lock "5ddeefec-ed4f-4fec-8d1c-02a2ddf65023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:51:25 user nova-compute[73104]: DEBUG nova.compute.manager [req-aefaec3e-5d7e-4979-a8e4-5e1a43e00151 req-3f51f0ba-1d0d-4cd3-9bf2-4bc99111f440 service nova] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] No waiting events found dispatching network-vif-plugged-06ff3140-31c9-478c-9d4e-c2a4ee346df4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:51:25 user nova-compute[73104]: WARNING nova.compute.manager [req-aefaec3e-5d7e-4979-a8e4-5e1a43e00151 req-3f51f0ba-1d0d-4cd3-9bf2-4bc99111f440 service nova] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Received unexpected event network-vif-plugged-06ff3140-31c9-478c-9d4e-c2a4ee346df4 for instance with vm_state active and task_state deleting.
Aug 26 08:51:25 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:51:25 user nova-compute[73104]: DEBUG nova.compute.manager [req-6f46e643-cd60-417b-8513-b695d738568c req-1d6b5829-5a28-4105-9d6b-0d1fc7d3bee2 service nova] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Received event network-vif-deleted-06ff3140-31c9-478c-9d4e-c2a4ee346df4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:51:25 user nova-compute[73104]: INFO nova.compute.manager [req-6f46e643-cd60-417b-8513-b695d738568c req-1d6b5829-5a28-4105-9d6b-0d1fc7d3bee2 service nova] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Neutron deleted interface 06ff3140-31c9-478c-9d4e-c2a4ee346df4; detaching it from the instance and deleting it from the info cache
Aug 26 08:51:25 user nova-compute[73104]: DEBUG nova.network.neutron [req-6f46e643-cd60-417b-8513-b695d738568c req-1d6b5829-5a28-4105-9d6b-0d1fc7d3bee2 service nova] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:51:25 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Took 1.68 seconds to deallocate network for instance.
Aug 26 08:51:25 user nova-compute[73104]: DEBUG nova.compute.manager [req-6f46e643-cd60-417b-8513-b695d738568c req-1d6b5829-5a28-4105-9d6b-0d1fc7d3bee2 service nova] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Detach interface failed, port_id=06ff3140-31c9-478c-9d4e-c2a4ee346df4, reason: Instance 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023 could not be found. {{(pid=73104) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 08:51:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-dc8ecbee-94c1-46e7-a9fc-2f1549caf964 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:51:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-dc8ecbee-94c1-46e7-a9fc-2f1549caf964 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:51:25 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-dc8ecbee-94c1-46e7-a9fc-2f1549caf964 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:51:25 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-dc8ecbee-94c1-46e7-a9fc-2f1549caf964 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:51:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-dc8ecbee-94c1-46e7-a9fc-2f1549caf964 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:51:26 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-dc8ecbee-94c1-46e7-a9fc-2f1549caf964 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Deleted allocations for instance 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023
Aug 26 08:51:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-dc8ecbee-94c1-46e7-a9fc-2f1549caf964 tempest-AttachVolumeNegativeTest-1286694855 tempest-AttachVolumeNegativeTest-1286694855-project-member] Lock "5ddeefec-ed4f-4fec-8d1c-02a2ddf65023" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.036s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:51:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ca73d257-c06c-4841-a42c-ecf02dab8baf tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Acquiring lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:51:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ca73d257-c06c-4841-a42c-ecf02dab8baf tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:51:31 user nova-compute[73104]: INFO nova.compute.manager [None req-ca73d257-c06c-4841-a42c-ecf02dab8baf tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Detaching volume e30bc0fc-d957-4e49-83a6-c3db0a223e1b
Aug 26 08:51:31 user nova-compute[73104]: INFO nova.virt.block_device [None req-ca73d257-c06c-4841-a42c-ecf02dab8baf tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Attempting to driver detach volume e30bc0fc-d957-4e49-83a6-c3db0a223e1b from mountpoint /dev/vdb
Aug 26 08:51:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ca73d257-c06c-4841-a42c-ecf02dab8baf tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Attempting to detach device vdb from instance 02665c70-cf75-44ba-9d90-eb9e5f12e0b7 from the persistent domain config. {{(pid=73104) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 08:51:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-ca73d257-c06c-4841-a42c-ecf02dab8baf tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:51:31 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:51:31 user nova-compute[73104]:   <source dev="/dev/sdd"/>
Aug 26 08:51:31 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:51:31 user nova-compute[73104]:   <serial>e30bc0fc-d957-4e49-83a6-c3db0a223e1b</serial>
Aug 26 08:51:31 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 08:51:31 user nova-compute[73104]: </disk>
Aug 26 08:51:31 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:51:31 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-ca73d257-c06c-4841-a42c-ecf02dab8baf tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Successfully detached device vdb from instance 02665c70-cf75-44ba-9d90-eb9e5f12e0b7 from the persistent domain config.
Aug 26 08:51:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ca73d257-c06c-4841-a42c-ecf02dab8baf tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 02665c70-cf75-44ba-9d90-eb9e5f12e0b7 from the live domain config. {{(pid=73104) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 08:51:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-ca73d257-c06c-4841-a42c-ecf02dab8baf tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:51:31 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:51:31 user nova-compute[73104]:   <source dev="/dev/sdd"/>
Aug 26 08:51:31 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:51:31 user nova-compute[73104]:   <serial>e30bc0fc-d957-4e49-83a6-c3db0a223e1b</serial>
Aug 26 08:51:31 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 08:51:31 user nova-compute[73104]: </disk>
Aug 26 08:51:31 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:51:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Received event <DeviceRemovedEvent: 1693039891.8585534, 02665c70-cf75-44ba-9d90-eb9e5f12e0b7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73104) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 08:51:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ca73d257-c06c-4841-a42c-ecf02dab8baf tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 02665c70-cf75-44ba-9d90-eb9e5f12e0b7 {{(pid=73104) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 08:51:31 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-ca73d257-c06c-4841-a42c-ecf02dab8baf tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Successfully detached device vdb from instance 02665c70-cf75-44ba-9d90-eb9e5f12e0b7 from the live domain config.
Aug 26 08:51:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca73d257-c06c-4841-a42c-ecf02dab8baf tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:51:31 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca73d257-c06c-4841-a42c-ecf02dab8baf tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UMlRKZVu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:51:31 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-ca73d257-c06c-4841-a42c-ecf02dab8baf tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:51:31 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-ca73d257-c06c-4841-a42c-ecf02dab8baf tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:51:31 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-ca73d257-c06c-4841-a42c-ecf02dab8baf tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:51:31 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca73d257-c06c-4841-a42c-ecf02dab8baf tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:51:31 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:31 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:31 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[653c404d-601d-432b-9dda-45594e36e843]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:51:31 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:31 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:31 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbec83f2-adcd-4416-b509-1fadad548c12]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:51:31 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca73d257-c06c-4841-a42c-ecf02dab8baf tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:51:31 user nova-compute[73104]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b (non-flash)
Aug 26 08:51:31 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:51:31 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca73d257-c06c-4841-a42c-ecf02dab8baf tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:51:31 user nova-compute[73104]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b (non-flash)
Aug 26 08:51:31 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:51:31 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca73d257-c06c-4841-a42c-ecf02dab8baf tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0c46136d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b'): ({'sdd'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:51:31 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ca73d257-c06c-4841-a42c-ecf02dab8baf tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Removing single pathed devices sdd {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:51:31 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:31 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:31 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3785f513-45e8-48a6-9eac-4fd0bedba908]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:51:31 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:31 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:31 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de0063c-e5c5-4c70-9bfc-25299f6afef2]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:51:31 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ca73d257-c06c-4841-a42c-ecf02dab8baf tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Flushing IO for device /dev/sdd {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:51:31 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1fee80-a74b-4bc5-91aa-443cdf2968b2]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:51:32 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ca73d257-c06c-4841-a42c-ecf02dab8baf tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:51:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8210bd7e-a8fa-4248-83fe-a207306f9e72]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:51:32 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ca73d257-c06c-4841-a42c-ecf02dab8baf tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:51:32 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ca73d257-c06c-4841-a42c-ecf02dab8baf tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] SCSI volumes sdd have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:51:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca73d257-c06c-4841-a42c-ecf02dab8baf tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:51:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[046bb3df-0ed6-433f-b5ff-a047a1c02274]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:51:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca73d257-c06c-4841-a42c-ecf02dab8baf tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:51:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1844fa7-8176-4c41-b550-928eabac8f1f]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:51:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca73d257-c06c-4841-a42c-ecf02dab8baf tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b, portal: 172.16.0.220,3260]
Aug 26 08:51:32 user nova-compute[73104]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b, portal: 172.16.0.220,3260] successful.
Aug 26 08:51:32 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:51:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e30bc0fc-d957-4e49-83a6-c3db0a223e1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa97d90d-186e-4383-936b-50d317fa6636]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:51:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca73d257-c06c-4841-a42c-ecf02dab8baf tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:51:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-ca73d257-c06c-4841-a42c-ecf02dab8baf tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:51:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca73d257-c06c-4841-a42c-ecf02dab8baf tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] <== disconnect_volume: return (301ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:51:32 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca73d257-c06c-4841-a42c-ecf02dab8baf tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:51:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:33 user nova-compute[73104]: DEBUG nova.objects.instance [None req-ca73d257-c06c-4841-a42c-ecf02dab8baf tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lazy-loading 'flavor' on Instance uuid 02665c70-cf75-44ba-9d90-eb9e5f12e0b7 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:51:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ca73d257-c06c-4841-a42c-ecf02dab8baf tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.856s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:51:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:36 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "33048996-d559-4b3c-9de9-39bb176c3ec9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:51:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:51:36 user nova-compute[73104]: DEBUG nova.compute.manager [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:51:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:51:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:51:36 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:51:36 user nova-compute[73104]: INFO nova.compute.claims [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Claim successful on node user
Aug 26 08:51:37 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:51:37 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:51:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:51:37 user nova-compute[73104]: DEBUG nova.compute.manager [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:51:37 user nova-compute[73104]: DEBUG nova.compute.manager [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:51:37 user nova-compute[73104]: DEBUG nova.network.neutron [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:51:37 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:51:37 user nova-compute[73104]: DEBUG nova.compute.manager [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:51:37 user nova-compute[73104]: DEBUG nova.policy [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4191d8a10ac54389b6b633701f6e6c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd101cd585e604a1881c981c946f70849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:51:37 user nova-compute[73104]: DEBUG nova.compute.manager [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:51:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:51:37 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Creating image(s)
Aug 26 08:51:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "/opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:51:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "/opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:51:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "/opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:51:37 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:37 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.224s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:51:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:51:37 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:37 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.223s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:37 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk 1073741824" returned: 0 in 0.054s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:51:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.182s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:38 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 08:51:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:38 user nova-compute[73104]: DEBUG nova.network.neutron [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Successfully created port: 4c1b906e-2c49-4642-9183-06292be46de4 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:51:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:38 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Cannot resize image /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 08:51:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:51:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Ensure instance console log exists: /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:51:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:51:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:51:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:51:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:51:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:51:38 user nova-compute[73104]: DEBUG nova.objects.instance [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lazy-loading 'flavor' on Instance uuid e7ac6a94-05a2-4b11-a541-26b1d1dae070 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:51:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:51:38 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693039883.8513563, 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:51:38 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] VM Stopped (Lifecycle Event)
Aug 26 08:51:38 user nova-compute[73104]: DEBUG nova.compute.manager [None req-5670bab2-3051-430f-a857-7d69d0d7d2d7 None None] [instance: 5ddeefec-ed4f-4fec-8d1c-02a2ddf65023] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:51:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:51:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:51:38 user nova-compute[73104]: INFO nova.compute.manager [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Attaching volume d97a6724-3b89-42f0-9ba7-ee0904e9993e to /dev/vdb
Aug 26 08:51:38 user nova-compute[73104]: DEBUG os_brick.utils [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:51:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:39 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda415b2-eb7e-4147-8f7f-6ae517c6f841]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:51:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:39 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0489b662-a261-40db-8e32-715fa05c4ef7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:51:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:39 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c688d0ba-0264-4142-bdc5-4087a001b4a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:51:39 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42d1fdf-b6a0-4f93-a037-256eab31dec0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:51:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:51:39 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:51:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:39 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:51:39 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:51:39 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[becf4914-2b72-46c3-8a5f-9d2ec3f6cb95]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:51:39 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:51:39 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:51:39 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:51:39 user nova-compute[73104]: DEBUG os_brick.utils [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:51:39 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Updating existing volume attachment record: bcdb6e84-46ab-499b-827f-8a8320a1ac15 {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 08:51:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:39 user nova-compute[73104]: DEBUG nova.network.neutron [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Successfully updated port: 4c1b906e-2c49-4642-9183-06292be46de4 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:51:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "refresh_cache-33048996-d559-4b3c-9de9-39bb176c3ec9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:51:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquired lock "refresh_cache-33048996-d559-4b3c-9de9-39bb176c3ec9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:51:39 user nova-compute[73104]: DEBUG nova.network.neutron [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:51:39 user nova-compute[73104]: DEBUG nova.compute.manager [req-2a296ead-e723-46f0-97fc-0a1eeae686fa req-658ffd43-1a45-4405-83cc-0958d0ba88ba service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Received event network-changed-4c1b906e-2c49-4642-9183-06292be46de4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:51:39 user nova-compute[73104]: DEBUG nova.compute.manager [req-2a296ead-e723-46f0-97fc-0a1eeae686fa req-658ffd43-1a45-4405-83cc-0958d0ba88ba service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Refreshing instance network info cache due to event network-changed-4c1b906e-2c49-4642-9183-06292be46de4. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:51:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2a296ead-e723-46f0-97fc-0a1eeae686fa req-658ffd43-1a45-4405-83cc-0958d0ba88ba service nova] Acquiring lock "refresh_cache-33048996-d559-4b3c-9de9-39bb176c3ec9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:51:39 user nova-compute[73104]: DEBUG nova.network.neutron [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG nova.network.neutron [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Updating instance_info_cache with network_info: [{"id": "4c1b906e-2c49-4642-9183-06292be46de4", "address": "fa:16:3e:7e:7d:6c", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1b906e-2c", "ovs_interfaceid": "4c1b906e-2c49-4642-9183-06292be46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Releasing lock "refresh_cache-33048996-d559-4b3c-9de9-39bb176c3ec9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG nova.compute.manager [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Instance network_info: |[{"id": "4c1b906e-2c49-4642-9183-06292be46de4", "address": "fa:16:3e:7e:7d:6c", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1b906e-2c", "ovs_interfaceid": "4c1b906e-2c49-4642-9183-06292be46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2a296ead-e723-46f0-97fc-0a1eeae686fa req-658ffd43-1a45-4405-83cc-0958d0ba88ba service nova] Acquired lock "refresh_cache-33048996-d559-4b3c-9de9-39bb176c3ec9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG nova.network.neutron [req-2a296ead-e723-46f0-97fc-0a1eeae686fa req-658ffd43-1a45-4405-83cc-0958d0ba88ba service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Refreshing network info cache for port 4c1b906e-2c49-4642-9183-06292be46de4 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Start _get_guest_xml network_info=[{"id": "4c1b906e-2c49-4642-9183-06292be46de4", "address": "fa:16:3e:7e:7d:6c", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1b906e-2c", "ovs_interfaceid": "4c1b906e-2c49-4642-9183-06292be46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:51:40 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:51:40 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:51:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:51:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1372648210',display_name='tempest-AttachVolumeTestJSON-server-1372648210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1372648210',id=28,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3ruAnm8wJOtkM5YpWf3zux9ipeTcCrtMwmPCNqS87cjfXmG7Jo5HHNQzK7O8JS5TTbG/bKm+6qFm/BZVW6gKLbnDGC/QXgHLRc1/aNdWcQz6PVhir0ZiiZKQ1S1B0vIg==',key_name='tempest-keypair-1147096816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d101cd585e604a1881c981c946f70849',ramdisk_id='',reservation_id='r-hfyybj1j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-684994869',owner_user_name='tempest-AttachVolumeTestJSON-684994869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:51:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4191d8a10ac54389b6b633701f6e6c77',uuid=33048996-d559-4b3c-9de9-39bb176c3ec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c1b906e-2c49-4642-9183-06292be46de4", "address": "fa:16:3e:7e:7d:6c", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1b906e-2c", "ovs_interfaceid": "4c1b906e-2c49-4642-9183-06292be46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Converting VIF {"id": "4c1b906e-2c49-4642-9183-06292be46de4", "address": "fa:16:3e:7e:7d:6c", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1b906e-2c", "ovs_interfaceid": "4c1b906e-2c49-4642-9183-06292be46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7d:6c,bridge_name='br-int',has_traffic_filtering=True,id=4c1b906e-2c49-4642-9183-06292be46de4,network=Network(e6ddfc91-c02c-429c-90ff-aaad54b98cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1b906e-2c') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG nova.objects.instance [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lazy-loading 'pci_devices' on Instance uuid 33048996-d559-4b3c-9de9-39bb176c3ec9 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:51:40 user nova-compute[73104]:   <uuid>33048996-d559-4b3c-9de9-39bb176c3ec9</uuid>
Aug 26 08:51:40 user nova-compute[73104]:   <name>instance-0000001c</name>
Aug 26 08:51:40 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:51:40 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:51:40 user nova-compute[73104]:   <metadata>
Aug 26 08:51:40 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:51:40 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:51:40 user nova-compute[73104]:       <nova:name>tempest-AttachVolumeTestJSON-server-1372648210</nova:name>
Aug 26 08:51:40 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:51:40</nova:creationTime>
Aug 26 08:51:40 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:51:40 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:51:40 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:51:40 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:51:40 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:51:40 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:51:40 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:51:40 user nova-compute[73104]:       <nova:owner>
Aug 26 08:51:40 user nova-compute[73104]:         <nova:user uuid="4191d8a10ac54389b6b633701f6e6c77">tempest-AttachVolumeTestJSON-684994869-project-member</nova:user>
Aug 26 08:51:40 user nova-compute[73104]:         <nova:project uuid="d101cd585e604a1881c981c946f70849">tempest-AttachVolumeTestJSON-684994869</nova:project>
Aug 26 08:51:40 user nova-compute[73104]:       </nova:owner>
Aug 26 08:51:40 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:51:40 user nova-compute[73104]:       <nova:ports>
Aug 26 08:51:40 user nova-compute[73104]:         <nova:port uuid="4c1b906e-2c49-4642-9183-06292be46de4">
Aug 26 08:51:40 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 08:51:40 user nova-compute[73104]:         </nova:port>
Aug 26 08:51:40 user nova-compute[73104]:       </nova:ports>
Aug 26 08:51:40 user nova-compute[73104]:     </nova:instance>
Aug 26 08:51:40 user nova-compute[73104]:   </metadata>
Aug 26 08:51:40 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:51:40 user nova-compute[73104]:     <system>
Aug 26 08:51:40 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:51:40 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:51:40 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:51:40 user nova-compute[73104]:       <entry name="serial">33048996-d559-4b3c-9de9-39bb176c3ec9</entry>
Aug 26 08:51:40 user nova-compute[73104]:       <entry name="uuid">33048996-d559-4b3c-9de9-39bb176c3ec9</entry>
Aug 26 08:51:40 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:51:40 user nova-compute[73104]:     </system>
Aug 26 08:51:40 user nova-compute[73104]:   </sysinfo>
Aug 26 08:51:40 user nova-compute[73104]:   <os>
Aug 26 08:51:40 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:51:40 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:51:40 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:51:40 user nova-compute[73104]:   </os>
Aug 26 08:51:40 user nova-compute[73104]:   <features>
Aug 26 08:51:40 user nova-compute[73104]:     <acpi/>
Aug 26 08:51:40 user nova-compute[73104]:     <apic/>
Aug 26 08:51:40 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:51:40 user nova-compute[73104]:   </features>
Aug 26 08:51:40 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:51:40 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:51:40 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:51:40 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:51:40 user nova-compute[73104]:   </clock>
Aug 26 08:51:40 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:51:40 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:51:40 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:51:40 user nova-compute[73104]:   </cpu>
Aug 26 08:51:40 user nova-compute[73104]:   <devices>
Aug 26 08:51:40 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:51:40 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:51:40 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk"/>
Aug 26 08:51:40 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:51:40 user nova-compute[73104]:     </disk>
Aug 26 08:51:40 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:51:40 user nova-compute[73104]:       <mac address="fa:16:3e:7e:7d:6c"/>
Aug 26 08:51:40 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:51:40 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:51:40 user nova-compute[73104]:       <target dev="tap4c1b906e-2c"/>
Aug 26 08:51:40 user nova-compute[73104]:     </interface>
Aug 26 08:51:40 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:51:40 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/console.log" append="off"/>
Aug 26 08:51:40 user nova-compute[73104]:     </serial>
Aug 26 08:51:40 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:51:40 user nova-compute[73104]:     <video>
Aug 26 08:51:40 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:51:40 user nova-compute[73104]:     </video>
Aug 26 08:51:40 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:51:40 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:51:40 user nova-compute[73104]:     </rng>
Aug 26 08:51:40 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:51:40 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:51:40 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:51:40 user nova-compute[73104]:     </memballoon>
Aug 26 08:51:40 user nova-compute[73104]:   </devices>
Aug 26 08:51:40 user nova-compute[73104]: </domain>
Aug 26 08:51:40 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:51:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1372648210',display_name='tempest-AttachVolumeTestJSON-server-1372648210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1372648210',id=28,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3ruAnm8wJOtkM5YpWf3zux9ipeTcCrtMwmPCNqS87cjfXmG7Jo5HHNQzK7O8JS5TTbG/bKm+6qFm/BZVW6gKLbnDGC/QXgHLRc1/aNdWcQz6PVhir0ZiiZKQ1S1B0vIg==',key_name='tempest-keypair-1147096816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d101cd585e604a1881c981c946f70849',ramdisk_id='',reservation_id='r-hfyybj1j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-684994869',owner_user_name='tempest-AttachVolumeTestJSON-684994869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:51:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4191d8a10ac54389b6b633701f6e6c77',uuid=33048996-d559-4b3c-9de9-39bb176c3ec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c1b906e-2c49-4642-9183-06292be46de4", "address": "fa:16:3e:7e:7d:6c", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1b906e-2c", "ovs_interfaceid": "4c1b906e-2c49-4642-9183-06292be46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Converting VIF {"id": "4c1b906e-2c49-4642-9183-06292be46de4", "address": "fa:16:3e:7e:7d:6c", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1b906e-2c", "ovs_interfaceid": "4c1b906e-2c49-4642-9183-06292be46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7d:6c,bridge_name='br-int',has_traffic_filtering=True,id=4c1b906e-2c49-4642-9183-06292be46de4,network=Network(e6ddfc91-c02c-429c-90ff-aaad54b98cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1b906e-2c') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG os_vif [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7d:6c,bridge_name='br-int',has_traffic_filtering=True,id=4c1b906e-2c49-4642-9183-06292be46de4,network=Network(e6ddfc91-c02c-429c-90ff-aaad54b98cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1b906e-2c') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c1b906e-2c, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4c1b906e-2c, col_values=(('external_ids', {'iface-id': '4c1b906e-2c49-4642-9183-06292be46de4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:7d:6c', 'vm-uuid': '33048996-d559-4b3c-9de9-39bb176c3ec9'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:40 user nova-compute[73104]: INFO os_vif [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7d:6c,bridge_name='br-int',has_traffic_filtering=True,id=4c1b906e-2c49-4642-9183-06292be46de4,network=Network(e6ddfc91-c02c-429c-90ff-aaad54b98cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1b906e-2c')
Aug 26 08:51:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] No VIF found with MAC fa:16:3e:7e:7d:6c, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG nova.network.neutron [req-2a296ead-e723-46f0-97fc-0a1eeae686fa req-658ffd43-1a45-4405-83cc-0958d0ba88ba service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Updated VIF entry in instance network info cache for port 4c1b906e-2c49-4642-9183-06292be46de4. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG nova.network.neutron [req-2a296ead-e723-46f0-97fc-0a1eeae686fa req-658ffd43-1a45-4405-83cc-0958d0ba88ba service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Updating instance_info_cache with network_info: [{"id": "4c1b906e-2c49-4642-9183-06292be46de4", "address": "fa:16:3e:7e:7d:6c", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1b906e-2c", "ovs_interfaceid": "4c1b906e-2c49-4642-9183-06292be46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:51:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2a296ead-e723-46f0-97fc-0a1eeae686fa req-658ffd43-1a45-4405-83cc-0958d0ba88ba service nova] Releasing lock "refresh_cache-33048996-d559-4b3c-9de9-39bb176c3ec9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:51:41 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:41 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:41 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:42 user nova-compute[73104]: DEBUG nova.compute.manager [req-accd2217-2013-4b30-9d6f-4fecc678db5e req-f64cf71d-6092-4ff9-a2e5-d0a70cad8ecb service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Received event network-vif-plugged-4c1b906e-2c49-4642-9183-06292be46de4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:51:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-accd2217-2013-4b30-9d6f-4fecc678db5e req-f64cf71d-6092-4ff9-a2e5-d0a70cad8ecb service nova] Acquiring lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:51:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-accd2217-2013-4b30-9d6f-4fecc678db5e req-f64cf71d-6092-4ff9-a2e5-d0a70cad8ecb service nova] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:51:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-accd2217-2013-4b30-9d6f-4fecc678db5e req-f64cf71d-6092-4ff9-a2e5-d0a70cad8ecb service nova] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:51:42 user nova-compute[73104]: DEBUG nova.compute.manager [req-accd2217-2013-4b30-9d6f-4fecc678db5e req-f64cf71d-6092-4ff9-a2e5-d0a70cad8ecb service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] No waiting events found dispatching network-vif-plugged-4c1b906e-2c49-4642-9183-06292be46de4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:51:42 user nova-compute[73104]: WARNING nova.compute.manager [req-accd2217-2013-4b30-9d6f-4fecc678db5e req-f64cf71d-6092-4ff9-a2e5-d0a70cad8ecb service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Received unexpected event network-vif-plugged-4c1b906e-2c49-4642-9183-06292be46de4 for instance with vm_state building and task_state spawning.
Aug 26 08:51:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Acquiring lock "945acd46-42e2-4c45-b8e5-9ea94703bc66" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:51:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "945acd46-42e2-4c45-b8e5-9ea94703bc66" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:51:42 user nova-compute[73104]: DEBUG nova.compute.manager [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:51:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:51:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:51:43 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:51:43 user nova-compute[73104]: INFO nova.compute.claims [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Claim successful on node user
Aug 26 08:51:43 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:51:43 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:51:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:51:43 user nova-compute[73104]: DEBUG nova.compute.manager [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:51:43 user nova-compute[73104]: DEBUG nova.compute.manager [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:51:43 user nova-compute[73104]: DEBUG nova.network.neutron [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:51:43 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:51:43 user nova-compute[73104]: DEBUG nova.compute.manager [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:51:43 user nova-compute[73104]: DEBUG nova.policy [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dea79c0b1d874d27b63d7e5418d12505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f8b4744aa5450ca396714b74a01049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:51:43 user nova-compute[73104]: DEBUG nova.compute.manager [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:51:43 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:51:43 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Creating image(s)
Aug 26 08:51:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Acquiring lock "/opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:51:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "/opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:51:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "/opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:51:43 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:43 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.196s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:51:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:51:43 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:44 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039904.0918078, 33048996-d559-4b3c-9de9-39bb176c3ec9 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:51:44 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] VM Resumed (Lifecycle Event)
Aug 26 08:51:44 user nova-compute[73104]: DEBUG nova.compute.manager [req-8bfd3cb8-3a23-4b41-a5b0-b5a884c2fe84 req-5b988e27-7b5a-41ba-a12a-0483b49e21f1 service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Received event network-vif-plugged-4c1b906e-2c49-4642-9183-06292be46de4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:51:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-8bfd3cb8-3a23-4b41-a5b0-b5a884c2fe84 req-5b988e27-7b5a-41ba-a12a-0483b49e21f1 service nova] Acquiring lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:51:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-8bfd3cb8-3a23-4b41-a5b0-b5a884c2fe84 req-5b988e27-7b5a-41ba-a12a-0483b49e21f1 service nova] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:51:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-8bfd3cb8-3a23-4b41-a5b0-b5a884c2fe84 req-5b988e27-7b5a-41ba-a12a-0483b49e21f1 service nova] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:51:44 user nova-compute[73104]: DEBUG nova.compute.manager [req-8bfd3cb8-3a23-4b41-a5b0-b5a884c2fe84 req-5b988e27-7b5a-41ba-a12a-0483b49e21f1 service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] No waiting events found dispatching network-vif-plugged-4c1b906e-2c49-4642-9183-06292be46de4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:51:44 user nova-compute[73104]: WARNING nova.compute.manager [req-8bfd3cb8-3a23-4b41-a5b0-b5a884c2fe84 req-5b988e27-7b5a-41ba-a12a-0483b49e21f1 service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Received unexpected event network-vif-plugged-4c1b906e-2c49-4642-9183-06292be46de4 for instance with vm_state building and task_state spawning.
Aug 26 08:51:44 user nova-compute[73104]: DEBUG nova.compute.manager [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:51:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:51:44 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:51:44 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Instance spawned successfully.
Aug 26 08:51:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:51:44 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:51:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.196s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:44 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:51:44 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039904.0927234, 33048996-d559-4b3c-9de9-39bb176c3ec9 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:51:44 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] VM Started (Lifecycle Event)
Aug 26 08:51:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk 1073741824" returned: 0 in 0.073s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:51:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:44 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:51:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:51:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:51:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:51:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:51:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:51:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:51:44 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:51:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:44 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:51:44 user nova-compute[73104]: INFO nova.compute.manager [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Took 6.91 seconds to spawn the instance on the hypervisor.
Aug 26 08:51:44 user nova-compute[73104]: DEBUG nova.compute.manager [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:51:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.221s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:44 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Checking if we can resize image /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 08:51:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:44 user nova-compute[73104]: DEBUG nova.network.neutron [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Successfully created port: 6df89783-82b3-4a16-b2ec-f5f3c2e54884 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:51:44 user nova-compute[73104]: INFO nova.compute.manager [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Took 7.71 seconds to build instance.
Aug 26 08:51:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-24ca281b-1876-4563-879a-19c338af3a75 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.854s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:51:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:44 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Cannot resize image /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 08:51:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:51:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Ensure instance console log exists: /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:51:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:51:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.006s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:51:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:51:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:45 user nova-compute[73104]: DEBUG nova.network.neutron [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Successfully updated port: 6df89783-82b3-4a16-b2ec-f5f3c2e54884 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:51:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Acquiring lock "refresh_cache-945acd46-42e2-4c45-b8e5-9ea94703bc66" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:51:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Acquired lock "refresh_cache-945acd46-42e2-4c45-b8e5-9ea94703bc66" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:51:45 user nova-compute[73104]: DEBUG nova.network.neutron [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:51:45 user nova-compute[73104]: DEBUG nova.network.neutron [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:51:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-acc0ed9b-664e-4e2f-bde5-797a37e3a55b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:51:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-acc0ed9b-664e-4e2f-bde5-797a37e3a55b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:51:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-acc0ed9b-664e-4e2f-bde5-797a37e3a55b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:51:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-acc0ed9b-664e-4e2f-bde5-797a37e3a55b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:51:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-acc0ed9b-664e-4e2f-bde5-797a37e3a55b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:51:45 user nova-compute[73104]: INFO nova.compute.manager [None req-acc0ed9b-664e-4e2f-bde5-797a37e3a55b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Terminating instance
Aug 26 08:51:45 user nova-compute[73104]: DEBUG nova.compute.manager [None req-acc0ed9b-664e-4e2f-bde5-797a37e3a55b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 08:51:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.network.neutron [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Updating instance_info_cache with network_info: [{"id": "6df89783-82b3-4a16-b2ec-f5f3c2e54884", "address": "fa:16:3e:b9:a6:80", "network": {"id": "bb0ed7b6-f1d2-41e5-b975-926555200ac9", "bridge": "br-int", "label": "tempest-TestStampPattern-89239905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f8b4744aa5450ca396714b74a01049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df89783-82", "ovs_interfaceid": "6df89783-82b3-4a16-b2ec-f5f3c2e54884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Releasing lock "refresh_cache-945acd46-42e2-4c45-b8e5-9ea94703bc66" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.compute.manager [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Instance network_info: |[{"id": "6df89783-82b3-4a16-b2ec-f5f3c2e54884", "address": "fa:16:3e:b9:a6:80", "network": {"id": "bb0ed7b6-f1d2-41e5-b975-926555200ac9", "bridge": "br-int", "label": "tempest-TestStampPattern-89239905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f8b4744aa5450ca396714b74a01049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df89783-82", "ovs_interfaceid": "6df89783-82b3-4a16-b2ec-f5f3c2e54884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Start _get_guest_xml network_info=[{"id": "6df89783-82b3-4a16-b2ec-f5f3c2e54884", "address": "fa:16:3e:b9:a6:80", "network": {"id": "bb0ed7b6-f1d2-41e5-b975-926555200ac9", "bridge": "br-int", "label": "tempest-TestStampPattern-89239905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f8b4744aa5450ca396714b74a01049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df89783-82", "ovs_interfaceid": "6df89783-82b3-4a16-b2ec-f5f3c2e54884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:51:46 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:51:46 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:51:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1369922145',display_name='tempest-TestStampPattern-server-1369922145',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1369922145',id=29,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8q5d7Z9/2Nnhi0JZhZxh3ataNnlHeSdFDCIuYvXZBV7m47ag+i9lJBSd6jnykjIfpVABlmqnqwhluVSlzPsJtT5zAJjK/bV+KbeeT0wsKSGG3sFgDqmXkgbk2fMo0ekA==',key_name='tempest-TestStampPattern-1398766845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4f8b4744aa5450ca396714b74a01049',ramdisk_id='',reservation_id='r-bttmbkg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1989133217',owner_user_name='tempest-TestStampPattern-1989133217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:51:44Z,user_data=None,user_id='dea79c0b1d874d27b63d7e5418d12505',uuid=945acd46-42e2-4c45-b8e5-9ea94703bc66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6df89783-82b3-4a16-b2ec-f5f3c2e54884", "address": "fa:16:3e:b9:a6:80", "network": {"id": "bb0ed7b6-f1d2-41e5-b975-926555200ac9", "bridge": "br-int", "label": "tempest-TestStampPattern-89239905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f8b4744aa5450ca396714b74a01049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df89783-82", "ovs_interfaceid": "6df89783-82b3-4a16-b2ec-f5f3c2e54884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Converting VIF {"id": "6df89783-82b3-4a16-b2ec-f5f3c2e54884", "address": "fa:16:3e:b9:a6:80", "network": {"id": "bb0ed7b6-f1d2-41e5-b975-926555200ac9", "bridge": "br-int", "label": "tempest-TestStampPattern-89239905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f8b4744aa5450ca396714b74a01049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df89783-82", "ovs_interfaceid": "6df89783-82b3-4a16-b2ec-f5f3c2e54884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:a6:80,bridge_name='br-int',has_traffic_filtering=True,id=6df89783-82b3-4a16-b2ec-f5f3c2e54884,network=Network(bb0ed7b6-f1d2-41e5-b975-926555200ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df89783-82') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.objects.instance [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lazy-loading 'pci_devices' on Instance uuid 945acd46-42e2-4c45-b8e5-9ea94703bc66 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.compute.manager [req-04de131a-4c71-4404-a362-210bf8fafca5 req-b95a0530-fd3b-4239-bb66-ed25acbbc3e6 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Received event network-vif-unplugged-68e8044e-0d86-4309-938c-f00d2c392440 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-04de131a-4c71-4404-a362-210bf8fafca5 req-b95a0530-fd3b-4239-bb66-ed25acbbc3e6 service nova] Acquiring lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-04de131a-4c71-4404-a362-210bf8fafca5 req-b95a0530-fd3b-4239-bb66-ed25acbbc3e6 service nova] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-04de131a-4c71-4404-a362-210bf8fafca5 req-b95a0530-fd3b-4239-bb66-ed25acbbc3e6 service nova] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.compute.manager [req-04de131a-4c71-4404-a362-210bf8fafca5 req-b95a0530-fd3b-4239-bb66-ed25acbbc3e6 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] No waiting events found dispatching network-vif-unplugged-68e8044e-0d86-4309-938c-f00d2c392440 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.compute.manager [req-04de131a-4c71-4404-a362-210bf8fafca5 req-b95a0530-fd3b-4239-bb66-ed25acbbc3e6 service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Received event network-vif-unplugged-68e8044e-0d86-4309-938c-f00d2c392440 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.compute.manager [req-47cc02be-fd2e-4b64-9ad9-d9e49d63c550 req-db2231a1-1976-4109-9b64-ae8bd6bb0edd service nova] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Received event network-changed-6df89783-82b3-4a16-b2ec-f5f3c2e54884 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.compute.manager [req-47cc02be-fd2e-4b64-9ad9-d9e49d63c550 req-db2231a1-1976-4109-9b64-ae8bd6bb0edd service nova] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Refreshing instance network info cache due to event network-changed-6df89783-82b3-4a16-b2ec-f5f3c2e54884. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-47cc02be-fd2e-4b64-9ad9-d9e49d63c550 req-db2231a1-1976-4109-9b64-ae8bd6bb0edd service nova] Acquiring lock "refresh_cache-945acd46-42e2-4c45-b8e5-9ea94703bc66" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-47cc02be-fd2e-4b64-9ad9-d9e49d63c550 req-db2231a1-1976-4109-9b64-ae8bd6bb0edd service nova] Acquired lock "refresh_cache-945acd46-42e2-4c45-b8e5-9ea94703bc66" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.network.neutron [req-47cc02be-fd2e-4b64-9ad9-d9e49d63c550 req-db2231a1-1976-4109-9b64-ae8bd6bb0edd service nova] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Refreshing network info cache for port 6df89783-82b3-4a16-b2ec-f5f3c2e54884 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:51:46 user nova-compute[73104]:   <uuid>945acd46-42e2-4c45-b8e5-9ea94703bc66</uuid>
Aug 26 08:51:46 user nova-compute[73104]:   <name>instance-0000001d</name>
Aug 26 08:51:46 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:51:46 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:51:46 user nova-compute[73104]:   <metadata>
Aug 26 08:51:46 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:51:46 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:51:46 user nova-compute[73104]:       <nova:name>tempest-TestStampPattern-server-1369922145</nova:name>
Aug 26 08:51:46 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:51:46</nova:creationTime>
Aug 26 08:51:46 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:51:46 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:51:46 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:51:46 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:51:46 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:51:46 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:51:46 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:51:46 user nova-compute[73104]:       <nova:owner>
Aug 26 08:51:46 user nova-compute[73104]:         <nova:user uuid="dea79c0b1d874d27b63d7e5418d12505">tempest-TestStampPattern-1989133217-project-member</nova:user>
Aug 26 08:51:46 user nova-compute[73104]:         <nova:project uuid="b4f8b4744aa5450ca396714b74a01049">tempest-TestStampPattern-1989133217</nova:project>
Aug 26 08:51:46 user nova-compute[73104]:       </nova:owner>
Aug 26 08:51:46 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:51:46 user nova-compute[73104]:       <nova:ports>
Aug 26 08:51:46 user nova-compute[73104]:         <nova:port uuid="6df89783-82b3-4a16-b2ec-f5f3c2e54884">
Aug 26 08:51:46 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 08:51:46 user nova-compute[73104]:         </nova:port>
Aug 26 08:51:46 user nova-compute[73104]:       </nova:ports>
Aug 26 08:51:46 user nova-compute[73104]:     </nova:instance>
Aug 26 08:51:46 user nova-compute[73104]:   </metadata>
Aug 26 08:51:46 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:51:46 user nova-compute[73104]:     <system>
Aug 26 08:51:46 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:51:46 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:51:46 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:51:46 user nova-compute[73104]:       <entry name="serial">945acd46-42e2-4c45-b8e5-9ea94703bc66</entry>
Aug 26 08:51:46 user nova-compute[73104]:       <entry name="uuid">945acd46-42e2-4c45-b8e5-9ea94703bc66</entry>
Aug 26 08:51:46 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:51:46 user nova-compute[73104]:     </system>
Aug 26 08:51:46 user nova-compute[73104]:   </sysinfo>
Aug 26 08:51:46 user nova-compute[73104]:   <os>
Aug 26 08:51:46 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:51:46 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:51:46 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:51:46 user nova-compute[73104]:   </os>
Aug 26 08:51:46 user nova-compute[73104]:   <features>
Aug 26 08:51:46 user nova-compute[73104]:     <acpi/>
Aug 26 08:51:46 user nova-compute[73104]:     <apic/>
Aug 26 08:51:46 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:51:46 user nova-compute[73104]:   </features>
Aug 26 08:51:46 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:51:46 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:51:46 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:51:46 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:51:46 user nova-compute[73104]:   </clock>
Aug 26 08:51:46 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:51:46 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:51:46 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:51:46 user nova-compute[73104]:   </cpu>
Aug 26 08:51:46 user nova-compute[73104]:   <devices>
Aug 26 08:51:46 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:51:46 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:51:46 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk"/>
Aug 26 08:51:46 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:51:46 user nova-compute[73104]:     </disk>
Aug 26 08:51:46 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:51:46 user nova-compute[73104]:       <mac address="fa:16:3e:b9:a6:80"/>
Aug 26 08:51:46 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:51:46 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:51:46 user nova-compute[73104]:       <target dev="tap6df89783-82"/>
Aug 26 08:51:46 user nova-compute[73104]:     </interface>
Aug 26 08:51:46 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:51:46 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/console.log" append="off"/>
Aug 26 08:51:46 user nova-compute[73104]:     </serial>
Aug 26 08:51:46 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:51:46 user nova-compute[73104]:     <video>
Aug 26 08:51:46 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:51:46 user nova-compute[73104]:     </video>
Aug 26 08:51:46 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:51:46 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:51:46 user nova-compute[73104]:     </rng>
Aug 26 08:51:46 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:51:46 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:51:46 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:51:46 user nova-compute[73104]:     </memballoon>
Aug 26 08:51:46 user nova-compute[73104]:   </devices>
Aug 26 08:51:46 user nova-compute[73104]: </domain>
Aug 26 08:51:46 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:51:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1369922145',display_name='tempest-TestStampPattern-server-1369922145',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1369922145',id=29,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8q5d7Z9/2Nnhi0JZhZxh3ataNnlHeSdFDCIuYvXZBV7m47ag+i9lJBSd6jnykjIfpVABlmqnqwhluVSlzPsJtT5zAJjK/bV+KbeeT0wsKSGG3sFgDqmXkgbk2fMo0ekA==',key_name='tempest-TestStampPattern-1398766845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4f8b4744aa5450ca396714b74a01049',ramdisk_id='',reservation_id='r-bttmbkg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1989133217',owner_user_name='tempest-TestStampPattern-1989133217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:51:44Z,user_data=None,user_id='dea79c0b1d874d27b63d7e5418d12505',uuid=945acd46-42e2-4c45-b8e5-9ea94703bc66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6df89783-82b3-4a16-b2ec-f5f3c2e54884", "address": "fa:16:3e:b9:a6:80", "network": {"id": "bb0ed7b6-f1d2-41e5-b975-926555200ac9", "bridge": "br-int", "label": "tempest-TestStampPattern-89239905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f8b4744aa5450ca396714b74a01049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df89783-82", "ovs_interfaceid": "6df89783-82b3-4a16-b2ec-f5f3c2e54884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Converting VIF {"id": "6df89783-82b3-4a16-b2ec-f5f3c2e54884", "address": "fa:16:3e:b9:a6:80", "network": {"id": "bb0ed7b6-f1d2-41e5-b975-926555200ac9", "bridge": "br-int", "label": "tempest-TestStampPattern-89239905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f8b4744aa5450ca396714b74a01049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df89783-82", "ovs_interfaceid": "6df89783-82b3-4a16-b2ec-f5f3c2e54884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:a6:80,bridge_name='br-int',has_traffic_filtering=True,id=6df89783-82b3-4a16-b2ec-f5f3c2e54884,network=Network(bb0ed7b6-f1d2-41e5-b975-926555200ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df89783-82') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG os_vif [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:a6:80,bridge_name='br-int',has_traffic_filtering=True,id=6df89783-82b3-4a16-b2ec-f5f3c2e54884,network=Network(bb0ed7b6-f1d2-41e5-b975-926555200ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df89783-82') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6df89783-82, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6df89783-82, col_values=(('external_ids', {'iface-id': '6df89783-82b3-4a16-b2ec-f5f3c2e54884', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:a6:80', 'vm-uuid': '945acd46-42e2-4c45-b8e5-9ea94703bc66'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:46 user nova-compute[73104]: INFO os_vif [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:a6:80,bridge_name='br-int',has_traffic_filtering=True,id=6df89783-82b3-4a16-b2ec-f5f3c2e54884,network=Network(bb0ed7b6-f1d2-41e5-b975-926555200ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df89783-82')
Aug 26 08:51:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] No VIF found with MAC fa:16:3e:b9:a6:80, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.network.neutron [req-47cc02be-fd2e-4b64-9ad9-d9e49d63c550 req-db2231a1-1976-4109-9b64-ae8bd6bb0edd service nova] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Updated VIF entry in instance network info cache for port 6df89783-82b3-4a16-b2ec-f5f3c2e54884. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.network.neutron [req-47cc02be-fd2e-4b64-9ad9-d9e49d63c550 req-db2231a1-1976-4109-9b64-ae8bd6bb0edd service nova] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Updating instance_info_cache with network_info: [{"id": "6df89783-82b3-4a16-b2ec-f5f3c2e54884", "address": "fa:16:3e:b9:a6:80", "network": {"id": "bb0ed7b6-f1d2-41e5-b975-926555200ac9", "bridge": "br-int", "label": "tempest-TestStampPattern-89239905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f8b4744aa5450ca396714b74a01049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df89783-82", "ovs_interfaceid": "6df89783-82b3-4a16-b2ec-f5f3c2e54884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:51:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-47cc02be-fd2e-4b64-9ad9-d9e49d63c550 req-db2231a1-1976-4109-9b64-ae8bd6bb0edd service nova] Releasing lock "refresh_cache-945acd46-42e2-4c45-b8e5-9ea94703bc66" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:51:46 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Instance destroyed successfully.
Aug 26 08:51:46 user nova-compute[73104]: DEBUG nova.objects.instance [None req-acc0ed9b-664e-4e2f-bde5-797a37e3a55b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lazy-loading 'resources' on Instance uuid b7f6e347-c1f3-4f56-86c4-3b28c4729964 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:51:47 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-acc0ed9b-664e-4e2f-bde5-797a37e3a55b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T08:45:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-507169638',display_name='tempest-ServerActionsTestOtherA-server-1640836795',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-507169638',id=23,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYLqMl8GpNjfNVCgo2H+2r4h7f+wltYEXzpCmKmElhA0DBXXS8OJ+jJMfreN4vSnENs3yu+UIcdrUm0f/2htkz5kCGsZ2tw03AkxIejr18INsy4zP7Li4asqVv0WIUqpw==',key_name='tempest-keypair-2115817653',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:48:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='efb864c0a34541dca00c6dbbcea17319',ramdisk_id='',reservation_id='r-p9meui0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1245661612',owner_user_name='tempest-ServerActionsTestOtherA-1245661612-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:48:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='257343af54bd42b591e8874ef4ecf8dc',uuid=b7f6e347-c1f3-4f56-86c4-3b28c4729964,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68e8044e-0d86-4309-938c-f00d2c392440", "address": "fa:16:3e:8e:1c:6e", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68e8044e-0d", "ovs_interfaceid": "68e8044e-0d86-4309-938c-f00d2c392440", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:51:47 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-acc0ed9b-664e-4e2f-bde5-797a37e3a55b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Converting VIF {"id": "68e8044e-0d86-4309-938c-f00d2c392440", "address": "fa:16:3e:8e:1c:6e", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68e8044e-0d", "ovs_interfaceid": "68e8044e-0d86-4309-938c-f00d2c392440", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:51:47 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-acc0ed9b-664e-4e2f-bde5-797a37e3a55b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:1c:6e,bridge_name='br-int',has_traffic_filtering=True,id=68e8044e-0d86-4309-938c-f00d2c392440,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68e8044e-0d') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:51:47 user nova-compute[73104]: DEBUG os_vif [None req-acc0ed9b-664e-4e2f-bde5-797a37e3a55b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:1c:6e,bridge_name='br-int',has_traffic_filtering=True,id=68e8044e-0d86-4309-938c-f00d2c392440,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68e8044e-0d') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:51:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68e8044e-0d, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:51:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:51:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:47 user nova-compute[73104]: INFO os_vif [None req-acc0ed9b-664e-4e2f-bde5-797a37e3a55b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:1c:6e,bridge_name='br-int',has_traffic_filtering=True,id=68e8044e-0d86-4309-938c-f00d2c392440,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68e8044e-0d')
Aug 26 08:51:47 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-acc0ed9b-664e-4e2f-bde5-797a37e3a55b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Deleting instance files /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964_del
Aug 26 08:51:47 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-acc0ed9b-664e-4e2f-bde5-797a37e3a55b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Deletion of /opt/stack/data/nova/instances/b7f6e347-c1f3-4f56-86c4-3b28c4729964_del complete
Aug 26 08:51:47 user nova-compute[73104]: INFO nova.compute.manager [None req-acc0ed9b-664e-4e2f-bde5-797a37e3a55b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Took 1.35 seconds to destroy the instance on the hypervisor.
Aug 26 08:51:47 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-acc0ed9b-664e-4e2f-bde5-797a37e3a55b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 08:51:47 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 08:51:47 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 08:51:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:48 user nova-compute[73104]: DEBUG nova.compute.manager [req-60d4931e-b6b8-4072-9cba-3f4ba53395b9 req-3171cc3f-0633-4b52-8f40-8b8fa2f1969f service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Received event network-vif-plugged-68e8044e-0d86-4309-938c-f00d2c392440 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:51:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-60d4931e-b6b8-4072-9cba-3f4ba53395b9 req-3171cc3f-0633-4b52-8f40-8b8fa2f1969f service nova] Acquiring lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:51:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-60d4931e-b6b8-4072-9cba-3f4ba53395b9 req-3171cc3f-0633-4b52-8f40-8b8fa2f1969f service nova] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:51:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-60d4931e-b6b8-4072-9cba-3f4ba53395b9 req-3171cc3f-0633-4b52-8f40-8b8fa2f1969f service nova] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:51:48 user nova-compute[73104]: DEBUG nova.compute.manager [req-60d4931e-b6b8-4072-9cba-3f4ba53395b9 req-3171cc3f-0633-4b52-8f40-8b8fa2f1969f service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] No waiting events found dispatching network-vif-plugged-68e8044e-0d86-4309-938c-f00d2c392440 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:51:48 user nova-compute[73104]: WARNING nova.compute.manager [req-60d4931e-b6b8-4072-9cba-3f4ba53395b9 req-3171cc3f-0633-4b52-8f40-8b8fa2f1969f service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Received unexpected event network-vif-plugged-68e8044e-0d86-4309-938c-f00d2c392440 for instance with vm_state active and task_state deleting.
Aug 26 08:51:48 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:51:48 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Took 1.40 seconds to deallocate network for instance.
Aug 26 08:51:48 user nova-compute[73104]: DEBUG nova.compute.manager [req-89883977-f79e-47cc-a9af-95c79a0f4241 req-8de9fe94-15c8-4deb-a179-59f21249738a service nova] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Received event network-vif-deleted-68e8044e-0d86-4309-938c-f00d2c392440 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:51:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-acc0ed9b-664e-4e2f-bde5-797a37e3a55b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:51:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-acc0ed9b-664e-4e2f-bde5-797a37e3a55b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:51:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:49 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-acc0ed9b-664e-4e2f-bde5-797a37e3a55b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:51:49 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-acc0ed9b-664e-4e2f-bde5-797a37e3a55b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:51:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-acc0ed9b-664e-4e2f-bde5-797a37e3a55b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:51:49 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-acc0ed9b-664e-4e2f-bde5-797a37e3a55b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Deleted allocations for instance b7f6e347-c1f3-4f56-86c4-3b28c4729964
Aug 26 08:51:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-acc0ed9b-664e-4e2f-bde5-797a37e3a55b tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "b7f6e347-c1f3-4f56-86c4-3b28c4729964" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.466s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:51:50 user nova-compute[73104]: DEBUG nova.compute.manager [req-054d416f-d4ba-449d-aa6a-8e2f7e9e151a req-02687364-b053-4190-9421-5d86feb14859 service nova] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Received event network-vif-plugged-6df89783-82b3-4a16-b2ec-f5f3c2e54884 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:51:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-054d416f-d4ba-449d-aa6a-8e2f7e9e151a req-02687364-b053-4190-9421-5d86feb14859 service nova] Acquiring lock "945acd46-42e2-4c45-b8e5-9ea94703bc66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:51:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-054d416f-d4ba-449d-aa6a-8e2f7e9e151a req-02687364-b053-4190-9421-5d86feb14859 service nova] Lock "945acd46-42e2-4c45-b8e5-9ea94703bc66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:51:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-054d416f-d4ba-449d-aa6a-8e2f7e9e151a req-02687364-b053-4190-9421-5d86feb14859 service nova] Lock "945acd46-42e2-4c45-b8e5-9ea94703bc66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:51:50 user nova-compute[73104]: DEBUG nova.compute.manager [req-054d416f-d4ba-449d-aa6a-8e2f7e9e151a req-02687364-b053-4190-9421-5d86feb14859 service nova] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] No waiting events found dispatching network-vif-plugged-6df89783-82b3-4a16-b2ec-f5f3c2e54884 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:51:50 user nova-compute[73104]: WARNING nova.compute.manager [req-054d416f-d4ba-449d-aa6a-8e2f7e9e151a req-02687364-b053-4190-9421-5d86feb14859 service nova] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Received unexpected event network-vif-plugged-6df89783-82b3-4a16-b2ec-f5f3c2e54884 for instance with vm_state building and task_state spawning.
Aug 26 08:51:50 user nova-compute[73104]: DEBUG nova.compute.manager [req-054d416f-d4ba-449d-aa6a-8e2f7e9e151a req-02687364-b053-4190-9421-5d86feb14859 service nova] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Received event network-vif-plugged-6df89783-82b3-4a16-b2ec-f5f3c2e54884 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:51:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-054d416f-d4ba-449d-aa6a-8e2f7e9e151a req-02687364-b053-4190-9421-5d86feb14859 service nova] Acquiring lock "945acd46-42e2-4c45-b8e5-9ea94703bc66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:51:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-054d416f-d4ba-449d-aa6a-8e2f7e9e151a req-02687364-b053-4190-9421-5d86feb14859 service nova] Lock "945acd46-42e2-4c45-b8e5-9ea94703bc66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:51:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-054d416f-d4ba-449d-aa6a-8e2f7e9e151a req-02687364-b053-4190-9421-5d86feb14859 service nova] Lock "945acd46-42e2-4c45-b8e5-9ea94703bc66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:51:50 user nova-compute[73104]: DEBUG nova.compute.manager [req-054d416f-d4ba-449d-aa6a-8e2f7e9e151a req-02687364-b053-4190-9421-5d86feb14859 service nova] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] No waiting events found dispatching network-vif-plugged-6df89783-82b3-4a16-b2ec-f5f3c2e54884 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:51:50 user nova-compute[73104]: WARNING nova.compute.manager [req-054d416f-d4ba-449d-aa6a-8e2f7e9e151a req-02687364-b053-4190-9421-5d86feb14859 service nova] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Received unexpected event network-vif-plugged-6df89783-82b3-4a16-b2ec-f5f3c2e54884 for instance with vm_state building and task_state spawning.
Aug 26 08:51:50 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039910.7934647, 945acd46-42e2-4c45-b8e5-9ea94703bc66 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:51:50 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] VM Resumed (Lifecycle Event)
Aug 26 08:51:50 user nova-compute[73104]: DEBUG nova.compute.manager [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:51:50 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:51:50 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Instance spawned successfully.
Aug 26 08:51:50 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:51:50 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:51:50 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:51:50 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:51:50 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:51:50 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:51:50 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:51:50 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:51:50 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:51:50 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:51:50 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039910.7947626, 945acd46-42e2-4c45-b8e5-9ea94703bc66 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:51:50 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] VM Started (Lifecycle Event)
Aug 26 08:51:50 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:51:50 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:51:50 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:51:50 user nova-compute[73104]: INFO nova.compute.manager [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Took 7.18 seconds to spawn the instance on the hypervisor.
Aug 26 08:51:50 user nova-compute[73104]: DEBUG nova.compute.manager [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:51:51 user nova-compute[73104]: INFO nova.compute.manager [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Took 8.04 seconds to build instance.
Aug 26 08:51:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d440f3ba-d01a-4c08-b396-0752100fca9b tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "945acd46-42e2-4c45-b8e5-9ea94703bc66" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.161s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KwpHJSaR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:51:51 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:51:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:51:51 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:51:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:51:51 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:51:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac79cafb-4c88-456f-9c36-51a44acf8cb2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:51:51 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0efb768-7d0c-41e5-9daa-9b0bf1febc67]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e] added
Aug 26 08:51:51 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.063s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a8ed34-6f80-4ef4-b21b-55a52b85cb36]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af51e65-0680-4c1f-9bd6-5234709a38bc]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KwpHJSaR {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KwpHJSaR" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe862353-f849-435c-9f0c-56503d836bc9]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KwpHJSaR'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d529c8fc-128f-4b23-97eb-5818e3c19c29]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aee9425-2d8b-4331-a5d7-07346aad9da8]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:51:51 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:51:51 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c752aa-fda2-45ce-be37-1eef240dba4a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e, portal: 172.16.0.220,3260]
Aug 26 08:51:51 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e, portal: 172.16.0.220,3260] successful.
Aug 26 08:51:51 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8caa48-9b18-4ba1-8392-a380d631fef8]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb4d637-a8e7-485c-a24c-caa15520b8fa]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:51:51 user nova-compute[73104]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e (non-flash)
Aug 26 08:51:51 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:51:51 user nova-compute[73104]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e (non-flash)
Aug 26 08:51:51 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec38b2e4-6031-45fc-9d5e-36e64fbd5ffd]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:51:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KwpHJSaR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:51:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:51:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '26163663835353638', 'path': '/dev/sdc'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:51:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163663835353638', 'path': '/dev/sdc'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:51:52 user nova-compute[73104]: DEBUG nova.objects.instance [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lazy-loading 'flavor' on Instance uuid e7ac6a94-05a2-4b11-a541-26b1d1dae070 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:51:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 08:51:52 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:51:52 user nova-compute[73104]:   <source dev="/dev/sdc"/>
Aug 26 08:51:52 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:51:52 user nova-compute[73104]:   <serial>d97a6724-3b89-42f0-9ba7-ee0904e9993e</serial>
Aug 26 08:51:52 user nova-compute[73104]: </disk>
Aug 26 08:51:52 user nova-compute[73104]:  {{(pid=73104) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 08:51:53 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:51:53 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:51:53 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] No VIF found with MAC fa:16:3e:12:ae:4a, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:51:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8aa0aefb-3b41-4e75-b068-3f5c557a3fbf tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.683s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:51:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:55 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:51:55 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:51:55 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:51:55 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 08:51:56 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:51:56 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:51:56 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:51:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:57 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:51:57 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:51:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:51:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:51:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:51:57 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 08:51:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:57 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:51:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:58 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:51:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:51:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:51:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:51:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:52:00 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:52:00 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:52:00 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=7935MB free_disk=24.111343383789062GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 08:52:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:52:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:52:00 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance b5e1f82c-5675-4c37-8ba2-44e6a341a576 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:52:00 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 3cf85d2f-de0d-4e9b-a534-98c799ae8db9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:52:00 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 02665c70-cf75-44ba-9d90-eb9e5f12e0b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:52:00 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance bef1e493-6b2c-4688-98c2-647261feb571 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:52:00 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance e7ac6a94-05a2-4b11-a541-26b1d1dae070 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:52:00 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 33048996-d559-4b3c-9de9-39bb176c3ec9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:52:00 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 945acd46-42e2-4c45-b8e5-9ea94703bc66 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:52:00 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 08:52:00 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 08:52:00 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:52:00 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:52:00 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 08:52:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.430s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:52:01 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693039906.9894173, b7f6e347-c1f3-4f56-86c4-3b28c4729964 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:52:01 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] VM Stopped (Lifecycle Event)
Aug 26 08:52:02 user nova-compute[73104]: DEBUG nova.compute.manager [None req-c3c01472-1f61-4076-9334-4e305d33c6c7 None None] [instance: b7f6e347-c1f3-4f56-86c4-3b28c4729964] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:52:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:03 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:52:03 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 08:52:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-3cf85d2f-de0d-4e9b-a534-98c799ae8db9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:52:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-3cf85d2f-de0d-4e9b-a534-98c799ae8db9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:52:03 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 08:52:04 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Updating instance_info_cache with network_info: [{"id": "1ff011d7-db1c-4bac-a2d3-ecf253085265", "address": "fa:16:3e:72:e3:65", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff011d7-db", "ovs_interfaceid": "1ff011d7-db1c-4bac-a2d3-ecf253085265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:52:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-3cf85d2f-de0d-4e9b-a534-98c799ae8db9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:52:04 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 08:52:05 user nova-compute[73104]: DEBUG nova.compute.manager [req-b2a52c69-47c1-4acf-b2c2-735405887051 req-24c7fa46-fe2a-43ef-8b9b-b90f677d7f50 service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Received event network-changed-a2c66a9f-398a-4f45-a821-5105e68bb4f4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:52:05 user nova-compute[73104]: DEBUG nova.compute.manager [req-b2a52c69-47c1-4acf-b2c2-735405887051 req-24c7fa46-fe2a-43ef-8b9b-b90f677d7f50 service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Refreshing instance network info cache due to event network-changed-a2c66a9f-398a-4f45-a821-5105e68bb4f4. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:52:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b2a52c69-47c1-4acf-b2c2-735405887051 req-24c7fa46-fe2a-43ef-8b9b-b90f677d7f50 service nova] Acquiring lock "refresh_cache-e7ac6a94-05a2-4b11-a541-26b1d1dae070" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:52:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b2a52c69-47c1-4acf-b2c2-735405887051 req-24c7fa46-fe2a-43ef-8b9b-b90f677d7f50 service nova] Acquired lock "refresh_cache-e7ac6a94-05a2-4b11-a541-26b1d1dae070" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:52:05 user nova-compute[73104]: DEBUG nova.network.neutron [req-b2a52c69-47c1-4acf-b2c2-735405887051 req-24c7fa46-fe2a-43ef-8b9b-b90f677d7f50 service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Refreshing network info cache for port a2c66a9f-398a-4f45-a821-5105e68bb4f4 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:52:06 user nova-compute[73104]: DEBUG nova.network.neutron [req-b2a52c69-47c1-4acf-b2c2-735405887051 req-24c7fa46-fe2a-43ef-8b9b-b90f677d7f50 service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Updated VIF entry in instance network info cache for port a2c66a9f-398a-4f45-a821-5105e68bb4f4. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:52:06 user nova-compute[73104]: DEBUG nova.network.neutron [req-b2a52c69-47c1-4acf-b2c2-735405887051 req-24c7fa46-fe2a-43ef-8b9b-b90f677d7f50 service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Updating instance_info_cache with network_info: [{"id": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "address": "fa:16:3e:12:ae:4a", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c66a9f-39", "ovs_interfaceid": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:52:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b2a52c69-47c1-4acf-b2c2-735405887051 req-24c7fa46-fe2a-43ef-8b9b-b90f677d7f50 service nova] Releasing lock "refresh_cache-e7ac6a94-05a2-4b11-a541-26b1d1dae070" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:52:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:07 user nova-compute[73104]: DEBUG nova.compute.manager [req-0d23ed35-270b-4e35-87d6-bb5c4d7db8b6 req-0ccd0f1f-7734-48be-adf1-07fc84b85aae service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Received event network-changed-a2c66a9f-398a-4f45-a821-5105e68bb4f4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:52:07 user nova-compute[73104]: DEBUG nova.compute.manager [req-0d23ed35-270b-4e35-87d6-bb5c4d7db8b6 req-0ccd0f1f-7734-48be-adf1-07fc84b85aae service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Refreshing instance network info cache due to event network-changed-a2c66a9f-398a-4f45-a821-5105e68bb4f4. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:52:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0d23ed35-270b-4e35-87d6-bb5c4d7db8b6 req-0ccd0f1f-7734-48be-adf1-07fc84b85aae service nova] Acquiring lock "refresh_cache-e7ac6a94-05a2-4b11-a541-26b1d1dae070" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:52:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0d23ed35-270b-4e35-87d6-bb5c4d7db8b6 req-0ccd0f1f-7734-48be-adf1-07fc84b85aae service nova] Acquired lock "refresh_cache-e7ac6a94-05a2-4b11-a541-26b1d1dae070" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:52:07 user nova-compute[73104]: DEBUG nova.network.neutron [req-0d23ed35-270b-4e35-87d6-bb5c4d7db8b6 req-0ccd0f1f-7734-48be-adf1-07fc84b85aae service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Refreshing network info cache for port a2c66a9f-398a-4f45-a821-5105e68bb4f4 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:52:08 user nova-compute[73104]: DEBUG nova.network.neutron [req-0d23ed35-270b-4e35-87d6-bb5c4d7db8b6 req-0ccd0f1f-7734-48be-adf1-07fc84b85aae service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Updated VIF entry in instance network info cache for port a2c66a9f-398a-4f45-a821-5105e68bb4f4. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:52:08 user nova-compute[73104]: DEBUG nova.network.neutron [req-0d23ed35-270b-4e35-87d6-bb5c4d7db8b6 req-0ccd0f1f-7734-48be-adf1-07fc84b85aae service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Updating instance_info_cache with network_info: [{"id": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "address": "fa:16:3e:12:ae:4a", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c66a9f-39", "ovs_interfaceid": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:52:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0d23ed35-270b-4e35-87d6-bb5c4d7db8b6 req-0ccd0f1f-7734-48be-adf1-07fc84b85aae service nova] Releasing lock "refresh_cache-e7ac6a94-05a2-4b11-a541-26b1d1dae070" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:52:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:52:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:52:14 user nova-compute[73104]: INFO nova.compute.manager [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Rebooting instance
Aug 26 08:52:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "refresh_cache-e7ac6a94-05a2-4b11-a541-26b1d1dae070" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:52:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquired lock "refresh_cache-e7ac6a94-05a2-4b11-a541-26b1d1dae070" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:52:15 user nova-compute[73104]: DEBUG nova.network.neutron [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:52:15 user nova-compute[73104]: DEBUG nova.network.neutron [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Updating instance_info_cache with network_info: [{"id": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "address": "fa:16:3e:12:ae:4a", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c66a9f-39", "ovs_interfaceid": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:52:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Releasing lock "refresh_cache-e7ac6a94-05a2-4b11-a541-26b1d1dae070" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:52:15 user nova-compute[73104]: DEBUG nova.compute.manager [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:52:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:15 user nova-compute[73104]: DEBUG nova.compute.manager [req-7b4bccaf-17f2-4ec3-bace-a2dee021c067 req-740df188-7709-4aaf-b5e6-e8ef5fb00a70 service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Received event network-vif-unplugged-a2c66a9f-398a-4f45-a821-5105e68bb4f4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:52:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-7b4bccaf-17f2-4ec3-bace-a2dee021c067 req-740df188-7709-4aaf-b5e6-e8ef5fb00a70 service nova] Acquiring lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:52:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-7b4bccaf-17f2-4ec3-bace-a2dee021c067 req-740df188-7709-4aaf-b5e6-e8ef5fb00a70 service nova] Lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:52:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-7b4bccaf-17f2-4ec3-bace-a2dee021c067 req-740df188-7709-4aaf-b5e6-e8ef5fb00a70 service nova] Lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:52:15 user nova-compute[73104]: DEBUG nova.compute.manager [req-7b4bccaf-17f2-4ec3-bace-a2dee021c067 req-740df188-7709-4aaf-b5e6-e8ef5fb00a70 service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] No waiting events found dispatching network-vif-unplugged-a2c66a9f-398a-4f45-a821-5105e68bb4f4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:52:15 user nova-compute[73104]: WARNING nova.compute.manager [req-7b4bccaf-17f2-4ec3-bace-a2dee021c067 req-740df188-7709-4aaf-b5e6-e8ef5fb00a70 service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Received unexpected event network-vif-unplugged-a2c66a9f-398a-4f45-a821-5105e68bb4f4 for instance with vm_state active and task_state reboot_started_hard.
Aug 26 08:52:16 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Instance destroyed successfully.
Aug 26 08:52:16 user nova-compute[73104]: DEBUG nova.objects.instance [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lazy-loading 'resources' on Instance uuid e7ac6a94-05a2-4b11-a541-26b1d1dae070 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:49:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2138351221',display_name='tempest-TestMinimumBasicScenario-server-2138351221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2138351221',id=27,image_ref='caf1cead-10a3-4849-8ac8-41228db7483f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDf00vmyBYw2P7QhlbDbc1fxtWuQ5FRLimltxpKURXRzn5zjIkyr4ORgtHBY8o9wAiBvVJ9BzrGsFCqEeA1uJ71YqknXVzsYW5BkhDEkS/bhJees5zknqzrUGDIQpFutQ==',key_name='tempest-TestMinimumBasicScenario-523425789',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:49:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='718e3cb41d5342069cd73b96bade97e7',ramdisk_id='',reservation_id='r-ceg6sez0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='caf1cead-10a3-4849-8ac8-41228db7483f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1112860810',owner_user_name='tempest-TestMinimumBasicScenario-1112860810-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:52:16Z,user_data=None,user_id='6fd47a4b6ae846a79a378d6ed543fd1c',uuid=e7ac6a94-05a2-4b11-a541-26b1d1dae070,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "address": "fa:16:3e:12:ae:4a", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c66a9f-39", "ovs_interfaceid": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Converting VIF {"id": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "address": "fa:16:3e:12:ae:4a", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c66a9f-39", "ovs_interfaceid": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:ae:4a,bridge_name='br-int',has_traffic_filtering=True,id=a2c66a9f-398a-4f45-a821-5105e68bb4f4,network=Network(85684c43-d34e-47e3-a067-9c4fb1520baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2c66a9f-39') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG os_vif [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:ae:4a,bridge_name='br-int',has_traffic_filtering=True,id=a2c66a9f-398a-4f45-a821-5105e68bb4f4,network=Network(85684c43-d34e-47e3-a067-9c4fb1520baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2c66a9f-39') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2c66a9f-39, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:52:16 user nova-compute[73104]: INFO os_vif [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:ae:4a,bridge_name='br-int',has_traffic_filtering=True,id=a2c66a9f-398a-4f45-a821-5105e68bb4f4,network=Network(85684c43-d34e-47e3-a067-9c4fb1520baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2c66a9f-39')
Aug 26 08:52:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KwpHJSaR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:52:16 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:52:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb2f7e3-7888-4100-af23-481e3015ec5b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebededc5-3c8b-457f-a954-995de4b4fd4b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:52:16 user nova-compute[73104]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e (non-flash)
Aug 26 08:52:16 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:52:16 user nova-compute[73104]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e (non-flash)
Aug 26 08:52:16 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0d1bf89d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e'): ({'sdc'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Removing single pathed devices sdc {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff020d7-c9a1-4c82-9cda-692589a56279]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.035s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b320db8-de5c-4c45-8981-637b8eb072ef]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Flushing IO for device /dev/sdc {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.114s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e787c5c4-e40a-45ad-a26f-84e17f18867b]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b5251c-038d-4b09-9483-a904c2116ca1]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] SCSI volumes sdc have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3e7a19-f900-4c9d-b0c6-b68f432eb70c]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[097d3d7c-d82b-4ec6-a3f1-f83de423246c]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e, portal: 172.16.0.220,3260]
Aug 26 08:52:16 user nova-compute[73104]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e, portal: 172.16.0.220,3260] successful.
Aug 26 08:52:16 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee229a1-9e70-4d19-82da-30616a802f05]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] <== disconnect_volume: return (400ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Start _get_guest_xml network_info=[{"id": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "address": "fa:16:3e:12:ae:4a", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c66a9f-39", "ovs_interfaceid": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=caf1cead-10a3-4849-8ac8-41228db7483f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'caf1cead-10a3-4849-8ac8-41228db7483f'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'bcdb6e84-46ab-499b-827f-8a8320a1ac15', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KwpHJSaR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'e7ac6a94-05a2-4b11-a541-26b1d1dae070', 'attached_at': '', 'detached_at': '', 'volume_id': 'd97a6724-3b89-42f0-9ba7-ee0904e9993e', 'serial': 'd97a6724-3b89-42f0-9ba7-ee0904e9993e'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:52:16 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:52:16 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:52:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=caf1cead-10a3-4849-8ac8-41228db7483f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG nova.objects.instance [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lazy-loading 'vcpu_model' on Instance uuid e7ac6a94-05a2-4b11-a541-26b1d1dae070 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG nova.objects.base [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Object Instance<e7ac6a94-05a2-4b11-a541-26b1d1dae070> lazy-loaded attributes: resources,vcpu_model {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KwpHJSaR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:52:16 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:52:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:52:16 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:52:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:52:16 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[559f6a36-357f-446f-a325-4d74185a0db0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:52:16 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f21936-a9be-4e57-b0a3-1da4b11778f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e] added
Aug 26 08:52:16 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d0601d-940f-4228-89fb-f05567b97b9b]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3193b7fe-ab81-4afe-83f7-473e8aa3b17b]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KwpHJSaR {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KwpHJSaR" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fba0abb-1d5e-4381-9c30-4a3b485a2125]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:52:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KwpHJSaR'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8cd016-feba-43d8-bc05-68387e30ad1c]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1bd4f3-8b2a-49d9-b10f-5d27a29f20eb]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:52:17 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:52:17 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abaa2f8-20ca-4f0d-8b6f-41332aa6cbd1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e, portal: 172.16.0.220,3260]
Aug 26 08:52:17 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e, portal: 172.16.0.220,3260] successful.
Aug 26 08:52:17 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df80856-27c9-438b-8cd0-8db39ebf9d95]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec00ab4b-ecb0-4b24-88ee-32150ac07ff8]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:52:17 user nova-compute[73104]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e (non-flash)
Aug 26 08:52:17 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:52:17 user nova-compute[73104]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e (non-flash)
Aug 26 08:52:17 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[466e17c2-9a7e-469c-adf7-97ef7791d3b6]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: None {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG nova.compute.manager [req-f9af877e-0a0d-4824-8469-31f46206f29b req-9646f1a4-5928-4caf-bdda-2c2d929d47af service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Received event network-vif-plugged-a2c66a9f-398a-4f45-a821-5105e68bb4f4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f9af877e-0a0d-4824-8469-31f46206f29b req-9646f1a4-5928-4caf-bdda-2c2d929d47af service nova] Acquiring lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f9af877e-0a0d-4824-8469-31f46206f29b req-9646f1a4-5928-4caf-bdda-2c2d929d47af service nova] Lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f9af877e-0a0d-4824-8469-31f46206f29b req-9646f1a4-5928-4caf-bdda-2c2d929d47af service nova] Lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:52:17 user nova-compute[73104]: DEBUG nova.compute.manager [req-f9af877e-0a0d-4824-8469-31f46206f29b req-9646f1a4-5928-4caf-bdda-2c2d929d47af service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] No waiting events found dispatching network-vif-plugged-a2c66a9f-398a-4f45-a821-5105e68bb4f4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:52:17 user nova-compute[73104]: WARNING nova.compute.manager [req-f9af877e-0a0d-4824-8469-31f46206f29b req-9646f1a4-5928-4caf-bdda-2c2d929d47af service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Received unexpected event network-vif-plugged-a2c66a9f-398a-4f45-a821-5105e68bb4f4 for instance with vm_state active and task_state reboot_started_hard.
Aug 26 08:52:18 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:52:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KwpHJSaR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:52:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:52:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26163663835353638', 'path': '/dev/sdc'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:52:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163663835353638', 'path': '/dev/sdc'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:52:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:49:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2138351221',display_name='tempest-TestMinimumBasicScenario-server-2138351221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2138351221',id=27,image_ref='caf1cead-10a3-4849-8ac8-41228db7483f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDf00vmyBYw2P7QhlbDbc1fxtWuQ5FRLimltxpKURXRzn5zjIkyr4ORgtHBY8o9wAiBvVJ9BzrGsFCqEeA1uJ71YqknXVzsYW5BkhDEkS/bhJees5zknqzrUGDIQpFutQ==',key_name='tempest-TestMinimumBasicScenario-523425789',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:49:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='718e3cb41d5342069cd73b96bade97e7',ramdisk_id='',reservation_id='r-ceg6sez0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='caf1cead-10a3-4849-8ac8-41228db7483f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1112860810',owner_user_name='tempest-TestMinimumBasicScenario-1112860810-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:52:16Z,user_data=None,user_id='6fd47a4b6ae846a79a378d6ed543fd1c',uuid=e7ac6a94-05a2-4b11-a541-26b1d1dae070,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "address": "fa:16:3e:12:ae:4a", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c66a9f-39", "ovs_interfaceid": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:52:18 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Converting VIF {"id": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "address": "fa:16:3e:12:ae:4a", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c66a9f-39", "ovs_interfaceid": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:52:18 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:ae:4a,bridge_name='br-int',has_traffic_filtering=True,id=a2c66a9f-398a-4f45-a821-5105e68bb4f4,network=Network(85684c43-d34e-47e3-a067-9c4fb1520baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2c66a9f-39') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:52:18 user nova-compute[73104]: DEBUG nova.objects.instance [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lazy-loading 'pci_devices' on Instance uuid e7ac6a94-05a2-4b11-a541-26b1d1dae070 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:52:18 user nova-compute[73104]: DEBUG nova.objects.base [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Object Instance<e7ac6a94-05a2-4b11-a541-26b1d1dae070> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:52:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:52:18 user nova-compute[73104]:   <uuid>e7ac6a94-05a2-4b11-a541-26b1d1dae070</uuid>
Aug 26 08:52:18 user nova-compute[73104]:   <name>instance-0000001b</name>
Aug 26 08:52:18 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:52:18 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:52:18 user nova-compute[73104]:   <metadata>
Aug 26 08:52:18 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:52:18 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:52:18 user nova-compute[73104]:       <nova:name>tempest-TestMinimumBasicScenario-server-2138351221</nova:name>
Aug 26 08:52:18 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:52:16</nova:creationTime>
Aug 26 08:52:18 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:52:18 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:52:18 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:52:18 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:52:18 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:52:18 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:52:18 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:52:18 user nova-compute[73104]:       <nova:owner>
Aug 26 08:52:18 user nova-compute[73104]:         <nova:user uuid="6fd47a4b6ae846a79a378d6ed543fd1c">tempest-TestMinimumBasicScenario-1112860810-project-member</nova:user>
Aug 26 08:52:18 user nova-compute[73104]:         <nova:project uuid="718e3cb41d5342069cd73b96bade97e7">tempest-TestMinimumBasicScenario-1112860810</nova:project>
Aug 26 08:52:18 user nova-compute[73104]:       </nova:owner>
Aug 26 08:52:18 user nova-compute[73104]:       <nova:root type="image" uuid="caf1cead-10a3-4849-8ac8-41228db7483f"/>
Aug 26 08:52:18 user nova-compute[73104]:       <nova:ports>
Aug 26 08:52:18 user nova-compute[73104]:         <nova:port uuid="a2c66a9f-398a-4f45-a821-5105e68bb4f4">
Aug 26 08:52:18 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 08:52:18 user nova-compute[73104]:         </nova:port>
Aug 26 08:52:18 user nova-compute[73104]:       </nova:ports>
Aug 26 08:52:18 user nova-compute[73104]:     </nova:instance>
Aug 26 08:52:18 user nova-compute[73104]:   </metadata>
Aug 26 08:52:18 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:52:18 user nova-compute[73104]:     <system>
Aug 26 08:52:18 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:52:18 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:52:18 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:52:18 user nova-compute[73104]:       <entry name="serial">e7ac6a94-05a2-4b11-a541-26b1d1dae070</entry>
Aug 26 08:52:18 user nova-compute[73104]:       <entry name="uuid">e7ac6a94-05a2-4b11-a541-26b1d1dae070</entry>
Aug 26 08:52:18 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:52:18 user nova-compute[73104]:     </system>
Aug 26 08:52:18 user nova-compute[73104]:   </sysinfo>
Aug 26 08:52:18 user nova-compute[73104]:   <os>
Aug 26 08:52:18 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:52:18 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:52:18 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:52:18 user nova-compute[73104]:   </os>
Aug 26 08:52:18 user nova-compute[73104]:   <features>
Aug 26 08:52:18 user nova-compute[73104]:     <acpi/>
Aug 26 08:52:18 user nova-compute[73104]:     <apic/>
Aug 26 08:52:18 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:52:18 user nova-compute[73104]:   </features>
Aug 26 08:52:18 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:52:18 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:52:18 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:52:18 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:52:18 user nova-compute[73104]:   </clock>
Aug 26 08:52:18 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:52:18 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:52:18 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:52:18 user nova-compute[73104]:   </cpu>
Aug 26 08:52:18 user nova-compute[73104]:   <devices>
Aug 26 08:52:18 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:52:18 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:52:18 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk"/>
Aug 26 08:52:18 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:52:18 user nova-compute[73104]:     </disk>
Aug 26 08:52:18 user nova-compute[73104]:     <disk type="block" device="disk">
Aug 26 08:52:18 user nova-compute[73104]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:52:18 user nova-compute[73104]:       <source dev="/dev/sdc"/>
Aug 26 08:52:18 user nova-compute[73104]:       <target dev="vdb" bus="virtio"/>
Aug 26 08:52:18 user nova-compute[73104]:       <serial>d97a6724-3b89-42f0-9ba7-ee0904e9993e</serial>
Aug 26 08:52:18 user nova-compute[73104]:     </disk>
Aug 26 08:52:18 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:52:18 user nova-compute[73104]:       <mac address="fa:16:3e:12:ae:4a"/>
Aug 26 08:52:18 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:52:18 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:52:18 user nova-compute[73104]:       <target dev="tapa2c66a9f-39"/>
Aug 26 08:52:18 user nova-compute[73104]:     </interface>
Aug 26 08:52:18 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:52:18 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/console.log" append="off"/>
Aug 26 08:52:18 user nova-compute[73104]:     </serial>
Aug 26 08:52:18 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:52:18 user nova-compute[73104]:     <video>
Aug 26 08:52:18 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:52:18 user nova-compute[73104]:     </video>
Aug 26 08:52:18 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:52:18 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:52:18 user nova-compute[73104]:     </rng>
Aug 26 08:52:18 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:52:18 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:52:18 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:52:18 user nova-compute[73104]:     </memballoon>
Aug 26 08:52:18 user nova-compute[73104]:   </devices>
Aug 26 08:52:18 user nova-compute[73104]: </domain>
Aug 26 08:52:18 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:52:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:52:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:52:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:52:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:52:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:52:18 user nova-compute[73104]: DEBUG nova.objects.instance [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lazy-loading 'trusted_certs' on Instance uuid e7ac6a94-05a2-4b11-a541-26b1d1dae070 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:52:18 user nova-compute[73104]: DEBUG nova.objects.base [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Object Instance<e7ac6a94-05a2-4b11-a541-26b1d1dae070> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:52:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44cb1fa5c00d8d1d4cd98702e1537f28f822a859 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:52:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44cb1fa5c00d8d1d4cd98702e1537f28f822a859 --force-share --output=json" returned: 0 in 0.175s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:52:18 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 08:52:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:52:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:52:18 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Cannot resize image /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 08:52:18 user nova-compute[73104]: DEBUG nova.objects.instance [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lazy-loading 'migration_context' on Instance uuid e7ac6a94-05a2-4b11-a541-26b1d1dae070 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:52:18 user nova-compute[73104]: DEBUG nova.objects.base [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Object Instance<e7ac6a94-05a2-4b11-a541-26b1d1dae070> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:52:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:49:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2138351221',display_name='tempest-TestMinimumBasicScenario-server-2138351221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2138351221',id=27,image_ref='caf1cead-10a3-4849-8ac8-41228db7483f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDf00vmyBYw2P7QhlbDbc1fxtWuQ5FRLimltxpKURXRzn5zjIkyr4ORgtHBY8o9wAiBvVJ9BzrGsFCqEeA1uJ71YqknXVzsYW5BkhDEkS/bhJees5zknqzrUGDIQpFutQ==',key_name='tempest-TestMinimumBasicScenario-523425789',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:49:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='718e3cb41d5342069cd73b96bade97e7',ramdisk_id='',reservation_id='r-ceg6sez0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='caf1cead-10a3-4849-8ac8-41228db7483f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1112860810',owner_user_name='tempest-TestMinimumBasicScenario-1112860810-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:52:16Z,user_data=None,user_id='6fd47a4b6ae846a79a378d6ed543fd1c',uuid=e7ac6a94-05a2-4b11-a541-26b1d1dae070,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "address": "fa:16:3e:12:ae:4a", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c66a9f-39", "ovs_interfaceid": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:52:18 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Converting VIF {"id": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "address": "fa:16:3e:12:ae:4a", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c66a9f-39", "ovs_interfaceid": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:52:18 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:ae:4a,bridge_name='br-int',has_traffic_filtering=True,id=a2c66a9f-398a-4f45-a821-5105e68bb4f4,network=Network(85684c43-d34e-47e3-a067-9c4fb1520baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2c66a9f-39') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:52:18 user nova-compute[73104]: DEBUG os_vif [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:ae:4a,bridge_name='br-int',has_traffic_filtering=True,id=a2c66a9f-398a-4f45-a821-5105e68bb4f4,network=Network(85684c43-d34e-47e3-a067-9c4fb1520baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2c66a9f-39') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:52:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:52:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:52:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2c66a9f-39, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:52:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa2c66a9f-39, col_values=(('external_ids', {'iface-id': 'a2c66a9f-398a-4f45-a821-5105e68bb4f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:ae:4a', 'vm-uuid': 'e7ac6a94-05a2-4b11-a541-26b1d1dae070'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:52:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:52:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:19 user nova-compute[73104]: INFO os_vif [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:ae:4a,bridge_name='br-int',has_traffic_filtering=True,id=a2c66a9f-398a-4f45-a821-5105e68bb4f4,network=Network(85684c43-d34e-47e3-a067-9c4fb1520baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2c66a9f-39')
Aug 26 08:52:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:20 user nova-compute[73104]: DEBUG nova.compute.manager [req-0b458264-2476-42b5-b921-e6c996131e94 req-6cea4363-0128-4bb0-a7b4-4d2acd1c4848 service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Received event network-vif-plugged-a2c66a9f-398a-4f45-a821-5105e68bb4f4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:52:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0b458264-2476-42b5-b921-e6c996131e94 req-6cea4363-0128-4bb0-a7b4-4d2acd1c4848 service nova] Acquiring lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:52:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0b458264-2476-42b5-b921-e6c996131e94 req-6cea4363-0128-4bb0-a7b4-4d2acd1c4848 service nova] Lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:52:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0b458264-2476-42b5-b921-e6c996131e94 req-6cea4363-0128-4bb0-a7b4-4d2acd1c4848 service nova] Lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:52:20 user nova-compute[73104]: DEBUG nova.compute.manager [req-0b458264-2476-42b5-b921-e6c996131e94 req-6cea4363-0128-4bb0-a7b4-4d2acd1c4848 service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] No waiting events found dispatching network-vif-plugged-a2c66a9f-398a-4f45-a821-5105e68bb4f4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:52:20 user nova-compute[73104]: WARNING nova.compute.manager [req-0b458264-2476-42b5-b921-e6c996131e94 req-6cea4363-0128-4bb0-a7b4-4d2acd1c4848 service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Received unexpected event network-vif-plugged-a2c66a9f-398a-4f45-a821-5105e68bb4f4 for instance with vm_state active and task_state reboot_started_hard.
Aug 26 08:52:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-65adecb4-2897-4a2f-9d7e-b3a4aef06f40 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Acquiring lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-65adecb4-2897-4a2f-9d7e-b3a4aef06f40 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-65adecb4-2897-4a2f-9d7e-b3a4aef06f40 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Acquiring lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-65adecb4-2897-4a2f-9d7e-b3a4aef06f40 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-65adecb4-2897-4a2f-9d7e-b3a4aef06f40 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:52:22 user nova-compute[73104]: INFO nova.compute.manager [None req-65adecb4-2897-4a2f-9d7e-b3a4aef06f40 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Terminating instance
Aug 26 08:52:22 user nova-compute[73104]: DEBUG nova.compute.manager [None req-65adecb4-2897-4a2f-9d7e-b3a4aef06f40 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Removed pending event for e7ac6a94-05a2-4b11-a541-26b1d1dae070 due to event {{(pid=73104) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039942.4226496, e7ac6a94-05a2-4b11-a541-26b1d1dae070 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:52:22 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] VM Resumed (Lifecycle Event)
Aug 26 08:52:22 user nova-compute[73104]: DEBUG nova.compute.manager [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:52:22 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Instance rebooted successfully.
Aug 26 08:52:22 user nova-compute[73104]: DEBUG nova.compute.manager [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG nova.compute.manager [req-ef894d8f-6687-42b5-9bde-8ed84de68b06 req-ec415e05-0bec-4499-bcfc-82da6101e1aa service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received event network-vif-unplugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ef894d8f-6687-42b5-9bde-8ed84de68b06 req-ec415e05-0bec-4499-bcfc-82da6101e1aa service nova] Acquiring lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ef894d8f-6687-42b5-9bde-8ed84de68b06 req-ec415e05-0bec-4499-bcfc-82da6101e1aa service nova] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ef894d8f-6687-42b5-9bde-8ed84de68b06 req-ec415e05-0bec-4499-bcfc-82da6101e1aa service nova] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG nova.compute.manager [req-ef894d8f-6687-42b5-9bde-8ed84de68b06 req-ec415e05-0bec-4499-bcfc-82da6101e1aa service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] No waiting events found dispatching network-vif-unplugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG nova.compute.manager [req-ef894d8f-6687-42b5-9bde-8ed84de68b06 req-ec415e05-0bec-4499-bcfc-82da6101e1aa service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received event network-vif-unplugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:52:22 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 26 08:52:22 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039942.4242275, e7ac6a94-05a2-4b11-a541-26b1d1dae070 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:52:22 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] VM Started (Lifecycle Event)
Aug 26 08:52:22 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b42188df-fa4b-432b-acea-e9b31c1b9884 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.540s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG nova.compute.manager [req-e80474d7-3aa6-430d-a9e7-fa7bd9758809 req-8cdc7ece-93a6-42ac-9e37-345fecfb3533 service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Received event network-vif-plugged-a2c66a9f-398a-4f45-a821-5105e68bb4f4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e80474d7-3aa6-430d-a9e7-fa7bd9758809 req-8cdc7ece-93a6-42ac-9e37-345fecfb3533 service nova] Acquiring lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e80474d7-3aa6-430d-a9e7-fa7bd9758809 req-8cdc7ece-93a6-42ac-9e37-345fecfb3533 service nova] Lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e80474d7-3aa6-430d-a9e7-fa7bd9758809 req-8cdc7ece-93a6-42ac-9e37-345fecfb3533 service nova] Lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG nova.compute.manager [req-e80474d7-3aa6-430d-a9e7-fa7bd9758809 req-8cdc7ece-93a6-42ac-9e37-345fecfb3533 service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] No waiting events found dispatching network-vif-plugged-a2c66a9f-398a-4f45-a821-5105e68bb4f4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:52:22 user nova-compute[73104]: WARNING nova.compute.manager [req-e80474d7-3aa6-430d-a9e7-fa7bd9758809 req-8cdc7ece-93a6-42ac-9e37-345fecfb3533 service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Received unexpected event network-vif-plugged-a2c66a9f-398a-4f45-a821-5105e68bb4f4 for instance with vm_state active and task_state None.
Aug 26 08:52:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:22 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Instance destroyed successfully.
Aug 26 08:52:22 user nova-compute[73104]: DEBUG nova.objects.instance [None req-65adecb4-2897-4a2f-9d7e-b3a4aef06f40 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lazy-loading 'resources' on Instance uuid 02665c70-cf75-44ba-9d90-eb9e5f12e0b7 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-65adecb4-2897-4a2f-9d7e-b3a4aef06f40 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:45:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-173756414',display_name='tempest-ServerStableDeviceRescueTest-server-173756414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-173756414',id=22,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDA0D9deqQAjrCLJd7vYB9eHa6xBscEdhGpQZkcJVmul30WTV05uYFTJHfePlsMdjM8/w/MauXZ8IM+tEsl3F9Wrd1BEMVqInSiZ7zedxOHCI2tOBe+m4M5LA+fV7gmJQ==',key_name='tempest-keypair-1663477319',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:49:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='994053e8d737440f8cb22f048a3c1873',ramdisk_id='',reservation_id='r-1a4hiypw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1186902489',owner_user_name='tempest-ServerStableDeviceRescueTest-1186902489-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:51:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b62f9580b597480eb0a775a160dadba4',uuid=02665c70-cf75-44ba-9d90-eb9e5f12e0b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "address": "fa:16:3e:d9:91:54", "network": {"id": "d09a6d6b-0c92-4bc3-a691-0aa3911d756e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1480336812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "994053e8d737440f8cb22f048a3c1873", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4b7f02-03", "ovs_interfaceid": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-65adecb4-2897-4a2f-9d7e-b3a4aef06f40 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Converting VIF {"id": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "address": "fa:16:3e:d9:91:54", "network": {"id": "d09a6d6b-0c92-4bc3-a691-0aa3911d756e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1480336812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "994053e8d737440f8cb22f048a3c1873", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4b7f02-03", "ovs_interfaceid": "af4b7f02-03f5-492b-9d27-4d7e5523b423", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-65adecb4-2897-4a2f-9d7e-b3a4aef06f40 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:91:54,bridge_name='br-int',has_traffic_filtering=True,id=af4b7f02-03f5-492b-9d27-4d7e5523b423,network=Network(d09a6d6b-0c92-4bc3-a691-0aa3911d756e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4b7f02-03') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG os_vif [None req-65adecb4-2897-4a2f-9d7e-b3a4aef06f40 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:91:54,bridge_name='br-int',has_traffic_filtering=True,id=af4b7f02-03f5-492b-9d27-4d7e5523b423,network=Network(d09a6d6b-0c92-4bc3-a691-0aa3911d756e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4b7f02-03') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf4b7f02-03, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:22 user nova-compute[73104]: INFO os_vif [None req-65adecb4-2897-4a2f-9d7e-b3a4aef06f40 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:91:54,bridge_name='br-int',has_traffic_filtering=True,id=af4b7f02-03f5-492b-9d27-4d7e5523b423,network=Network(d09a6d6b-0c92-4bc3-a691-0aa3911d756e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4b7f02-03')
Aug 26 08:52:22 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-65adecb4-2897-4a2f-9d7e-b3a4aef06f40 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Deleting instance files /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7_del
Aug 26 08:52:22 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-65adecb4-2897-4a2f-9d7e-b3a4aef06f40 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Deletion of /opt/stack/data/nova/instances/02665c70-cf75-44ba-9d90-eb9e5f12e0b7_del complete
Aug 26 08:52:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:22 user nova-compute[73104]: INFO nova.compute.manager [None req-65adecb4-2897-4a2f-9d7e-b3a4aef06f40 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 26 08:52:22 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-65adecb4-2897-4a2f-9d7e-b3a4aef06f40 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 08:52:22 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 08:52:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:23 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:52:23 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Took 1.01 seconds to deallocate network for instance.
Aug 26 08:52:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-65adecb4-2897-4a2f-9d7e-b3a4aef06f40 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:52:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-65adecb4-2897-4a2f-9d7e-b3a4aef06f40 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:52:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:24 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-65adecb4-2897-4a2f-9d7e-b3a4aef06f40 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:52:24 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-65adecb4-2897-4a2f-9d7e-b3a4aef06f40 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:52:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-65adecb4-2897-4a2f-9d7e-b3a4aef06f40 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:52:24 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-65adecb4-2897-4a2f-9d7e-b3a4aef06f40 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Deleted allocations for instance 02665c70-cf75-44ba-9d90-eb9e5f12e0b7
Aug 26 08:52:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-65adecb4-2897-4a2f-9d7e-b3a4aef06f40 tempest-ServerStableDeviceRescueTest-1186902489 tempest-ServerStableDeviceRescueTest-1186902489-project-member] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.385s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:52:24 user nova-compute[73104]: DEBUG nova.compute.manager [req-902d6f39-9234-4045-9d06-59db5721a691 req-83a14511-90ff-4cb5-a0fc-545c42e4ab54 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received event network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:52:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-902d6f39-9234-4045-9d06-59db5721a691 req-83a14511-90ff-4cb5-a0fc-545c42e4ab54 service nova] Acquiring lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:52:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-902d6f39-9234-4045-9d06-59db5721a691 req-83a14511-90ff-4cb5-a0fc-545c42e4ab54 service nova] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:52:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-902d6f39-9234-4045-9d06-59db5721a691 req-83a14511-90ff-4cb5-a0fc-545c42e4ab54 service nova] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:52:24 user nova-compute[73104]: DEBUG nova.compute.manager [req-902d6f39-9234-4045-9d06-59db5721a691 req-83a14511-90ff-4cb5-a0fc-545c42e4ab54 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] No waiting events found dispatching network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:52:24 user nova-compute[73104]: WARNING nova.compute.manager [req-902d6f39-9234-4045-9d06-59db5721a691 req-83a14511-90ff-4cb5-a0fc-545c42e4ab54 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received unexpected event network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 for instance with vm_state deleted and task_state None.
Aug 26 08:52:24 user nova-compute[73104]: DEBUG nova.compute.manager [req-902d6f39-9234-4045-9d06-59db5721a691 req-83a14511-90ff-4cb5-a0fc-545c42e4ab54 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received event network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:52:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-902d6f39-9234-4045-9d06-59db5721a691 req-83a14511-90ff-4cb5-a0fc-545c42e4ab54 service nova] Acquiring lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:52:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-902d6f39-9234-4045-9d06-59db5721a691 req-83a14511-90ff-4cb5-a0fc-545c42e4ab54 service nova] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:52:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-902d6f39-9234-4045-9d06-59db5721a691 req-83a14511-90ff-4cb5-a0fc-545c42e4ab54 service nova] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:52:24 user nova-compute[73104]: DEBUG nova.compute.manager [req-902d6f39-9234-4045-9d06-59db5721a691 req-83a14511-90ff-4cb5-a0fc-545c42e4ab54 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] No waiting events found dispatching network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:52:24 user nova-compute[73104]: WARNING nova.compute.manager [req-902d6f39-9234-4045-9d06-59db5721a691 req-83a14511-90ff-4cb5-a0fc-545c42e4ab54 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received unexpected event network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 for instance with vm_state deleted and task_state None.
Aug 26 08:52:24 user nova-compute[73104]: DEBUG nova.compute.manager [req-902d6f39-9234-4045-9d06-59db5721a691 req-83a14511-90ff-4cb5-a0fc-545c42e4ab54 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received event network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:52:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-902d6f39-9234-4045-9d06-59db5721a691 req-83a14511-90ff-4cb5-a0fc-545c42e4ab54 service nova] Acquiring lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:52:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-902d6f39-9234-4045-9d06-59db5721a691 req-83a14511-90ff-4cb5-a0fc-545c42e4ab54 service nova] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:52:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-902d6f39-9234-4045-9d06-59db5721a691 req-83a14511-90ff-4cb5-a0fc-545c42e4ab54 service nova] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:52:24 user nova-compute[73104]: DEBUG nova.compute.manager [req-902d6f39-9234-4045-9d06-59db5721a691 req-83a14511-90ff-4cb5-a0fc-545c42e4ab54 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] No waiting events found dispatching network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:52:24 user nova-compute[73104]: WARNING nova.compute.manager [req-902d6f39-9234-4045-9d06-59db5721a691 req-83a14511-90ff-4cb5-a0fc-545c42e4ab54 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received unexpected event network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 for instance with vm_state deleted and task_state None.
Aug 26 08:52:24 user nova-compute[73104]: DEBUG nova.compute.manager [req-902d6f39-9234-4045-9d06-59db5721a691 req-83a14511-90ff-4cb5-a0fc-545c42e4ab54 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received event network-vif-unplugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:52:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-902d6f39-9234-4045-9d06-59db5721a691 req-83a14511-90ff-4cb5-a0fc-545c42e4ab54 service nova] Acquiring lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:52:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-902d6f39-9234-4045-9d06-59db5721a691 req-83a14511-90ff-4cb5-a0fc-545c42e4ab54 service nova] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:52:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-902d6f39-9234-4045-9d06-59db5721a691 req-83a14511-90ff-4cb5-a0fc-545c42e4ab54 service nova] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:52:24 user nova-compute[73104]: DEBUG nova.compute.manager [req-902d6f39-9234-4045-9d06-59db5721a691 req-83a14511-90ff-4cb5-a0fc-545c42e4ab54 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] No waiting events found dispatching network-vif-unplugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:52:24 user nova-compute[73104]: WARNING nova.compute.manager [req-902d6f39-9234-4045-9d06-59db5721a691 req-83a14511-90ff-4cb5-a0fc-545c42e4ab54 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received unexpected event network-vif-unplugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 for instance with vm_state deleted and task_state None.
Aug 26 08:52:24 user nova-compute[73104]: DEBUG nova.compute.manager [req-902d6f39-9234-4045-9d06-59db5721a691 req-83a14511-90ff-4cb5-a0fc-545c42e4ab54 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received event network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:52:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-902d6f39-9234-4045-9d06-59db5721a691 req-83a14511-90ff-4cb5-a0fc-545c42e4ab54 service nova] Acquiring lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:52:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-902d6f39-9234-4045-9d06-59db5721a691 req-83a14511-90ff-4cb5-a0fc-545c42e4ab54 service nova] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:52:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-902d6f39-9234-4045-9d06-59db5721a691 req-83a14511-90ff-4cb5-a0fc-545c42e4ab54 service nova] Lock "02665c70-cf75-44ba-9d90-eb9e5f12e0b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:52:24 user nova-compute[73104]: DEBUG nova.compute.manager [req-902d6f39-9234-4045-9d06-59db5721a691 req-83a14511-90ff-4cb5-a0fc-545c42e4ab54 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] No waiting events found dispatching network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:52:24 user nova-compute[73104]: WARNING nova.compute.manager [req-902d6f39-9234-4045-9d06-59db5721a691 req-83a14511-90ff-4cb5-a0fc-545c42e4ab54 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received unexpected event network-vif-plugged-af4b7f02-03f5-492b-9d27-4d7e5523b423 for instance with vm_state deleted and task_state None.
Aug 26 08:52:24 user nova-compute[73104]: DEBUG nova.compute.manager [req-2bf940ab-98e0-4d94-a025-fa0699504133 req-3387660b-fed3-4882-b097-d46e2a7d55f9 service nova] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Received event network-vif-deleted-af4b7f02-03f5-492b-9d27-4d7e5523b423 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:52:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "bf35aa10-80b1-4518-88b3-63c6a11e626b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:52:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "bf35aa10-80b1-4518-88b3-63c6a11e626b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:52:33 user nova-compute[73104]: DEBUG nova.compute.manager [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:52:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:52:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:52:33 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:52:33 user nova-compute[73104]: INFO nova.compute.claims [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Claim successful on node user
Aug 26 08:52:33 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:52:33 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:52:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:52:33 user nova-compute[73104]: DEBUG nova.compute.manager [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:52:33 user nova-compute[73104]: DEBUG nova.compute.manager [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:52:33 user nova-compute[73104]: DEBUG nova.network.neutron [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:52:34 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:52:34 user nova-compute[73104]: DEBUG nova.compute.manager [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:52:34 user nova-compute[73104]: DEBUG nova.policy [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bcd11beb7046440f814cbf4a13ab0272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a37356203d547c2abf0aa634c2ad548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:52:34 user nova-compute[73104]: DEBUG nova.compute.manager [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:52:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:52:34 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Creating image(s)
Aug 26 08:52:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:52:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "/opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:52:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "/opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:52:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:52:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.184s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:52:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:52:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:52:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:52:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.182s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:52:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:52:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk 1073741824" returned: 0 in 0.062s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:52:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:52:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:52:34 user nova-compute[73104]: DEBUG nova.network.neutron [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Successfully created port: ba4dd86b-d62a-48be-89c7-d63a6013a1ef {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:52:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.233s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:52:34 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 08:52:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Cannot resize image /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Ensure instance console log exists: /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG nova.network.neutron [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Successfully updated port: ba4dd86b-d62a-48be-89c7-d63a6013a1ef {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "refresh_cache-bf35aa10-80b1-4518-88b3-63c6a11e626b" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquired lock "refresh_cache-bf35aa10-80b1-4518-88b3-63c6a11e626b" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG nova.network.neutron [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG nova.compute.manager [req-e8cc0719-6317-40f4-b972-8b4707c92fde req-7032ca47-2223-4ffd-b3b3-884318b5a937 service nova] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Received event network-changed-ba4dd86b-d62a-48be-89c7-d63a6013a1ef {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG nova.compute.manager [req-e8cc0719-6317-40f4-b972-8b4707c92fde req-7032ca47-2223-4ffd-b3b3-884318b5a937 service nova] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Refreshing instance network info cache due to event network-changed-ba4dd86b-d62a-48be-89c7-d63a6013a1ef. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e8cc0719-6317-40f4-b972-8b4707c92fde req-7032ca47-2223-4ffd-b3b3-884318b5a937 service nova] Acquiring lock "refresh_cache-bf35aa10-80b1-4518-88b3-63c6a11e626b" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG nova.network.neutron [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG nova.network.neutron [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Updating instance_info_cache with network_info: [{"id": "ba4dd86b-d62a-48be-89c7-d63a6013a1ef", "address": "fa:16:3e:bc:d7:ff", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4dd86b-d6", "ovs_interfaceid": "ba4dd86b-d62a-48be-89c7-d63a6013a1ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Releasing lock "refresh_cache-bf35aa10-80b1-4518-88b3-63c6a11e626b" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Instance network_info: |[{"id": "ba4dd86b-d62a-48be-89c7-d63a6013a1ef", "address": "fa:16:3e:bc:d7:ff", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4dd86b-d6", "ovs_interfaceid": "ba4dd86b-d62a-48be-89c7-d63a6013a1ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e8cc0719-6317-40f4-b972-8b4707c92fde req-7032ca47-2223-4ffd-b3b3-884318b5a937 service nova] Acquired lock "refresh_cache-bf35aa10-80b1-4518-88b3-63c6a11e626b" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG nova.network.neutron [req-e8cc0719-6317-40f4-b972-8b4707c92fde req-7032ca47-2223-4ffd-b3b3-884318b5a937 service nova] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Refreshing network info cache for port ba4dd86b-d62a-48be-89c7-d63a6013a1ef {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Start _get_guest_xml network_info=[{"id": "ba4dd86b-d62a-48be-89c7-d63a6013a1ef", "address": "fa:16:3e:bc:d7:ff", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4dd86b-d6", "ovs_interfaceid": "ba4dd86b-d62a-48be-89c7-d63a6013a1ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:52:35 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:52:35 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:52:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:52:35 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:52:36 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-757348124',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-757348124',id=30,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a37356203d547c2abf0aa634c2ad548',ramdisk_id='',reservation_id='r-nwqltj8v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1111216102',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:52:34Z,user_data=None,user_id='bcd11beb7046440f814cbf4a13ab0272',uuid=bf35aa10-80b1-4518-88b3-63c6a11e626b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba4dd86b-d62a-48be-89c7-d63a6013a1ef", "address": "fa:16:3e:bc:d7:ff", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4dd86b-d6", "ovs_interfaceid": "ba4dd86b-d62a-48be-89c7-d63a6013a1ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:52:36 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Converting VIF {"id": "ba4dd86b-d62a-48be-89c7-d63a6013a1ef", "address": "fa:16:3e:bc:d7:ff", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4dd86b-d6", "ovs_interfaceid": "ba4dd86b-d62a-48be-89c7-d63a6013a1ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:52:36 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d7:ff,bridge_name='br-int',has_traffic_filtering=True,id=ba4dd86b-d62a-48be-89c7-d63a6013a1ef,network=Network(ce0a529c-2119-4b2a-a08f-567e3671c3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4dd86b-d6') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:52:36 user nova-compute[73104]: DEBUG nova.objects.instance [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lazy-loading 'pci_devices' on Instance uuid bf35aa10-80b1-4518-88b3-63c6a11e626b {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:52:36 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:52:36 user nova-compute[73104]:   <uuid>bf35aa10-80b1-4518-88b3-63c6a11e626b</uuid>
Aug 26 08:52:36 user nova-compute[73104]:   <name>instance-0000001e</name>
Aug 26 08:52:36 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:52:36 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:52:36 user nova-compute[73104]:   <metadata>
Aug 26 08:52:36 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:52:36 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:52:36 user nova-compute[73104]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-757348124</nova:name>
Aug 26 08:52:36 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:52:35</nova:creationTime>
Aug 26 08:52:36 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:52:36 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:52:36 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:52:36 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:52:36 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:52:36 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:52:36 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:52:36 user nova-compute[73104]:       <nova:owner>
Aug 26 08:52:36 user nova-compute[73104]:         <nova:user uuid="bcd11beb7046440f814cbf4a13ab0272">tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member</nova:user>
Aug 26 08:52:36 user nova-compute[73104]:         <nova:project uuid="8a37356203d547c2abf0aa634c2ad548">tempest-ServerBootFromVolumeStableRescueTest-1111216102</nova:project>
Aug 26 08:52:36 user nova-compute[73104]:       </nova:owner>
Aug 26 08:52:36 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:52:36 user nova-compute[73104]:       <nova:ports>
Aug 26 08:52:36 user nova-compute[73104]:         <nova:port uuid="ba4dd86b-d62a-48be-89c7-d63a6013a1ef">
Aug 26 08:52:36 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 08:52:36 user nova-compute[73104]:         </nova:port>
Aug 26 08:52:36 user nova-compute[73104]:       </nova:ports>
Aug 26 08:52:36 user nova-compute[73104]:     </nova:instance>
Aug 26 08:52:36 user nova-compute[73104]:   </metadata>
Aug 26 08:52:36 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:52:36 user nova-compute[73104]:     <system>
Aug 26 08:52:36 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:52:36 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:52:36 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:52:36 user nova-compute[73104]:       <entry name="serial">bf35aa10-80b1-4518-88b3-63c6a11e626b</entry>
Aug 26 08:52:36 user nova-compute[73104]:       <entry name="uuid">bf35aa10-80b1-4518-88b3-63c6a11e626b</entry>
Aug 26 08:52:36 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:52:36 user nova-compute[73104]:     </system>
Aug 26 08:52:36 user nova-compute[73104]:   </sysinfo>
Aug 26 08:52:36 user nova-compute[73104]:   <os>
Aug 26 08:52:36 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:52:36 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:52:36 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:52:36 user nova-compute[73104]:   </os>
Aug 26 08:52:36 user nova-compute[73104]:   <features>
Aug 26 08:52:36 user nova-compute[73104]:     <acpi/>
Aug 26 08:52:36 user nova-compute[73104]:     <apic/>
Aug 26 08:52:36 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:52:36 user nova-compute[73104]:   </features>
Aug 26 08:52:36 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:52:36 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:52:36 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:52:36 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:52:36 user nova-compute[73104]:   </clock>
Aug 26 08:52:36 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:52:36 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:52:36 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:52:36 user nova-compute[73104]:   </cpu>
Aug 26 08:52:36 user nova-compute[73104]:   <devices>
Aug 26 08:52:36 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:52:36 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:52:36 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk"/>
Aug 26 08:52:36 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:52:36 user nova-compute[73104]:     </disk>
Aug 26 08:52:36 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:52:36 user nova-compute[73104]:       <mac address="fa:16:3e:bc:d7:ff"/>
Aug 26 08:52:36 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:52:36 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:52:36 user nova-compute[73104]:       <target dev="tapba4dd86b-d6"/>
Aug 26 08:52:36 user nova-compute[73104]:     </interface>
Aug 26 08:52:36 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:52:36 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/console.log" append="off"/>
Aug 26 08:52:36 user nova-compute[73104]:     </serial>
Aug 26 08:52:36 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:52:36 user nova-compute[73104]:     <video>
Aug 26 08:52:36 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:52:36 user nova-compute[73104]:     </video>
Aug 26 08:52:36 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:52:36 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:52:36 user nova-compute[73104]:     </rng>
Aug 26 08:52:36 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:52:36 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:52:36 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:52:36 user nova-compute[73104]:     </memballoon>
Aug 26 08:52:36 user nova-compute[73104]:   </devices>
Aug 26 08:52:36 user nova-compute[73104]: </domain>
Aug 26 08:52:36 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:52:36 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-757348124',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-757348124',id=30,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a37356203d547c2abf0aa634c2ad548',ramdisk_id='',reservation_id='r-nwqltj8v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1111216102',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:52:34Z,user_data=None,user_id='bcd11beb7046440f814cbf4a13ab0272',uuid=bf35aa10-80b1-4518-88b3-63c6a11e626b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba4dd86b-d62a-48be-89c7-d63a6013a1ef", "address": "fa:16:3e:bc:d7:ff", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4dd86b-d6", "ovs_interfaceid": "ba4dd86b-d62a-48be-89c7-d63a6013a1ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:52:36 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Converting VIF {"id": "ba4dd86b-d62a-48be-89c7-d63a6013a1ef", "address": "fa:16:3e:bc:d7:ff", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4dd86b-d6", "ovs_interfaceid": "ba4dd86b-d62a-48be-89c7-d63a6013a1ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:52:36 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d7:ff,bridge_name='br-int',has_traffic_filtering=True,id=ba4dd86b-d62a-48be-89c7-d63a6013a1ef,network=Network(ce0a529c-2119-4b2a-a08f-567e3671c3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4dd86b-d6') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:52:36 user nova-compute[73104]: DEBUG os_vif [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d7:ff,bridge_name='br-int',has_traffic_filtering=True,id=ba4dd86b-d62a-48be-89c7-d63a6013a1ef,network=Network(ce0a529c-2119-4b2a-a08f-567e3671c3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4dd86b-d6') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:52:36 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:36 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:52:36 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:52:36 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:36 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba4dd86b-d6, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:52:36 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapba4dd86b-d6, col_values=(('external_ids', {'iface-id': 'ba4dd86b-d62a-48be-89c7-d63a6013a1ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:d7:ff', 'vm-uuid': 'bf35aa10-80b1-4518-88b3-63c6a11e626b'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:52:36 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:36 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:52:36 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:36 user nova-compute[73104]: INFO os_vif [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d7:ff,bridge_name='br-int',has_traffic_filtering=True,id=ba4dd86b-d62a-48be-89c7-d63a6013a1ef,network=Network(ce0a529c-2119-4b2a-a08f-567e3671c3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4dd86b-d6')
Aug 26 08:52:36 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:52:36 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] No VIF found with MAC fa:16:3e:bc:d7:ff, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:52:36 user nova-compute[73104]: DEBUG nova.network.neutron [req-e8cc0719-6317-40f4-b972-8b4707c92fde req-7032ca47-2223-4ffd-b3b3-884318b5a937 service nova] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Updated VIF entry in instance network info cache for port ba4dd86b-d62a-48be-89c7-d63a6013a1ef. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:52:36 user nova-compute[73104]: DEBUG nova.network.neutron [req-e8cc0719-6317-40f4-b972-8b4707c92fde req-7032ca47-2223-4ffd-b3b3-884318b5a937 service nova] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Updating instance_info_cache with network_info: [{"id": "ba4dd86b-d62a-48be-89c7-d63a6013a1ef", "address": "fa:16:3e:bc:d7:ff", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4dd86b-d6", "ovs_interfaceid": "ba4dd86b-d62a-48be-89c7-d63a6013a1ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:52:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e8cc0719-6317-40f4-b972-8b4707c92fde req-7032ca47-2223-4ffd-b3b3-884318b5a937 service nova] Releasing lock "refresh_cache-bf35aa10-80b1-4518-88b3-63c6a11e626b" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:52:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:37 user nova-compute[73104]: DEBUG nova.compute.manager [req-e0164fd6-3c00-4ba8-ad76-9275ad194315 req-2b5d960b-7fb2-498f-930c-cf952bd00c31 service nova] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Received event network-vif-plugged-ba4dd86b-d62a-48be-89c7-d63a6013a1ef {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:52:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e0164fd6-3c00-4ba8-ad76-9275ad194315 req-2b5d960b-7fb2-498f-930c-cf952bd00c31 service nova] Acquiring lock "bf35aa10-80b1-4518-88b3-63c6a11e626b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:52:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e0164fd6-3c00-4ba8-ad76-9275ad194315 req-2b5d960b-7fb2-498f-930c-cf952bd00c31 service nova] Lock "bf35aa10-80b1-4518-88b3-63c6a11e626b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:52:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e0164fd6-3c00-4ba8-ad76-9275ad194315 req-2b5d960b-7fb2-498f-930c-cf952bd00c31 service nova] Lock "bf35aa10-80b1-4518-88b3-63c6a11e626b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:52:37 user nova-compute[73104]: DEBUG nova.compute.manager [req-e0164fd6-3c00-4ba8-ad76-9275ad194315 req-2b5d960b-7fb2-498f-930c-cf952bd00c31 service nova] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] No waiting events found dispatching network-vif-plugged-ba4dd86b-d62a-48be-89c7-d63a6013a1ef {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:52:37 user nova-compute[73104]: WARNING nova.compute.manager [req-e0164fd6-3c00-4ba8-ad76-9275ad194315 req-2b5d960b-7fb2-498f-930c-cf952bd00c31 service nova] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Received unexpected event network-vif-plugged-ba4dd86b-d62a-48be-89c7-d63a6013a1ef for instance with vm_state building and task_state spawning.
Aug 26 08:52:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:37 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693039942.820579, 02665c70-cf75-44ba-9d90-eb9e5f12e0b7 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:52:37 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] VM Stopped (Lifecycle Event)
Aug 26 08:52:37 user nova-compute[73104]: DEBUG nova.compute.manager [None req-8207e660-b307-4059-8169-36b911797159 None None] [instance: 02665c70-cf75-44ba-9d90-eb9e5f12e0b7] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:52:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:39 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039959.544006, bf35aa10-80b1-4518-88b3-63c6a11e626b => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:52:39 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] VM Resumed (Lifecycle Event)
Aug 26 08:52:39 user nova-compute[73104]: DEBUG nova.compute.manager [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:52:39 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:52:39 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Instance spawned successfully.
Aug 26 08:52:39 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:52:39 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:52:39 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:52:39 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:52:39 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:52:39 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:52:39 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:52:39 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:52:39 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:52:39 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:52:39 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693039959.5451093, bf35aa10-80b1-4518-88b3-63c6a11e626b => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:52:39 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] VM Started (Lifecycle Event)
Aug 26 08:52:39 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:52:39 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:52:39 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:52:39 user nova-compute[73104]: INFO nova.compute.manager [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Took 5.52 seconds to spawn the instance on the hypervisor.
Aug 26 08:52:39 user nova-compute[73104]: DEBUG nova.compute.manager [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:52:39 user nova-compute[73104]: DEBUG nova.compute.manager [req-9ce2a0d7-d622-444e-8bfc-ce49d614cb84 req-18582c23-7e50-4323-9685-7fb9daa4db41 service nova] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Received event network-vif-plugged-ba4dd86b-d62a-48be-89c7-d63a6013a1ef {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:52:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9ce2a0d7-d622-444e-8bfc-ce49d614cb84 req-18582c23-7e50-4323-9685-7fb9daa4db41 service nova] Acquiring lock "bf35aa10-80b1-4518-88b3-63c6a11e626b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:52:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9ce2a0d7-d622-444e-8bfc-ce49d614cb84 req-18582c23-7e50-4323-9685-7fb9daa4db41 service nova] Lock "bf35aa10-80b1-4518-88b3-63c6a11e626b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:52:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9ce2a0d7-d622-444e-8bfc-ce49d614cb84 req-18582c23-7e50-4323-9685-7fb9daa4db41 service nova] Lock "bf35aa10-80b1-4518-88b3-63c6a11e626b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:52:39 user nova-compute[73104]: DEBUG nova.compute.manager [req-9ce2a0d7-d622-444e-8bfc-ce49d614cb84 req-18582c23-7e50-4323-9685-7fb9daa4db41 service nova] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] No waiting events found dispatching network-vif-plugged-ba4dd86b-d62a-48be-89c7-d63a6013a1ef {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:52:39 user nova-compute[73104]: WARNING nova.compute.manager [req-9ce2a0d7-d622-444e-8bfc-ce49d614cb84 req-18582c23-7e50-4323-9685-7fb9daa4db41 service nova] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Received unexpected event network-vif-plugged-ba4dd86b-d62a-48be-89c7-d63a6013a1ef for instance with vm_state building and task_state spawning.
Aug 26 08:52:39 user nova-compute[73104]: INFO nova.compute.manager [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Took 6.16 seconds to build instance.
Aug 26 08:52:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3d706174-e71c-4aa1-ae1b-1bc124f0eb84 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "bf35aa10-80b1-4518-88b3-63c6a11e626b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.265s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:52:41 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:51 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:57 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:52:57 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:52:57 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:52:57 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:52:57 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:52:57 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 08:52:58 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:52:58 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:52:58 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:52:58 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Triggering sync for uuid b5e1f82c-5675-4c37-8ba2-44e6a341a576 {{(pid=73104) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 08:52:58 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Triggering sync for uuid 3cf85d2f-de0d-4e9b-a534-98c799ae8db9 {{(pid=73104) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 08:52:58 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Triggering sync for uuid bef1e493-6b2c-4688-98c2-647261feb571 {{(pid=73104) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 08:52:58 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Triggering sync for uuid e7ac6a94-05a2-4b11-a541-26b1d1dae070 {{(pid=73104) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 08:52:58 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Triggering sync for uuid 33048996-d559-4b3c-9de9-39bb176c3ec9 {{(pid=73104) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 08:52:58 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Triggering sync for uuid 945acd46-42e2-4c45-b8e5-9ea94703bc66 {{(pid=73104) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 08:52:58 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Triggering sync for uuid bf35aa10-80b1-4518-88b3-63c6a11e626b {{(pid=73104) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 08:52:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "b5e1f82c-5675-4c37-8ba2-44e6a341a576" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:52:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "b5e1f82c-5675-4c37-8ba2-44e6a341a576" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:52:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:52:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:52:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "bef1e493-6b2c-4688-98c2-647261feb571" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:52:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "bef1e493-6b2c-4688-98c2-647261feb571" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:52:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:52:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:52:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "33048996-d559-4b3c-9de9-39bb176c3ec9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:52:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:52:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "945acd46-42e2-4c45-b8e5-9ea94703bc66" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:52:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "945acd46-42e2-4c45-b8e5-9ea94703bc66" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:52:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "bf35aa10-80b1-4518-88b3-63c6a11e626b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:52:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "bf35aa10-80b1-4518-88b3-63c6a11e626b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:52:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "b5e1f82c-5675-4c37-8ba2-44e6a341a576" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:52:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:52:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:52:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "bef1e493-6b2c-4688-98c2-647261feb571" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:52:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:52:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "945acd46-42e2-4c45-b8e5-9ea94703bc66" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:52:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "bf35aa10-80b1-4518-88b3-63c6a11e626b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:52:59 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:52:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:52:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:52:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:52:59 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 08:52:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:52:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:52:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:52:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:52:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:52:59 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:52:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:52:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:52:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:00 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:53:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:01 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:53:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:02 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:53:02 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:53:02 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=7884MB free_disk=24.150455474853516GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 08:53:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:53:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:53:02 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance b5e1f82c-5675-4c37-8ba2-44e6a341a576 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:53:02 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 3cf85d2f-de0d-4e9b-a534-98c799ae8db9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:53:02 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance bef1e493-6b2c-4688-98c2-647261feb571 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:53:02 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance e7ac6a94-05a2-4b11-a541-26b1d1dae070 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:53:02 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 33048996-d559-4b3c-9de9-39bb176c3ec9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:53:02 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 945acd46-42e2-4c45-b8e5-9ea94703bc66 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:53:02 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance bf35aa10-80b1-4518-88b3-63c6a11e626b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:53:02 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 08:53:02 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 08:53:02 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Refreshing inventories for resource provider 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 08:53:02 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Updating ProviderTree inventory for provider 8a2a2397-4d47-4524-8146-84db4225a812 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 08:53:02 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Updating inventory in ProviderTree for provider 8a2a2397-4d47-4524-8146-84db4225a812 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 08:53:02 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Refreshing aggregate associations for resource provider 8a2a2397-4d47-4524-8146-84db4225a812, aggregates: None {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 08:53:02 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Refreshing trait associations for resource provider 8a2a2397-4d47-4524-8146-84db4225a812, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 08:53:02 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:53:02 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:53:02 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 08:53:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.774s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:53:02 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:53:02 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Cleaning up deleted instances {{(pid=73104) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 08:53:02 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] There are 0 instances to clean {{(pid=73104) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 08:53:02 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:53:02 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73104) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 08:53:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:53:04 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:53:04 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:53:04 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 08:53:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-bef1e493-6b2c-4688-98c2-647261feb571" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:53:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-bef1e493-6b2c-4688-98c2-647261feb571" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:53:05 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 08:53:05 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Updating instance_info_cache with network_info: [{"id": "6ddebd25-cfe6-4b0e-8b2d-746fae9f8685", "address": "fa:16:3e:03:fd:b2", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddebd25-cf", "ovs_interfaceid": "6ddebd25-cfe6-4b0e-8b2d-746fae9f8685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:53:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-bef1e493-6b2c-4688-98c2-647261feb571" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:53:05 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 08:53:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:53:06 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:53:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:53:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:53:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:53:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:53:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:53:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:53:26 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:53:29 user nova-compute[73104]: DEBUG nova.compute.manager [req-14b179eb-5381-439b-8710-51854e6960e1 req-dcc68e7c-7708-4d4a-b074-110ca38e8845 service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Received event network-changed-4c1b906e-2c49-4642-9183-06292be46de4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:53:29 user nova-compute[73104]: DEBUG nova.compute.manager [req-14b179eb-5381-439b-8710-51854e6960e1 req-dcc68e7c-7708-4d4a-b074-110ca38e8845 service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Refreshing instance network info cache due to event network-changed-4c1b906e-2c49-4642-9183-06292be46de4. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:53:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-14b179eb-5381-439b-8710-51854e6960e1 req-dcc68e7c-7708-4d4a-b074-110ca38e8845 service nova] Acquiring lock "refresh_cache-33048996-d559-4b3c-9de9-39bb176c3ec9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:53:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-14b179eb-5381-439b-8710-51854e6960e1 req-dcc68e7c-7708-4d4a-b074-110ca38e8845 service nova] Acquired lock "refresh_cache-33048996-d559-4b3c-9de9-39bb176c3ec9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:53:29 user nova-compute[73104]: DEBUG nova.network.neutron [req-14b179eb-5381-439b-8710-51854e6960e1 req-dcc68e7c-7708-4d4a-b074-110ca38e8845 service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Refreshing network info cache for port 4c1b906e-2c49-4642-9183-06292be46de4 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:53:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:53:29 user nova-compute[73104]: DEBUG nova.network.neutron [req-14b179eb-5381-439b-8710-51854e6960e1 req-dcc68e7c-7708-4d4a-b074-110ca38e8845 service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Updated VIF entry in instance network info cache for port 4c1b906e-2c49-4642-9183-06292be46de4. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:53:29 user nova-compute[73104]: DEBUG nova.network.neutron [req-14b179eb-5381-439b-8710-51854e6960e1 req-dcc68e7c-7708-4d4a-b074-110ca38e8845 service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Updating instance_info_cache with network_info: [{"id": "4c1b906e-2c49-4642-9183-06292be46de4", "address": "fa:16:3e:7e:7d:6c", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1b906e-2c", "ovs_interfaceid": "4c1b906e-2c49-4642-9183-06292be46de4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:53:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-14b179eb-5381-439b-8710-51854e6960e1 req-dcc68e7c-7708-4d4a-b074-110ca38e8845 service nova] Releasing lock "refresh_cache-33048996-d559-4b3c-9de9-39bb176c3ec9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:53:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:53:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "33048996-d559-4b3c-9de9-39bb176c3ec9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:53:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:53:34 user nova-compute[73104]: DEBUG nova.objects.instance [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lazy-loading 'flavor' on Instance uuid 33048996-d559-4b3c-9de9-39bb176c3ec9 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:53:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:53:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:53:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "33048996-d559-4b3c-9de9-39bb176c3ec9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:53:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:53:34 user nova-compute[73104]: INFO nova.compute.manager [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Attaching volume 575b4aa5-1edc-47c1-88ed-42ab59f35a16 to /dev/vdb
Aug 26 08:53:34 user nova-compute[73104]: DEBUG os_brick.utils [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:53:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:34 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce40edd-8806-4190-97da-ca5eaf7ef0e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:34 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ee4291-9502-44f0-8c48-666ccc44513e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:34 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[250c2add-fff9-46f7-bd49-2012b217aa1c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:34 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5a59d2-92b3-4c29-a5af-30e5c73bb425]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:53:34 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:53:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:53:34 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:53:34 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a191d0-2920-425c-98c1-a1e0ffb0b7d9]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:34 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:53:34 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:53:34 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:53:34 user nova-compute[73104]: DEBUG os_brick.utils [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:53:34 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Updating existing volume attachment record: faf16012-bcba-4e7b-bccf-50b960a8b212 {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 08:53:34 user nova-compute[73104]: DEBUG nova.compute.manager [req-c52ac238-c300-4b01-a971-42fd3718c00e req-8efcacee-280a-4c16-a0ab-762728bf3eae service nova] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Received event network-changed-6df89783-82b3-4a16-b2ec-f5f3c2e54884 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:53:34 user nova-compute[73104]: DEBUG nova.compute.manager [req-c52ac238-c300-4b01-a971-42fd3718c00e req-8efcacee-280a-4c16-a0ab-762728bf3eae service nova] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Refreshing instance network info cache due to event network-changed-6df89783-82b3-4a16-b2ec-f5f3c2e54884. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:53:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c52ac238-c300-4b01-a971-42fd3718c00e req-8efcacee-280a-4c16-a0ab-762728bf3eae service nova] Acquiring lock "refresh_cache-945acd46-42e2-4c45-b8e5-9ea94703bc66" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:53:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c52ac238-c300-4b01-a971-42fd3718c00e req-8efcacee-280a-4c16-a0ab-762728bf3eae service nova] Acquired lock "refresh_cache-945acd46-42e2-4c45-b8e5-9ea94703bc66" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:53:34 user nova-compute[73104]: DEBUG nova.network.neutron [req-c52ac238-c300-4b01-a971-42fd3718c00e req-8efcacee-280a-4c16-a0ab-762728bf3eae service nova] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Refreshing network info cache for port 6df89783-82b3-4a16-b2ec-f5f3c2e54884 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:53:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Acquiring lock "945acd46-42e2-4c45-b8e5-9ea94703bc66" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:53:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "945acd46-42e2-4c45-b8e5-9ea94703bc66" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:53:35 user nova-compute[73104]: DEBUG nova.objects.instance [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lazy-loading 'flavor' on Instance uuid 945acd46-42e2-4c45-b8e5-9ea94703bc66 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:53:35 user nova-compute[73104]: DEBUG nova.network.neutron [req-c52ac238-c300-4b01-a971-42fd3718c00e req-8efcacee-280a-4c16-a0ab-762728bf3eae service nova] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Updated VIF entry in instance network info cache for port 6df89783-82b3-4a16-b2ec-f5f3c2e54884. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:53:35 user nova-compute[73104]: DEBUG nova.network.neutron [req-c52ac238-c300-4b01-a971-42fd3718c00e req-8efcacee-280a-4c16-a0ab-762728bf3eae service nova] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Updating instance_info_cache with network_info: [{"id": "6df89783-82b3-4a16-b2ec-f5f3c2e54884", "address": "fa:16:3e:b9:a6:80", "network": {"id": "bb0ed7b6-f1d2-41e5-b975-926555200ac9", "bridge": "br-int", "label": "tempest-TestStampPattern-89239905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f8b4744aa5450ca396714b74a01049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df89783-82", "ovs_interfaceid": "6df89783-82b3-4a16-b2ec-f5f3c2e54884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:53:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "945acd46-42e2-4c45-b8e5-9ea94703bc66" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:53:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c52ac238-c300-4b01-a971-42fd3718c00e req-8efcacee-280a-4c16-a0ab-762728bf3eae service nova] Releasing lock "refresh_cache-945acd46-42e2-4c45-b8e5-9ea94703bc66" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:53:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Acquiring lock "945acd46-42e2-4c45-b8e5-9ea94703bc66" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:53:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "945acd46-42e2-4c45-b8e5-9ea94703bc66" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:53:35 user nova-compute[73104]: INFO nova.compute.manager [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Attaching volume 1435a330-40f6-4f13-a132-425366767499 to /dev/vdb
Aug 26 08:53:35 user nova-compute[73104]: DEBUG os_brick.utils [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:53:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:35 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82de651-51fd-4ffa-9d45-01d5a9998180]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:35 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[799e9c2b-5614-4673-949f-e1667c096dfa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:35 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf80260-7650-48e4-b909-e4fe00726bb4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:35 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f907e9-dce1-46fb-83df-bf6254b25ddc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:53:35 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:53:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:53:35 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:53:35 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[11346178-22b1-4815-a8a2-4cc1fe2f7aae]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:35 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:53:35 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:53:35 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:53:35 user nova-compute[73104]: DEBUG os_brick.utils [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:53:35 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Updating existing volume attachment record: 544b41ad-f50e-4d75-baad-38a64b9f06b8 {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 08:53:36 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:53:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:53:41 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:53:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cnwzLsMB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:53:46 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:53:46 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:53:46 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:53:46 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:53:46 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:53:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[894a1bae-6ac1-47be-a5a6-b6e284847166]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:53:46 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ec528c-7c71-445c-bff7-2e167d755b3d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16] added
Aug 26 08:53:46 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23dac7b-e032-49b9-878e-385286c25d13]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc08a738-8332-415d-b722-c51bec45bca2]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cnwzLsMB {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cnwzLsMB" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[443ecc46-de8f-4991-832b-fad48e4a3535]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cnwzLsMB'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eca28ec-dc26-4478-b002-d0f2c3c37c0d]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ff671f-86bb-4676-91e8-55deab648a4a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:53:46 user nova-compute[73104]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e (non-flash)
Aug 26 08:53:46 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:53:46 user nova-compute[73104]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e (non-flash)
Aug 26 08:53:46 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf69e683-f238-4626-bfbc-ffe52371dfd3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16, portal: 172.16.0.220,3260]
Aug 26 08:53:46 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16, portal: 172.16.0.220,3260] successful.
Aug 26 08:53:46 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[40882b7f-c07c-497b-b5ca-1d3da0154c9d]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec9ea49-affd-4440-9b57-c38f4c0f7781]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:53:46 user nova-compute[73104]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e (non-flash)
Aug 26 08:53:46 user nova-compute[73104]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:53:46 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:53:46 user nova-compute[73104]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e (non-flash)
Aug 26 08:53:46 user nova-compute[73104]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:53:46 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[095740cf-ebfb-4674-bc52-a89f89bf61a8]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:53:46 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cnwzLsMB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:53:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:53:47 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:53:47 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23137653639613433', 'path': '/dev/sdd'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:53:47 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137653639613433', 'path': '/dev/sdd'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:53:47 user nova-compute[73104]: DEBUG nova.objects.instance [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lazy-loading 'flavor' on Instance uuid 33048996-d559-4b3c-9de9-39bb176c3ec9 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:53:47 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 08:53:47 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:53:47 user nova-compute[73104]:   <source dev="/dev/sdd"/>
Aug 26 08:53:47 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:53:47 user nova-compute[73104]:   <serial>575b4aa5-1edc-47c1-88ed-42ab59f35a16</serial>
Aug 26 08:53:47 user nova-compute[73104]: </disk>
Aug 26 08:53:47 user nova-compute[73104]:  {{(pid=73104) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 08:53:48 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:53:48 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:53:48 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] No VIF found with MAC fa:16:3e:7e:7d:6c, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:53:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-bc4eb9a1-ee55-4655-aafb-782bd178b57e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.816s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:53:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:53:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-f92066b6-e0ac-460b-9c68-68d435f54948 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "33048996-d559-4b3c-9de9-39bb176c3ec9" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:53:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-f92066b6-e0ac-460b-9c68-68d435f54948 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:53:49 user nova-compute[73104]: DEBUG nova.compute.manager [None req-f92066b6-e0ac-460b-9c68-68d435f54948 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:53:49 user nova-compute[73104]: DEBUG nova.compute.manager [None req-f92066b6-e0ac-460b-9c68-68d435f54948 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73104) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 26 08:53:49 user nova-compute[73104]: DEBUG nova.objects.instance [None req-f92066b6-e0ac-460b-9c68-68d435f54948 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lazy-loading 'flavor' on Instance uuid 33048996-d559-4b3c-9de9-39bb176c3ec9 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:53:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:53:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:53:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:53:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:53:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:53:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-25f3f3a6-dc17-4585-a8f4-e1e3a382f33f req-bb68f8c9-4f32-4304-9b37-96193a8adfec service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Received event network-vif-unplugged-4c1b906e-2c49-4642-9183-06292be46de4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:53:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-25f3f3a6-dc17-4585-a8f4-e1e3a382f33f req-bb68f8c9-4f32-4304-9b37-96193a8adfec service nova] Acquiring lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:53:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-25f3f3a6-dc17-4585-a8f4-e1e3a382f33f req-bb68f8c9-4f32-4304-9b37-96193a8adfec service nova] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:53:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-25f3f3a6-dc17-4585-a8f4-e1e3a382f33f req-bb68f8c9-4f32-4304-9b37-96193a8adfec service nova] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:53:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-25f3f3a6-dc17-4585-a8f4-e1e3a382f33f req-bb68f8c9-4f32-4304-9b37-96193a8adfec service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] No waiting events found dispatching network-vif-unplugged-4c1b906e-2c49-4642-9183-06292be46de4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:53:49 user nova-compute[73104]: WARNING nova.compute.manager [req-25f3f3a6-dc17-4585-a8f4-e1e3a382f33f req-bb68f8c9-4f32-4304-9b37-96193a8adfec service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Received unexpected event network-vif-unplugged-4c1b906e-2c49-4642-9183-06292be46de4 for instance with vm_state active and task_state powering-off.
Aug 26 08:53:49 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Instance destroyed successfully.
Aug 26 08:53:49 user nova-compute[73104]: DEBUG nova.compute.manager [None req-f92066b6-e0ac-460b-9c68-68d435f54948 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:53:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-f92066b6-e0ac-460b-9c68-68d435f54948 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.902s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:53:51 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:53:51 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:53:51 user nova-compute[73104]: DEBUG nova.compute.manager [req-1a053e73-f7b6-4acf-be37-1fa80d3fc386 req-da781a4f-6120-4ec7-8894-a80dba223d64 service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Received event network-vif-plugged-4c1b906e-2c49-4642-9183-06292be46de4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:53:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1a053e73-f7b6-4acf-be37-1fa80d3fc386 req-da781a4f-6120-4ec7-8894-a80dba223d64 service nova] Acquiring lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:53:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1a053e73-f7b6-4acf-be37-1fa80d3fc386 req-da781a4f-6120-4ec7-8894-a80dba223d64 service nova] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:53:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1a053e73-f7b6-4acf-be37-1fa80d3fc386 req-da781a4f-6120-4ec7-8894-a80dba223d64 service nova] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:53:51 user nova-compute[73104]: DEBUG nova.compute.manager [req-1a053e73-f7b6-4acf-be37-1fa80d3fc386 req-da781a4f-6120-4ec7-8894-a80dba223d64 service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] No waiting events found dispatching network-vif-plugged-4c1b906e-2c49-4642-9183-06292be46de4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:53:51 user nova-compute[73104]: WARNING nova.compute.manager [req-1a053e73-f7b6-4acf-be37-1fa80d3fc386 req-da781a4f-6120-4ec7-8894-a80dba223d64 service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Received unexpected event network-vif-plugged-4c1b906e-2c49-4642-9183-06292be46de4 for instance with vm_state stopped and task_state None.
Aug 26 08:53:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:53:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WxUmVtCN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:53:52 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:53:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:53:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:53:52 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:53:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:53:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:53:52 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:53:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:52 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdcda01-952a-4256-b388-0db10484142c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:52 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:53:52 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:53:52 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bbd93d-5bfc-46a6-a794-f9dd04ac63b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499] added
Aug 26 08:53:53 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebd76c5-0b85-474a-a1a7-a21cbb58180a]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3e82ea-6236-49ca-b01a-c0d9fc6391d4]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WxUmVtCN {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WxUmVtCN" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fe3f27-4fbb-4fc1-9c27-dc7b50b6b1f4]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WxUmVtCN'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aed1bef-82ed-4dd3-a7ff-bd6d0becdced]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9ceaa9-96b8-45e4-8709-81310a39bc02]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:53:53 user nova-compute[73104]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e (non-flash)
Aug 26 08:53:53 user nova-compute[73104]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:53:53 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:53:53 user nova-compute[73104]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e (non-flash)
Aug 26 08:53:53 user nova-compute[73104]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:53:53 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e0853b-b31f-4f6b-b11c-64d7b59cc39f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499, portal: 172.16.0.220,3260]
Aug 26 08:53:53 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499, portal: 172.16.0.220,3260] successful.
Aug 26 08:53:53 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b8f945-f5a0-4a6f-94cb-2fcdedf6faec]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[57218ea5-1d5d-4776-a053-eb98c4e2aff7]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:53:53 user nova-compute[73104]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e (non-flash)
Aug 26 08:53:53 user nova-compute[73104]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:53:53 user nova-compute[73104]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499 (non-flash)
Aug 26 08:53:53 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:53:53 user nova-compute[73104]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e (non-flash)
Aug 26 08:53:53 user nova-compute[73104]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:53:53 user nova-compute[73104]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499 (non-flash)
Aug 26 08:53:53 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4af034-3d67-4c10-9632-88b5dac6f592]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:53:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WxUmVtCN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:53:54 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:53:54 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23437323132373966', 'path': '/dev/sde'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:53:54 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437323132373966', 'path': '/dev/sde'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:53:54 user nova-compute[73104]: DEBUG nova.objects.instance [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lazy-loading 'flavor' on Instance uuid 945acd46-42e2-4c45-b8e5-9ea94703bc66 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:53:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:53:54 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 08:53:54 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:53:54 user nova-compute[73104]:   <source dev="/dev/sde"/>
Aug 26 08:53:54 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:53:54 user nova-compute[73104]:   <serial>1435a330-40f6-4f13-a132-425366767499</serial>
Aug 26 08:53:54 user nova-compute[73104]: </disk>
Aug 26 08:53:54 user nova-compute[73104]:  {{(pid=73104) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 08:53:54 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:53:54 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:53:54 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] No VIF found with MAC fa:16:3e:b9:a6:80, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:53:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-37f5c4d1-602d-4f0a-8a7e-b20b6fc8cab8 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "945acd46-42e2-4c45-b8e5-9ea94703bc66" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.411s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:53:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:53:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:53:57 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:53:57 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:53:57 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:53:57 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 08:53:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b90f279d-caa8-49b5-9473-1f0e73b14503 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Acquiring lock "945acd46-42e2-4c45-b8e5-9ea94703bc66" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:53:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b90f279d-caa8-49b5-9473-1f0e73b14503 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "945acd46-42e2-4c45-b8e5-9ea94703bc66" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:53:57 user nova-compute[73104]: INFO nova.compute.manager [None req-b90f279d-caa8-49b5-9473-1f0e73b14503 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Detaching volume 1435a330-40f6-4f13-a132-425366767499
Aug 26 08:53:57 user nova-compute[73104]: INFO nova.virt.block_device [None req-b90f279d-caa8-49b5-9473-1f0e73b14503 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Attempting to driver detach volume 1435a330-40f6-4f13-a132-425366767499 from mountpoint /dev/vdb
Aug 26 08:53:57 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b90f279d-caa8-49b5-9473-1f0e73b14503 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Attempting to detach device vdb from instance 945acd46-42e2-4c45-b8e5-9ea94703bc66 from the persistent domain config. {{(pid=73104) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 08:53:57 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-b90f279d-caa8-49b5-9473-1f0e73b14503 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:53:57 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:53:57 user nova-compute[73104]:   <source dev="/dev/sde"/>
Aug 26 08:53:57 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:53:57 user nova-compute[73104]:   <serial>1435a330-40f6-4f13-a132-425366767499</serial>
Aug 26 08:53:57 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 08:53:57 user nova-compute[73104]: </disk>
Aug 26 08:53:57 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:53:57 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-b90f279d-caa8-49b5-9473-1f0e73b14503 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Successfully detached device vdb from instance 945acd46-42e2-4c45-b8e5-9ea94703bc66 from the persistent domain config.
Aug 26 08:53:57 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b90f279d-caa8-49b5-9473-1f0e73b14503 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 945acd46-42e2-4c45-b8e5-9ea94703bc66 from the live domain config. {{(pid=73104) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 08:53:57 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-b90f279d-caa8-49b5-9473-1f0e73b14503 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:53:57 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:53:57 user nova-compute[73104]:   <source dev="/dev/sde"/>
Aug 26 08:53:57 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:53:57 user nova-compute[73104]:   <serial>1435a330-40f6-4f13-a132-425366767499</serial>
Aug 26 08:53:57 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 08:53:57 user nova-compute[73104]: </disk>
Aug 26 08:53:57 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "c08a447c-e25d-4f88-b15f-0c3de12559aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "c08a447c-e25d-4f88-b15f-0c3de12559aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG nova.compute.manager [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:53:58 user nova-compute[73104]: INFO nova.compute.claims [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Claim successful on node user
Aug 26 08:53:58 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Received event <DeviceRemovedEvent: 1693040038.2821784, 945acd46-42e2-4c45-b8e5-9ea94703bc66 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73104) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b90f279d-caa8-49b5-9473-1f0e73b14503 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 945acd46-42e2-4c45-b8e5-9ea94703bc66 {{(pid=73104) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 08:53:58 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-b90f279d-caa8-49b5-9473-1f0e73b14503 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Successfully detached device vdb from instance 945acd46-42e2-4c45-b8e5-9ea94703bc66 from the live domain config.
Aug 26 08:53:58 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b90f279d-caa8-49b5-9473-1f0e73b14503 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90f279d-caa8-49b5-9473-1f0e73b14503 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WxUmVtCN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:53:58 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-b90f279d-caa8-49b5-9473-1f0e73b14503 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:53:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b90f279d-caa8-49b5-9473-1f0e73b14503 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b90f279d-caa8-49b5-9473-1f0e73b14503 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90f279d-caa8-49b5-9473-1f0e73b14503 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2996582-da56-4016-8ca3-1a5377f6b43f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe58b7f3-6a1d-4b99-9c0e-4e186df42195]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90f279d-caa8-49b5-9473-1f0e73b14503 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:53:58 user nova-compute[73104]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e (non-flash)
Aug 26 08:53:58 user nova-compute[73104]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:53:58 user nova-compute[73104]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499 (non-flash)
Aug 26 08:53:58 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90f279d-caa8-49b5-9473-1f0e73b14503 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:53:58 user nova-compute[73104]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e (non-flash)
Aug 26 08:53:58 user nova-compute[73104]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:53:58 user nova-compute[73104]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499 (non-flash)
Aug 26 08:53:58 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90f279d-caa8-49b5-9473-1f0e73b14503 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b4783640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499'): ({'sde'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b90f279d-caa8-49b5-9473-1f0e73b14503 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Removing single pathed devices sde {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6cbe7b-349d-4337-b645-6de40aaf3eae]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15e530a-6ed3-4fb7-810c-46fc42e70f81]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b90f279d-caa8-49b5-9473-1f0e73b14503 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Flushing IO for device /dev/sde {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[da73593c-5bad-41dc-8dd1-894501da787e]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b90f279d-caa8-49b5-9473-1f0e73b14503 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4176f20-1edc-4224-9dcd-fc4514ec8569]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b90f279d-caa8-49b5-9473-1f0e73b14503 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b90f279d-caa8-49b5-9473-1f0e73b14503 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] SCSI volumes sde have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90f279d-caa8-49b5-9473-1f0e73b14503 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[063f39eb-5bd8-4b8e-80f3-a7656f7d47b2]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90f279d-caa8-49b5-9473-1f0e73b14503 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbd5003-6d24-463d-bf36-76ab75678c96]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90f279d-caa8-49b5-9473-1f0e73b14503 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499, portal: 172.16.0.220,3260]
Aug 26 08:53:58 user nova-compute[73104]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499, portal: 172.16.0.220,3260] successful.
Aug 26 08:53:58 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1435a330-40f6-4f13-a132-425366767499 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec2f52e-4ae8-4522-8074-f8a3db153e86]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90f279d-caa8-49b5-9473-1f0e73b14503 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b90f279d-caa8-49b5-9473-1f0e73b14503 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90f279d-caa8-49b5-9473-1f0e73b14503 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] <== disconnect_volume: return (350ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b90f279d-caa8-49b5-9473-1f0e73b14503 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG nova.compute.manager [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG nova.compute.manager [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG nova.network.neutron [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:53:58 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:53:58 user nova-compute[73104]: DEBUG nova.compute.manager [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:53:58 user nova-compute[73104]: INFO nova.virt.block_device [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Booting with volume bad36aef-53e3-49c3-9dd8-e4b9c2d65185 at /dev/vda
Aug 26 08:53:58 user nova-compute[73104]: DEBUG os_brick.utils [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e153937b-9bee-4c18-aed9-6bb1ee504ac5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8b7d8e-ae8c-4c4f-9c84-2feac3fd8d2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f14207c-0019-4b53-85d6-f274cb99744a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eca52cb-7e3d-4647-91b6-2a2f2823fbb6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG nova.policy [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '257343af54bd42b591e8874ef4ecf8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb864c0a34541dca00c6dbbcea17319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:53:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:53:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:53:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:53:59 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:53:59 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[715ba195-59d8-48ef-b984-9bc6c9b1bfaf]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:53:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:53:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:53:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:53:59 user nova-compute[73104]: DEBUG os_brick.utils [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:53:59 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Updating existing volume attachment record: 4bb81466-e184-42ab-be6d-9eec4efce1d5 {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 08:53:59 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:53:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:53:59 user nova-compute[73104]: DEBUG nova.objects.instance [None req-b90f279d-caa8-49b5-9473-1f0e73b14503 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lazy-loading 'flavor' on Instance uuid 945acd46-42e2-4c45-b8e5-9ea94703bc66 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:53:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b90f279d-caa8-49b5-9473-1f0e73b14503 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "945acd46-42e2-4c45-b8e5-9ea94703bc66" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.996s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:53:59 user nova-compute[73104]: DEBUG nova.network.neutron [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Successfully created port: 15317ff8-610b-4e0a-b0a8-ef37bb219ba8 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:54:00 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:54:01 user nova-compute[73104]: DEBUG nova.network.neutron [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Successfully updated port: 15317ff8-610b-4e0a-b0a8-ef37bb219ba8 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:54:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "refresh_cache-c08a447c-e25d-4f88-b15f-0c3de12559aa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:54:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquired lock "refresh_cache-c08a447c-e25d-4f88-b15f-0c3de12559aa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:54:01 user nova-compute[73104]: DEBUG nova.network.neutron [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:54:01 user nova-compute[73104]: DEBUG nova.compute.manager [req-fc52e849-352d-49e7-a95b-6486f68310f6 req-1ef82b02-c1af-466f-ae0d-0b8e427439f6 service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Received event network-changed-15317ff8-610b-4e0a-b0a8-ef37bb219ba8 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:54:01 user nova-compute[73104]: DEBUG nova.compute.manager [req-fc52e849-352d-49e7-a95b-6486f68310f6 req-1ef82b02-c1af-466f-ae0d-0b8e427439f6 service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Refreshing instance network info cache due to event network-changed-15317ff8-610b-4e0a-b0a8-ef37bb219ba8. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:54:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-fc52e849-352d-49e7-a95b-6486f68310f6 req-1ef82b02-c1af-466f-ae0d-0b8e427439f6 service nova] Acquiring lock "refresh_cache-c08a447c-e25d-4f88-b15f-0c3de12559aa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:54:01 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:01 user nova-compute[73104]: DEBUG nova.network.neutron [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:54:01 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:54:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:54:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:54:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:54:01 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 08:54:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:01 user nova-compute[73104]: DEBUG nova.network.neutron [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Updating instance_info_cache with network_info: [{"id": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "address": "fa:16:3e:3a:b1:b8", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15317ff8-61", "ovs_interfaceid": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:54:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Releasing lock "refresh_cache-c08a447c-e25d-4f88-b15f-0c3de12559aa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:54:01 user nova-compute[73104]: DEBUG nova.compute.manager [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Instance network_info: |[{"id": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "address": "fa:16:3e:3a:b1:b8", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15317ff8-61", "ovs_interfaceid": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:54:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-fc52e849-352d-49e7-a95b-6486f68310f6 req-1ef82b02-c1af-466f-ae0d-0b8e427439f6 service nova] Acquired lock "refresh_cache-c08a447c-e25d-4f88-b15f-0c3de12559aa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:54:01 user nova-compute[73104]: DEBUG nova.network.neutron [req-fc52e849-352d-49e7-a95b-6486f68310f6 req-1ef82b02-c1af-466f-ae0d-0b8e427439f6 service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Refreshing network info cache for port 15317ff8-610b-4e0a-b0a8-ef37bb219ba8 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:54:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:01 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:54:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Acquiring lock "6550b41d-2414-4b3e-9a50-9bba88033aae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:54:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Lock "6550b41d-2414-4b3e-9a50-9bba88033aae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:54:02 user nova-compute[73104]: DEBUG nova.compute.manager [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:54:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:54:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:54:02 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:54:02 user nova-compute[73104]: INFO nova.compute.claims [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Claim successful on node user
Aug 26 08:54:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:02 user nova-compute[73104]: DEBUG nova.network.neutron [req-fc52e849-352d-49e7-a95b-6486f68310f6 req-1ef82b02-c1af-466f-ae0d-0b8e427439f6 service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Updated VIF entry in instance network info cache for port 15317ff8-610b-4e0a-b0a8-ef37bb219ba8. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:54:02 user nova-compute[73104]: DEBUG nova.network.neutron [req-fc52e849-352d-49e7-a95b-6486f68310f6 req-1ef82b02-c1af-466f-ae0d-0b8e427439f6 service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Updating instance_info_cache with network_info: [{"id": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "address": "fa:16:3e:3a:b1:b8", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15317ff8-61", "ovs_interfaceid": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:54:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-fc52e849-352d-49e7-a95b-6486f68310f6 req-1ef82b02-c1af-466f-ae0d-0b8e427439f6 service nova] Releasing lock "refresh_cache-c08a447c-e25d-4f88-b15f-0c3de12559aa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:54:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:02 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:54:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:02 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:54:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:54:02 user nova-compute[73104]: DEBUG nova.compute.manager [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:54:02 user nova-compute[73104]: DEBUG nova.compute.manager [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:54:02 user nova-compute[73104]: DEBUG nova.network.neutron [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:54:02 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:54:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:54:02 user nova-compute[73104]: DEBUG nova.compute.manager [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:54:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:02 user nova-compute[73104]: DEBUG nova.policy [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e132db6ecf3a4576b057867ed41c1f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca97939d90e46678626053110e9dba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:54:02 user nova-compute[73104]: DEBUG nova.compute.manager [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:54:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:54:02 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Creating image(s)
Aug 26 08:54:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Acquiring lock "/opt/stack/data/nova/instances/6550b41d-2414-4b3e-9a50-9bba88033aae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:54:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Lock "/opt/stack/data/nova/instances/6550b41d-2414-4b3e-9a50-9bba88033aae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:54:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Lock "/opt/stack/data/nova/instances/6550b41d-2414-4b3e-9a50-9bba88033aae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:54:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.172s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:54:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:54:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:03 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:54:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.189s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/6550b41d-2414-4b3e-9a50-9bba88033aae/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/6550b41d-2414-4b3e-9a50-9bba88033aae/disk 1073741824" returned: 0 in 0.067s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:54:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:03 user nova-compute[73104]: DEBUG nova.network.neutron [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Successfully created port: cfa211db-57c3-47a2-82e1-f9536415953c {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:54:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.204s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:03 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6550b41d-2414-4b3e-9a50-9bba88033aae/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 08:54:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6550b41d-2414-4b3e-9a50-9bba88033aae/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6550b41d-2414-4b3e-9a50-9bba88033aae/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:03 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Cannot resize image /opt/stack/data/nova/instances/6550b41d-2414-4b3e-9a50-9bba88033aae/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 08:54:03 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:54:03 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Ensure instance console log exists: /opt/stack/data/nova/instances/6550b41d-2414-4b3e-9a50-9bba88033aae/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:54:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:54:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:54:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:54:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:04 user nova-compute[73104]: DEBUG nova.network.neutron [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Successfully updated port: cfa211db-57c3-47a2-82e1-f9536415953c {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:54:04 user nova-compute[73104]: DEBUG nova.compute.manager [req-3b9fc416-ef18-4a96-a395-5d09668fc21b req-8a33fe47-84f9-48a6-a01c-5e36861a6c9a service nova] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Received event network-changed-cfa211db-57c3-47a2-82e1-f9536415953c {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:54:04 user nova-compute[73104]: DEBUG nova.compute.manager [req-3b9fc416-ef18-4a96-a395-5d09668fc21b req-8a33fe47-84f9-48a6-a01c-5e36861a6c9a service nova] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Refreshing instance network info cache due to event network-changed-cfa211db-57c3-47a2-82e1-f9536415953c. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:54:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3b9fc416-ef18-4a96-a395-5d09668fc21b req-8a33fe47-84f9-48a6-a01c-5e36861a6c9a service nova] Acquiring lock "refresh_cache-6550b41d-2414-4b3e-9a50-9bba88033aae" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:54:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3b9fc416-ef18-4a96-a395-5d09668fc21b req-8a33fe47-84f9-48a6-a01c-5e36861a6c9a service nova] Acquired lock "refresh_cache-6550b41d-2414-4b3e-9a50-9bba88033aae" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:54:04 user nova-compute[73104]: DEBUG nova.network.neutron [req-3b9fc416-ef18-4a96-a395-5d09668fc21b req-8a33fe47-84f9-48a6-a01c-5e36861a6c9a service nova] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Refreshing network info cache for port cfa211db-57c3-47a2-82e1-f9536415953c {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:54:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Acquiring lock "refresh_cache-6550b41d-2414-4b3e-9a50-9bba88033aae" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:54:04 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:54:04 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:54:04 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8045MB free_disk=24.135726928710938GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 08:54:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:54:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:54:04 user nova-compute[73104]: DEBUG nova.network.neutron [req-3b9fc416-ef18-4a96-a395-5d09668fc21b req-8a33fe47-84f9-48a6-a01c-5e36861a6c9a service nova] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:54:04 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance b5e1f82c-5675-4c37-8ba2-44e6a341a576 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:54:04 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 3cf85d2f-de0d-4e9b-a534-98c799ae8db9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:54:04 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance bef1e493-6b2c-4688-98c2-647261feb571 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:54:04 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance e7ac6a94-05a2-4b11-a541-26b1d1dae070 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:54:04 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 33048996-d559-4b3c-9de9-39bb176c3ec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:54:04 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 945acd46-42e2-4c45-b8e5-9ea94703bc66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:54:04 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance bf35aa10-80b1-4518-88b3-63c6a11e626b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:54:04 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance c08a447c-e25d-4f88-b15f-0c3de12559aa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:54:04 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 6550b41d-2414-4b3e-9a50-9bba88033aae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:54:04 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 08:54:04 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 08:54:04 user nova-compute[73104]: DEBUG nova.network.neutron [req-3b9fc416-ef18-4a96-a395-5d09668fc21b req-8a33fe47-84f9-48a6-a01c-5e36861a6c9a service nova] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:54:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3b9fc416-ef18-4a96-a395-5d09668fc21b req-8a33fe47-84f9-48a6-a01c-5e36861a6c9a service nova] Releasing lock "refresh_cache-6550b41d-2414-4b3e-9a50-9bba88033aae" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:54:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Acquired lock "refresh_cache-6550b41d-2414-4b3e-9a50-9bba88033aae" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:54:04 user nova-compute[73104]: DEBUG nova.network.neutron [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:54:04 user nova-compute[73104]: DEBUG nova.network.neutron [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:54:04 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:54:04 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693040029.912493, 33048996-d559-4b3c-9de9-39bb176c3ec9 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:54:04 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] VM Stopped (Lifecycle Event)
Aug 26 08:54:04 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:54:04 user nova-compute[73104]: DEBUG nova.compute.manager [None req-001913b1-749d-47cc-97a8-75328156f36d None None] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:54:04 user nova-compute[73104]: DEBUG nova.compute.manager [None req-001913b1-749d-47cc-97a8-75328156f36d None None] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:54:04 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 08:54:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.444s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG nova.network.neutron [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Updating instance_info_cache with network_info: [{"id": "cfa211db-57c3-47a2-82e1-f9536415953c", "address": "fa:16:3e:7f:fb:55", "network": {"id": "2bbbc03e-d3e2-41b9-9b25-265081247b1b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-839419385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca97939d90e46678626053110e9dba1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfa211db-57", "ovs_interfaceid": "cfa211db-57c3-47a2-82e1-f9536415953c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Releasing lock "refresh_cache-6550b41d-2414-4b3e-9a50-9bba88033aae" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG nova.compute.manager [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Instance network_info: |[{"id": "cfa211db-57c3-47a2-82e1-f9536415953c", "address": "fa:16:3e:7f:fb:55", "network": {"id": "2bbbc03e-d3e2-41b9-9b25-265081247b1b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-839419385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca97939d90e46678626053110e9dba1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfa211db-57", "ovs_interfaceid": "cfa211db-57c3-47a2-82e1-f9536415953c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Start _get_guest_xml network_info=[{"id": "cfa211db-57c3-47a2-82e1-f9536415953c", "address": "fa:16:3e:7f:fb:55", "network": {"id": "2bbbc03e-d3e2-41b9-9b25-265081247b1b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-839419385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca97939d90e46678626053110e9dba1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfa211db-57", "ovs_interfaceid": "cfa211db-57c3-47a2-82e1-f9536415953c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:54:05 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:54:05 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:54:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:54:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2064089476',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2064089476',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2064089',id=32,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABvzYvcjGmyfKfdsoFitoPQFmpg7LweWNYDz8+UZUn69fL9aHleLx7wbc1dvQd/Ekavkt8ULLe3sHhy7mnptjN0kmm9Fg8+FrouUOOY5LrTWt81nuxu2Iff/RzVKgN4Vg==',key_name='tempest-keypair-714993415',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dca97939d90e46678626053110e9dba1',ramdisk_id='',reservation_id='r-7q9azygr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1954048769',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:54:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e132db6ecf3a4576b057867ed41c1f59',uuid=6550b41d-2414-4b3e-9a50-9bba88033aae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfa211db-57c3-47a2-82e1-f9536415953c", "address": "fa:16:3e:7f:fb:55", "network": {"id": "2bbbc03e-d3e2-41b9-9b25-265081247b1b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-839419385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca97939d90e46678626053110e9dba1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfa211db-57", "ovs_interfaceid": "cfa211db-57c3-47a2-82e1-f9536415953c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Converting VIF {"id": "cfa211db-57c3-47a2-82e1-f9536415953c", "address": "fa:16:3e:7f:fb:55", "network": {"id": "2bbbc03e-d3e2-41b9-9b25-265081247b1b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-839419385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca97939d90e46678626053110e9dba1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfa211db-57", "ovs_interfaceid": "cfa211db-57c3-47a2-82e1-f9536415953c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:fb:55,bridge_name='br-int',has_traffic_filtering=True,id=cfa211db-57c3-47a2-82e1-f9536415953c,network=Network(2bbbc03e-d3e2-41b9-9b25-265081247b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfa211db-57') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG nova.objects.instance [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Lazy-loading 'pci_devices' on Instance uuid 6550b41d-2414-4b3e-9a50-9bba88033aae {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:54:05 user nova-compute[73104]:   <uuid>6550b41d-2414-4b3e-9a50-9bba88033aae</uuid>
Aug 26 08:54:05 user nova-compute[73104]:   <name>instance-00000020</name>
Aug 26 08:54:05 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:54:05 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:54:05 user nova-compute[73104]:   <metadata>
Aug 26 08:54:05 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:54:05 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:54:05 user nova-compute[73104]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-2064089476</nova:name>
Aug 26 08:54:05 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:54:05</nova:creationTime>
Aug 26 08:54:05 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:54:05 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:54:05 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:54:05 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:54:05 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:54:05 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:54:05 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:54:05 user nova-compute[73104]:       <nova:owner>
Aug 26 08:54:05 user nova-compute[73104]:         <nova:user uuid="e132db6ecf3a4576b057867ed41c1f59">tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member</nova:user>
Aug 26 08:54:05 user nova-compute[73104]:         <nova:project uuid="dca97939d90e46678626053110e9dba1">tempest-TestServerVolumeAttachScenarioOldVersion-1954048769</nova:project>
Aug 26 08:54:05 user nova-compute[73104]:       </nova:owner>
Aug 26 08:54:05 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:54:05 user nova-compute[73104]:       <nova:ports>
Aug 26 08:54:05 user nova-compute[73104]:         <nova:port uuid="cfa211db-57c3-47a2-82e1-f9536415953c">
Aug 26 08:54:05 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 08:54:05 user nova-compute[73104]:         </nova:port>
Aug 26 08:54:05 user nova-compute[73104]:       </nova:ports>
Aug 26 08:54:05 user nova-compute[73104]:     </nova:instance>
Aug 26 08:54:05 user nova-compute[73104]:   </metadata>
Aug 26 08:54:05 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:54:05 user nova-compute[73104]:     <system>
Aug 26 08:54:05 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:54:05 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:54:05 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:54:05 user nova-compute[73104]:       <entry name="serial">6550b41d-2414-4b3e-9a50-9bba88033aae</entry>
Aug 26 08:54:05 user nova-compute[73104]:       <entry name="uuid">6550b41d-2414-4b3e-9a50-9bba88033aae</entry>
Aug 26 08:54:05 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:54:05 user nova-compute[73104]:     </system>
Aug 26 08:54:05 user nova-compute[73104]:   </sysinfo>
Aug 26 08:54:05 user nova-compute[73104]:   <os>
Aug 26 08:54:05 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:54:05 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:54:05 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:54:05 user nova-compute[73104]:   </os>
Aug 26 08:54:05 user nova-compute[73104]:   <features>
Aug 26 08:54:05 user nova-compute[73104]:     <acpi/>
Aug 26 08:54:05 user nova-compute[73104]:     <apic/>
Aug 26 08:54:05 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:54:05 user nova-compute[73104]:   </features>
Aug 26 08:54:05 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:54:05 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:54:05 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:54:05 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:54:05 user nova-compute[73104]:   </clock>
Aug 26 08:54:05 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:54:05 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:54:05 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:54:05 user nova-compute[73104]:   </cpu>
Aug 26 08:54:05 user nova-compute[73104]:   <devices>
Aug 26 08:54:05 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:54:05 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:54:05 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/6550b41d-2414-4b3e-9a50-9bba88033aae/disk"/>
Aug 26 08:54:05 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:54:05 user nova-compute[73104]:     </disk>
Aug 26 08:54:05 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:54:05 user nova-compute[73104]:       <mac address="fa:16:3e:7f:fb:55"/>
Aug 26 08:54:05 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:54:05 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:54:05 user nova-compute[73104]:       <target dev="tapcfa211db-57"/>
Aug 26 08:54:05 user nova-compute[73104]:     </interface>
Aug 26 08:54:05 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:54:05 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/6550b41d-2414-4b3e-9a50-9bba88033aae/console.log" append="off"/>
Aug 26 08:54:05 user nova-compute[73104]:     </serial>
Aug 26 08:54:05 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:54:05 user nova-compute[73104]:     <video>
Aug 26 08:54:05 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:54:05 user nova-compute[73104]:     </video>
Aug 26 08:54:05 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:54:05 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:54:05 user nova-compute[73104]:     </rng>
Aug 26 08:54:05 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:54:05 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:54:05 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:54:05 user nova-compute[73104]:     </memballoon>
Aug 26 08:54:05 user nova-compute[73104]:   </devices>
Aug 26 08:54:05 user nova-compute[73104]: </domain>
Aug 26 08:54:05 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:54:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2064089476',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2064089476',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2064089',id=32,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABvzYvcjGmyfKfdsoFitoPQFmpg7LweWNYDz8+UZUn69fL9aHleLx7wbc1dvQd/Ekavkt8ULLe3sHhy7mnptjN0kmm9Fg8+FrouUOOY5LrTWt81nuxu2Iff/RzVKgN4Vg==',key_name='tempest-keypair-714993415',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dca97939d90e46678626053110e9dba1',ramdisk_id='',reservation_id='r-7q9azygr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1954048769',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:54:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e132db6ecf3a4576b057867ed41c1f59',uuid=6550b41d-2414-4b3e-9a50-9bba88033aae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfa211db-57c3-47a2-82e1-f9536415953c", "address": "fa:16:3e:7f:fb:55", "network": {"id": "2bbbc03e-d3e2-41b9-9b25-265081247b1b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-839419385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca97939d90e46678626053110e9dba1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfa211db-57", "ovs_interfaceid": "cfa211db-57c3-47a2-82e1-f9536415953c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Converting VIF {"id": "cfa211db-57c3-47a2-82e1-f9536415953c", "address": "fa:16:3e:7f:fb:55", "network": {"id": "2bbbc03e-d3e2-41b9-9b25-265081247b1b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-839419385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca97939d90e46678626053110e9dba1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfa211db-57", "ovs_interfaceid": "cfa211db-57c3-47a2-82e1-f9536415953c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:fb:55,bridge_name='br-int',has_traffic_filtering=True,id=cfa211db-57c3-47a2-82e1-f9536415953c,network=Network(2bbbc03e-d3e2-41b9-9b25-265081247b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfa211db-57') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG os_vif [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:fb:55,bridge_name='br-int',has_traffic_filtering=True,id=cfa211db-57c3-47a2-82e1-f9536415953c,network=Network(2bbbc03e-d3e2-41b9-9b25-265081247b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfa211db-57') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcfa211db-57, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcfa211db-57, col_values=(('external_ids', {'iface-id': 'cfa211db-57c3-47a2-82e1-f9536415953c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:fb:55', 'vm-uuid': '6550b41d-2414-4b3e-9a50-9bba88033aae'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:05 user nova-compute[73104]: INFO os_vif [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:fb:55,bridge_name='br-int',has_traffic_filtering=True,id=cfa211db-57c3-47a2-82e1-f9536415953c,network=Network(2bbbc03e-d3e2-41b9-9b25-265081247b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfa211db-57')
Aug 26 08:54:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:54:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] No VIF found with MAC fa:16:3e:7f:fb:55, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:54:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:06 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:54:06 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 08:54:06 user nova-compute[73104]: DEBUG nova.compute.manager [req-40202b5b-31e6-47cd-b023-0f8b01910a77 req-1bb9a0e1-8618-4eb0-98df-81fa2ddf2c94 service nova] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Received event network-vif-plugged-cfa211db-57c3-47a2-82e1-f9536415953c {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:54:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-40202b5b-31e6-47cd-b023-0f8b01910a77 req-1bb9a0e1-8618-4eb0-98df-81fa2ddf2c94 service nova] Acquiring lock "6550b41d-2414-4b3e-9a50-9bba88033aae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:54:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-40202b5b-31e6-47cd-b023-0f8b01910a77 req-1bb9a0e1-8618-4eb0-98df-81fa2ddf2c94 service nova] Lock "6550b41d-2414-4b3e-9a50-9bba88033aae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:54:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-40202b5b-31e6-47cd-b023-0f8b01910a77 req-1bb9a0e1-8618-4eb0-98df-81fa2ddf2c94 service nova] Lock "6550b41d-2414-4b3e-9a50-9bba88033aae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:54:06 user nova-compute[73104]: DEBUG nova.compute.manager [req-40202b5b-31e6-47cd-b023-0f8b01910a77 req-1bb9a0e1-8618-4eb0-98df-81fa2ddf2c94 service nova] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] No waiting events found dispatching network-vif-plugged-cfa211db-57c3-47a2-82e1-f9536415953c {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:54:06 user nova-compute[73104]: WARNING nova.compute.manager [req-40202b5b-31e6-47cd-b023-0f8b01910a77 req-1bb9a0e1-8618-4eb0-98df-81fa2ddf2c94 service nova] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Received unexpected event network-vif-plugged-cfa211db-57c3-47a2-82e1-f9536415953c for instance with vm_state building and task_state spawning.
Aug 26 08:54:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-e7ac6a94-05a2-4b11-a541-26b1d1dae070" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:54:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-e7ac6a94-05a2-4b11-a541-26b1d1dae070" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:54:07 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 08:54:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:07 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Updating instance_info_cache with network_info: [{"id": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "address": "fa:16:3e:12:ae:4a", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c66a9f-39", "ovs_interfaceid": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:54:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-e7ac6a94-05a2-4b11-a541-26b1d1dae070" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:54:07 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 08:54:08 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040048.7691987, 6550b41d-2414-4b3e-9a50-9bba88033aae => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:54:08 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] VM Resumed (Lifecycle Event)
Aug 26 08:54:08 user nova-compute[73104]: DEBUG nova.compute.manager [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:54:08 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:54:08 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Instance spawned successfully.
Aug 26 08:54:08 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:54:08 user nova-compute[73104]: DEBUG nova.compute.manager [req-a52b8f34-9ea6-4d1a-93d8-1abd1b874e7e req-f2e0185b-5cf0-45b0-adb0-1b0350ffc42e service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Received event network-changed-a2c66a9f-398a-4f45-a821-5105e68bb4f4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:54:08 user nova-compute[73104]: DEBUG nova.compute.manager [req-a52b8f34-9ea6-4d1a-93d8-1abd1b874e7e req-f2e0185b-5cf0-45b0-adb0-1b0350ffc42e service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Refreshing instance network info cache due to event network-changed-a2c66a9f-398a-4f45-a821-5105e68bb4f4. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:54:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a52b8f34-9ea6-4d1a-93d8-1abd1b874e7e req-f2e0185b-5cf0-45b0-adb0-1b0350ffc42e service nova] Acquiring lock "refresh_cache-e7ac6a94-05a2-4b11-a541-26b1d1dae070" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:54:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a52b8f34-9ea6-4d1a-93d8-1abd1b874e7e req-f2e0185b-5cf0-45b0-adb0-1b0350ffc42e service nova] Acquired lock "refresh_cache-e7ac6a94-05a2-4b11-a541-26b1d1dae070" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:54:08 user nova-compute[73104]: DEBUG nova.network.neutron [req-a52b8f34-9ea6-4d1a-93d8-1abd1b874e7e req-f2e0185b-5cf0-45b0-adb0-1b0350ffc42e service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Refreshing network info cache for port a2c66a9f-398a-4f45-a821-5105e68bb4f4 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:54:08 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:54:08 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:54:08 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:54:08 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:54:08 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:54:08 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:54:08 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:54:08 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:54:08 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:54:08 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040048.7777457, 6550b41d-2414-4b3e-9a50-9bba88033aae => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:54:08 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] VM Started (Lifecycle Event)
Aug 26 08:54:08 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:54:08 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:54:08 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:54:08 user nova-compute[73104]: INFO nova.compute.manager [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Took 5.96 seconds to spawn the instance on the hypervisor.
Aug 26 08:54:08 user nova-compute[73104]: DEBUG nova.compute.manager [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:54:09 user nova-compute[73104]: INFO nova.compute.manager [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Took 6.86 seconds to build instance.
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9c432408-23a8-4422-9c64-45618c7f2623 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9c432408-23a8-4422-9c64-45618c7f2623 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-87d8cd26-a751-45ad-9e37-e49280879b2a tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Lock "6550b41d-2414-4b3e-9a50-9bba88033aae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.981s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:54:09 user nova-compute[73104]: INFO nova.compute.manager [None req-9c432408-23a8-4422-9c64-45618c7f2623 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Detaching volume d97a6724-3b89-42f0-9ba7-ee0904e9993e
Aug 26 08:54:09 user nova-compute[73104]: DEBUG nova.compute.manager [req-cf0aaf55-e7fc-4c23-ac8f-de2446984384 req-8e70ea04-d449-4a20-8eb0-498420742014 service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Received event network-changed-a2c66a9f-398a-4f45-a821-5105e68bb4f4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG nova.compute.manager [req-cf0aaf55-e7fc-4c23-ac8f-de2446984384 req-8e70ea04-d449-4a20-8eb0-498420742014 service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Refreshing instance network info cache due to event network-changed-a2c66a9f-398a-4f45-a821-5105e68bb4f4. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-cf0aaf55-e7fc-4c23-ac8f-de2446984384 req-8e70ea04-d449-4a20-8eb0-498420742014 service nova] Acquiring lock "refresh_cache-e7ac6a94-05a2-4b11-a541-26b1d1dae070" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:54:09 user nova-compute[73104]: INFO nova.virt.block_device [None req-9c432408-23a8-4422-9c64-45618c7f2623 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Attempting to driver detach volume d97a6724-3b89-42f0-9ba7-ee0904e9993e from mountpoint /dev/vdb
Aug 26 08:54:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-9c432408-23a8-4422-9c64-45618c7f2623 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Attempting to detach device vdb from instance e7ac6a94-05a2-4b11-a541-26b1d1dae070 from the persistent domain config. {{(pid=73104) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-9c432408-23a8-4422-9c64-45618c7f2623 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:54:09 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:54:09 user nova-compute[73104]:   <source dev="/dev/sdc"/>
Aug 26 08:54:09 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:54:09 user nova-compute[73104]:   <serial>d97a6724-3b89-42f0-9ba7-ee0904e9993e</serial>
Aug 26 08:54:09 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 08:54:09 user nova-compute[73104]: </disk>
Aug 26 08:54:09 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:54:09 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-9c432408-23a8-4422-9c64-45618c7f2623 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Successfully detached device vdb from instance e7ac6a94-05a2-4b11-a541-26b1d1dae070 from the persistent domain config.
Aug 26 08:54:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-9c432408-23a8-4422-9c64-45618c7f2623 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e7ac6a94-05a2-4b11-a541-26b1d1dae070 from the live domain config. {{(pid=73104) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-9c432408-23a8-4422-9c64-45618c7f2623 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:54:09 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:54:09 user nova-compute[73104]:   <source dev="/dev/sdc"/>
Aug 26 08:54:09 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:54:09 user nova-compute[73104]:   <serial>d97a6724-3b89-42f0-9ba7-ee0904e9993e</serial>
Aug 26 08:54:09 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 08:54:09 user nova-compute[73104]: </disk>
Aug 26 08:54:09 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG nova.network.neutron [req-a52b8f34-9ea6-4d1a-93d8-1abd1b874e7e req-f2e0185b-5cf0-45b0-adb0-1b0350ffc42e service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Updated VIF entry in instance network info cache for port a2c66a9f-398a-4f45-a821-5105e68bb4f4. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG nova.network.neutron [req-a52b8f34-9ea6-4d1a-93d8-1abd1b874e7e req-f2e0185b-5cf0-45b0-adb0-1b0350ffc42e service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Updating instance_info_cache with network_info: [{"id": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "address": "fa:16:3e:12:ae:4a", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c66a9f-39", "ovs_interfaceid": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a52b8f34-9ea6-4d1a-93d8-1abd1b874e7e req-f2e0185b-5cf0-45b0-adb0-1b0350ffc42e service nova] Releasing lock "refresh_cache-e7ac6a94-05a2-4b11-a541-26b1d1dae070" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-cf0aaf55-e7fc-4c23-ac8f-de2446984384 req-8e70ea04-d449-4a20-8eb0-498420742014 service nova] Acquired lock "refresh_cache-e7ac6a94-05a2-4b11-a541-26b1d1dae070" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG nova.network.neutron [req-cf0aaf55-e7fc-4c23-ac8f-de2446984384 req-8e70ea04-d449-4a20-8eb0-498420742014 service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Refreshing network info cache for port a2c66a9f-398a-4f45-a821-5105e68bb4f4 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Received event <DeviceRemovedEvent: 1693040049.6179261, e7ac6a94-05a2-4b11-a541-26b1d1dae070 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73104) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-9c432408-23a8-4422-9c64-45618c7f2623 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e7ac6a94-05a2-4b11-a541-26b1d1dae070 {{(pid=73104) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 08:54:09 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-9c432408-23a8-4422-9c64-45618c7f2623 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Successfully detached device vdb from instance e7ac6a94-05a2-4b11-a541-26b1d1dae070 from the live domain config.
Aug 26 08:54:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c432408-23a8-4422-9c64-45618c7f2623 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c432408-23a8-4422-9c64-45618c7f2623 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KwpHJSaR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:54:09 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-9c432408-23a8-4422-9c64-45618c7f2623 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:54:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-9c432408-23a8-4422-9c64-45618c7f2623 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-9c432408-23a8-4422-9c64-45618c7f2623 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c432408-23a8-4422-9c64-45618c7f2623 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[872021bd-1a45-4cf0-a215-a63df8771254]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e66f695-88ae-46a2-a026-dd53a953e6b8]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c432408-23a8-4422-9c64-45618c7f2623 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:54:09 user nova-compute[73104]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e (non-flash)
Aug 26 08:54:09 user nova-compute[73104]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:54:09 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c432408-23a8-4422-9c64-45618c7f2623 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:54:09 user nova-compute[73104]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e (non-flash)
Aug 26 08:54:09 user nova-compute[73104]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:54:09 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c432408-23a8-4422-9c64-45618c7f2623 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0cc1ea710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e'): ({'sdc'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-9c432408-23a8-4422-9c64-45618c7f2623 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Removing single pathed devices sdc {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[054e2843-5be1-4ec7-9107-efe9d0021685]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[826dfc07-c406-477a-a838-5626521190f6]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-9c432408-23a8-4422-9c64-45618c7f2623 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Flushing IO for device /dev/sdc {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11776cf-df37-43c1-b616-4a0ead12d3c3]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-9c432408-23a8-4422-9c64-45618c7f2623 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb33d291-ec46-4488-ab5f-cf46ec4fb4ef]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-9c432408-23a8-4422-9c64-45618c7f2623 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-9c432408-23a8-4422-9c64-45618c7f2623 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] SCSI volumes sdc have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c432408-23a8-4422-9c64-45618c7f2623 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[363a35b2-72c3-4db1-bde7-bfbf7d85c579]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c432408-23a8-4422-9c64-45618c7f2623 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG nova.network.neutron [req-cf0aaf55-e7fc-4c23-ac8f-de2446984384 req-8e70ea04-d449-4a20-8eb0-498420742014 service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Updated VIF entry in instance network info cache for port a2c66a9f-398a-4f45-a821-5105e68bb4f4. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG nova.network.neutron [req-cf0aaf55-e7fc-4c23-ac8f-de2446984384 req-8e70ea04-d449-4a20-8eb0-498420742014 service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Updating instance_info_cache with network_info: [{"id": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "address": "fa:16:3e:12:ae:4a", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c66a9f-39", "ovs_interfaceid": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-cf0aaf55-e7fc-4c23-ac8f-de2446984384 req-8e70ea04-d449-4a20-8eb0-498420742014 service nova] Releasing lock "refresh_cache-e7ac6a94-05a2-4b11-a541-26b1d1dae070" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG nova.compute.manager [req-cf0aaf55-e7fc-4c23-ac8f-de2446984384 req-8e70ea04-d449-4a20-8eb0-498420742014 service nova] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Received event network-vif-plugged-cfa211db-57c3-47a2-82e1-f9536415953c {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-cf0aaf55-e7fc-4c23-ac8f-de2446984384 req-8e70ea04-d449-4a20-8eb0-498420742014 service nova] Acquiring lock "6550b41d-2414-4b3e-9a50-9bba88033aae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-cf0aaf55-e7fc-4c23-ac8f-de2446984384 req-8e70ea04-d449-4a20-8eb0-498420742014 service nova] Lock "6550b41d-2414-4b3e-9a50-9bba88033aae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-cf0aaf55-e7fc-4c23-ac8f-de2446984384 req-8e70ea04-d449-4a20-8eb0-498420742014 service nova] Lock "6550b41d-2414-4b3e-9a50-9bba88033aae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG nova.compute.manager [req-cf0aaf55-e7fc-4c23-ac8f-de2446984384 req-8e70ea04-d449-4a20-8eb0-498420742014 service nova] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] No waiting events found dispatching network-vif-plugged-cfa211db-57c3-47a2-82e1-f9536415953c {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:54:09 user nova-compute[73104]: WARNING nova.compute.manager [req-cf0aaf55-e7fc-4c23-ac8f-de2446984384 req-8e70ea04-d449-4a20-8eb0-498420742014 service nova] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Received unexpected event network-vif-plugged-cfa211db-57c3-47a2-82e1-f9536415953c for instance with vm_state active and task_state None.
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb88f454-8c7d-4358-80fd-686509d8781a]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c432408-23a8-4422-9c64-45618c7f2623 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e, portal: 172.16.0.220,3260]
Aug 26 08:54:09 user nova-compute[73104]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e, portal: 172.16.0.220,3260] successful.
Aug 26 08:54:09 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97a6724-3b89-42f0-9ba7-ee0904e9993e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6bd786-14af-460d-baaa-76fb1d5a9c2a]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c432408-23a8-4422-9c64-45618c7f2623 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-9c432408-23a8-4422-9c64-45618c7f2623 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c432408-23a8-4422-9c64-45618c7f2623 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] <== disconnect_volume: return (315ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:54:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c432408-23a8-4422-9c64-45618c7f2623 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG nova.objects.instance [None req-9c432408-23a8-4422-9c64-45618c7f2623 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lazy-loading 'flavor' on Instance uuid e7ac6a94-05a2-4b11-a541-26b1d1dae070 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9c432408-23a8-4422-9c64-45618c7f2623 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.812s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG nova.compute.manager [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:54:10 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Creating image(s)
Aug 26 08:54:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Did not create local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Ensure instance console log exists: /opt/stack/data/nova/instances/c08a447c-e25d-4f88-b15f-0c3de12559aa/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Start _get_guest_xml network_info=[{"id": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "address": "fa:16:3e:3a:b1:b8", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15317ff8-61", "ovs_interfaceid": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '4bb81466-e184-42ab-be6d-9eec4efce1d5', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pPYHBKjQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c08a447c-e25d-4f88-b15f-0c3de12559aa', 'attached_at': '', 'detached_at': '', 'volume_id': 'bad36aef-53e3-49c3-9dd8-e4b9c2d65185', 'serial': 'bad36aef-53e3-49c3-9dd8-e4b9c2d65185'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:54:10 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:54:10 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:54:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pPYHBKjQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:54:10 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:54:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:54:10 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:54:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:54:10 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:54:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[56960a86-4a18-474a-83f9-1d0ee49f1a81]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:54:10 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[24712091-a23f-4ceb-8b68-491c8c28c160]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185] added
Aug 26 08:54:10 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[358432fe-b617-4202-9c38-2ad59e761d15]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:54:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[993043cc-f9ca-4b8d-be0b-4bbd6763cb19]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pPYHBKjQ {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pPYHBKjQ" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f50722-299e-4893-932c-d0ae1a4a8211]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pPYHBKjQ'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3690443e-0e78-48e7-a745-965169b4d1c9]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f37d22-398e-4a73-871b-42cc1d9d0622]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:54:11 user nova-compute[73104]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:54:11 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:54:11 user nova-compute[73104]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:54:11 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7de50fe-9807-432d-b247-167f79d929f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185, portal: 172.16.0.220,3260]
Aug 26 08:54:11 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185, portal: 172.16.0.220,3260] successful.
Aug 26 08:54:11 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85ef96e-7b6a-4c84-8d22-cca293d90558]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2eee8fb-900d-44cc-8905-352115750c97]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:54:11 user nova-compute[73104]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:54:11 user nova-compute[73104]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:54:11 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:54:11 user nova-compute[73104]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:54:11 user nova-compute[73104]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:54:11 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c581d3-1ed9-4c2a-8f77-ed929a6e5227]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:54:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pPYHBKjQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:54:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:54:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23236303931633061', 'path': '/dev/sdc'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:54:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236303931633061', 'path': '/dev/sdc'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:54:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:53:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-437929114',display_name='tempest-ServerActionsTestOtherA-server-437929114',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-437929114',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDd7CVbfrgJk+LANTVyASPXlTQ9/WFcC61mCbmrDUGOXT5afWNcplXvZ22xaA7blYJtw8QDJAtG8f1dybdt3ItZCTVqOwov6sASWzyNlxMeQebqYtQoQd/bQsWZ9J2R2Q==',key_name='tempest-keypair-923484929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efb864c0a34541dca00c6dbbcea17319',ramdisk_id='',reservation_id='r-iqtdg5qf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1245661612',owner_user_name='tempest-ServerActionsTestOtherA-1245661612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:53:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='257343af54bd42b591e8874ef4ecf8dc',uuid=c08a447c-e25d-4f88-b15f-0c3de12559aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "address": "fa:16:3e:3a:b1:b8", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15317ff8-61", "ovs_interfaceid": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:54:12 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Converting VIF {"id": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "address": "fa:16:3e:3a:b1:b8", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15317ff8-61", "ovs_interfaceid": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:54:12 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:b1:b8,bridge_name='br-int',has_traffic_filtering=True,id=15317ff8-610b-4e0a-b0a8-ef37bb219ba8,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15317ff8-61') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:54:12 user nova-compute[73104]: DEBUG nova.objects.instance [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lazy-loading 'pci_devices' on Instance uuid c08a447c-e25d-4f88-b15f-0c3de12559aa {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:54:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:54:12 user nova-compute[73104]:   <uuid>c08a447c-e25d-4f88-b15f-0c3de12559aa</uuid>
Aug 26 08:54:12 user nova-compute[73104]:   <name>instance-0000001f</name>
Aug 26 08:54:12 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:54:12 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:54:12 user nova-compute[73104]:   <metadata>
Aug 26 08:54:12 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:54:12 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:54:12 user nova-compute[73104]:       <nova:name>tempest-ServerActionsTestOtherA-server-437929114</nova:name>
Aug 26 08:54:12 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:54:10</nova:creationTime>
Aug 26 08:54:12 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:54:12 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:54:12 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:54:12 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:54:12 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:54:12 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:54:12 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:54:12 user nova-compute[73104]:       <nova:owner>
Aug 26 08:54:12 user nova-compute[73104]:         <nova:user uuid="257343af54bd42b591e8874ef4ecf8dc">tempest-ServerActionsTestOtherA-1245661612-project-member</nova:user>
Aug 26 08:54:12 user nova-compute[73104]:         <nova:project uuid="efb864c0a34541dca00c6dbbcea17319">tempest-ServerActionsTestOtherA-1245661612</nova:project>
Aug 26 08:54:12 user nova-compute[73104]:       </nova:owner>
Aug 26 08:54:12 user nova-compute[73104]:       <nova:ports>
Aug 26 08:54:12 user nova-compute[73104]:         <nova:port uuid="15317ff8-610b-4e0a-b0a8-ef37bb219ba8">
Aug 26 08:54:12 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 08:54:12 user nova-compute[73104]:         </nova:port>
Aug 26 08:54:12 user nova-compute[73104]:       </nova:ports>
Aug 26 08:54:12 user nova-compute[73104]:     </nova:instance>
Aug 26 08:54:12 user nova-compute[73104]:   </metadata>
Aug 26 08:54:12 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:54:12 user nova-compute[73104]:     <system>
Aug 26 08:54:12 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:54:12 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:54:12 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:54:12 user nova-compute[73104]:       <entry name="serial">c08a447c-e25d-4f88-b15f-0c3de12559aa</entry>
Aug 26 08:54:12 user nova-compute[73104]:       <entry name="uuid">c08a447c-e25d-4f88-b15f-0c3de12559aa</entry>
Aug 26 08:54:12 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:54:12 user nova-compute[73104]:     </system>
Aug 26 08:54:12 user nova-compute[73104]:   </sysinfo>
Aug 26 08:54:12 user nova-compute[73104]:   <os>
Aug 26 08:54:12 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:54:12 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:54:12 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:54:12 user nova-compute[73104]:   </os>
Aug 26 08:54:12 user nova-compute[73104]:   <features>
Aug 26 08:54:12 user nova-compute[73104]:     <acpi/>
Aug 26 08:54:12 user nova-compute[73104]:     <apic/>
Aug 26 08:54:12 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:54:12 user nova-compute[73104]:   </features>
Aug 26 08:54:12 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:54:12 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:54:12 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:54:12 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:54:12 user nova-compute[73104]:   </clock>
Aug 26 08:54:12 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:54:12 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:54:12 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:54:12 user nova-compute[73104]:   </cpu>
Aug 26 08:54:12 user nova-compute[73104]:   <devices>
Aug 26 08:54:12 user nova-compute[73104]:     <disk type="block" device="disk">
Aug 26 08:54:12 user nova-compute[73104]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:54:12 user nova-compute[73104]:       <source dev="/dev/sdc"/>
Aug 26 08:54:12 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:54:12 user nova-compute[73104]:       <serial>bad36aef-53e3-49c3-9dd8-e4b9c2d65185</serial>
Aug 26 08:54:12 user nova-compute[73104]:     </disk>
Aug 26 08:54:12 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:54:12 user nova-compute[73104]:       <mac address="fa:16:3e:3a:b1:b8"/>
Aug 26 08:54:12 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:54:12 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:54:12 user nova-compute[73104]:       <target dev="tap15317ff8-61"/>
Aug 26 08:54:12 user nova-compute[73104]:     </interface>
Aug 26 08:54:12 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:54:12 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/c08a447c-e25d-4f88-b15f-0c3de12559aa/console.log" append="off"/>
Aug 26 08:54:12 user nova-compute[73104]:     </serial>
Aug 26 08:54:12 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:54:12 user nova-compute[73104]:     <video>
Aug 26 08:54:12 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:54:12 user nova-compute[73104]:     </video>
Aug 26 08:54:12 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:54:12 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:54:12 user nova-compute[73104]:     </rng>
Aug 26 08:54:12 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:54:12 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:54:12 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:54:12 user nova-compute[73104]:     </memballoon>
Aug 26 08:54:12 user nova-compute[73104]:   </devices>
Aug 26 08:54:12 user nova-compute[73104]: </domain>
Aug 26 08:54:12 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:54:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:53:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-437929114',display_name='tempest-ServerActionsTestOtherA-server-437929114',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-437929114',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDd7CVbfrgJk+LANTVyASPXlTQ9/WFcC61mCbmrDUGOXT5afWNcplXvZ22xaA7blYJtw8QDJAtG8f1dybdt3ItZCTVqOwov6sASWzyNlxMeQebqYtQoQd/bQsWZ9J2R2Q==',key_name='tempest-keypair-923484929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efb864c0a34541dca00c6dbbcea17319',ramdisk_id='',reservation_id='r-iqtdg5qf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1245661612',owner_user_name='tempest-ServerActionsTestOtherA-1245661612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:53:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='257343af54bd42b591e8874ef4ecf8dc',uuid=c08a447c-e25d-4f88-b15f-0c3de12559aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "address": "fa:16:3e:3a:b1:b8", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15317ff8-61", "ovs_interfaceid": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:54:12 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Converting VIF {"id": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "address": "fa:16:3e:3a:b1:b8", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15317ff8-61", "ovs_interfaceid": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:54:12 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:b1:b8,bridge_name='br-int',has_traffic_filtering=True,id=15317ff8-610b-4e0a-b0a8-ef37bb219ba8,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15317ff8-61') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:54:12 user nova-compute[73104]: DEBUG os_vif [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:b1:b8,bridge_name='br-int',has_traffic_filtering=True,id=15317ff8-610b-4e0a-b0a8-ef37bb219ba8,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15317ff8-61') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:54:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:54:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:54:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15317ff8-61, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:54:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap15317ff8-61, col_values=(('external_ids', {'iface-id': '15317ff8-610b-4e0a-b0a8-ef37bb219ba8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:b1:b8', 'vm-uuid': 'c08a447c-e25d-4f88-b15f-0c3de12559aa'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:54:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:54:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:12 user nova-compute[73104]: INFO os_vif [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:b1:b8,bridge_name='br-int',has_traffic_filtering=True,id=15317ff8-610b-4e0a-b0a8-ef37bb219ba8,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15317ff8-61')
Aug 26 08:54:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:54:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] No VIF found with MAC fa:16:3e:3a:b1:b8, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:54:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:13 user nova-compute[73104]: DEBUG nova.compute.manager [req-a8334add-8d5a-441f-9c6d-ed813536664c req-e4a45ab4-285d-46a4-8b35-f5fe6f94e723 service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Received event network-vif-plugged-15317ff8-610b-4e0a-b0a8-ef37bb219ba8 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:54:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a8334add-8d5a-441f-9c6d-ed813536664c req-e4a45ab4-285d-46a4-8b35-f5fe6f94e723 service nova] Acquiring lock "c08a447c-e25d-4f88-b15f-0c3de12559aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:54:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a8334add-8d5a-441f-9c6d-ed813536664c req-e4a45ab4-285d-46a4-8b35-f5fe6f94e723 service nova] Lock "c08a447c-e25d-4f88-b15f-0c3de12559aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:54:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a8334add-8d5a-441f-9c6d-ed813536664c req-e4a45ab4-285d-46a4-8b35-f5fe6f94e723 service nova] Lock "c08a447c-e25d-4f88-b15f-0c3de12559aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:54:13 user nova-compute[73104]: DEBUG nova.compute.manager [req-a8334add-8d5a-441f-9c6d-ed813536664c req-e4a45ab4-285d-46a4-8b35-f5fe6f94e723 service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] No waiting events found dispatching network-vif-plugged-15317ff8-610b-4e0a-b0a8-ef37bb219ba8 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:54:13 user nova-compute[73104]: WARNING nova.compute.manager [req-a8334add-8d5a-441f-9c6d-ed813536664c req-e4a45ab4-285d-46a4-8b35-f5fe6f94e723 service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Received unexpected event network-vif-plugged-15317ff8-610b-4e0a-b0a8-ef37bb219ba8 for instance with vm_state building and task_state spawning.
Aug 26 08:54:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:15 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040055.9327493, c08a447c-e25d-4f88-b15f-0c3de12559aa => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:54:15 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] VM Resumed (Lifecycle Event)
Aug 26 08:54:15 user nova-compute[73104]: DEBUG nova.compute.manager [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:54:15 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:54:15 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Instance spawned successfully.
Aug 26 08:54:15 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:54:15 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:54:15 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:54:15 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:54:15 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:54:15 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:54:15 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:54:15 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:54:15 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:54:15 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:54:15 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040055.936099, c08a447c-e25d-4f88-b15f-0c3de12559aa => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:54:15 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] VM Started (Lifecycle Event)
Aug 26 08:54:15 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:54:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:54:16 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:54:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-d2845ffe-9ae8-4bb5-9c89-01af64977258 req-e20133e4-93e1-4231-9bd1-ad970bcbc22e service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Received event network-vif-plugged-15317ff8-610b-4e0a-b0a8-ef37bb219ba8 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:54:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d2845ffe-9ae8-4bb5-9c89-01af64977258 req-e20133e4-93e1-4231-9bd1-ad970bcbc22e service nova] Acquiring lock "c08a447c-e25d-4f88-b15f-0c3de12559aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:54:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d2845ffe-9ae8-4bb5-9c89-01af64977258 req-e20133e4-93e1-4231-9bd1-ad970bcbc22e service nova] Lock "c08a447c-e25d-4f88-b15f-0c3de12559aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:54:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d2845ffe-9ae8-4bb5-9c89-01af64977258 req-e20133e4-93e1-4231-9bd1-ad970bcbc22e service nova] Lock "c08a447c-e25d-4f88-b15f-0c3de12559aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:54:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-d2845ffe-9ae8-4bb5-9c89-01af64977258 req-e20133e4-93e1-4231-9bd1-ad970bcbc22e service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] No waiting events found dispatching network-vif-plugged-15317ff8-610b-4e0a-b0a8-ef37bb219ba8 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:54:16 user nova-compute[73104]: WARNING nova.compute.manager [req-d2845ffe-9ae8-4bb5-9c89-01af64977258 req-e20133e4-93e1-4231-9bd1-ad970bcbc22e service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Received unexpected event network-vif-plugged-15317ff8-610b-4e0a-b0a8-ef37bb219ba8 for instance with vm_state building and task_state spawning.
Aug 26 08:54:16 user nova-compute[73104]: INFO nova.compute.manager [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Took 5.19 seconds to spawn the instance on the hypervisor.
Aug 26 08:54:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:54:16 user nova-compute[73104]: INFO nova.compute.manager [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Took 17.90 seconds to build instance.
Aug 26 08:54:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0ec2d8f6-7267-4327-8930-eb31e805cf7a tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "c08a447c-e25d-4f88-b15f-0c3de12559aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.011s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:54:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:24 user nova-compute[73104]: DEBUG nova.compute.manager [None req-154c76b5-e637-4a37-9597-6a43d98bba4e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:54:24 user nova-compute[73104]: INFO nova.compute.manager [None req-154c76b5-e637-4a37-9597-6a43d98bba4e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] instance snapshotting
Aug 26 08:54:24 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-154c76b5-e637-4a37-9597-6a43d98bba4e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Beginning live snapshot process
Aug 26 08:54:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-154c76b5-e637-4a37-9597-6a43d98bba4e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json -f qcow2 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-154c76b5-e637-4a37-9597-6a43d98bba4e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-154c76b5-e637-4a37-9597-6a43d98bba4e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json -f qcow2 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-154c76b5-e637-4a37-9597-6a43d98bba4e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-154c76b5-e637-4a37-9597-6a43d98bba4e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-154c76b5-e637-4a37-9597-6a43d98bba4e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.186s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-154c76b5-e637-4a37-9597-6a43d98bba4e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0x4sf0nc/8164b5d57ed84a249227c4b9d4d2ada3.delta 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-154c76b5-e637-4a37-9597-6a43d98bba4e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0x4sf0nc/8164b5d57ed84a249227c4b9d4d2ada3.delta 1073741824" returned: 0 in 0.077s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:25 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-154c76b5-e637-4a37-9597-6a43d98bba4e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 08:54:26 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-154c76b5-e637-4a37-9597-6a43d98bba4e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73104) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 08:54:26 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-154c76b5-e637-4a37-9597-6a43d98bba4e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73104) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 08:54:26 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-154c76b5-e637-4a37-9597-6a43d98bba4e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 08:54:26 user nova-compute[73104]: DEBUG nova.privsep.utils [None req-154c76b5-e637-4a37-9597-6a43d98bba4e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73104) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 08:54:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-154c76b5-e637-4a37-9597-6a43d98bba4e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0x4sf0nc/8164b5d57ed84a249227c4b9d4d2ada3.delta /opt/stack/data/nova/instances/snapshots/tmp0x4sf0nc/8164b5d57ed84a249227c4b9d4d2ada3 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-154c76b5-e637-4a37-9597-6a43d98bba4e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0x4sf0nc/8164b5d57ed84a249227c4b9d4d2ada3.delta /opt/stack/data/nova/instances/snapshots/tmp0x4sf0nc/8164b5d57ed84a249227c4b9d4d2ada3" returned: 0 in 0.590s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:27 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-154c76b5-e637-4a37-9597-6a43d98bba4e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Snapshot extracted, beginning image upload
Aug 26 08:54:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:30 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-154c76b5-e637-4a37-9597-6a43d98bba4e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Snapshot image upload complete
Aug 26 08:54:30 user nova-compute[73104]: INFO nova.compute.manager [None req-154c76b5-e637-4a37-9597-6a43d98bba4e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Took 5.60 seconds to snapshot the instance on the hypervisor.
Aug 26 08:54:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:54:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 08:54:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 08:54:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 08:54:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:57 user nova-compute[73104]: DEBUG nova.compute.manager [None req-ed9e84eb-f4aa-4bed-a537-d5ddace0ab37 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:54:57 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:54:57 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:54:57 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:54:57 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 08:54:57 user nova-compute[73104]: INFO nova.compute.manager [None req-ed9e84eb-f4aa-4bed-a537-d5ddace0ab37 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] instance snapshotting
Aug 26 08:54:57 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-ed9e84eb-f4aa-4bed-a537-d5ddace0ab37 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Beginning live snapshot process
Aug 26 08:54:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:54:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 08:54:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 08:54:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 08:54:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-ed9e84eb-f4aa-4bed-a537-d5ddace0ab37 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json -f qcow2 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-ed9e84eb-f4aa-4bed-a537-d5ddace0ab37 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-ed9e84eb-f4aa-4bed-a537-d5ddace0ab37 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json -f qcow2 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-ed9e84eb-f4aa-4bed-a537-d5ddace0ab37 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-ed9e84eb-f4aa-4bed-a537-d5ddace0ab37 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-ed9e84eb-f4aa-4bed-a537-d5ddace0ab37 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.188s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-ed9e84eb-f4aa-4bed-a537-d5ddace0ab37 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5q9yhe_j/17327b77300040329354ab969fa3d100.delta 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:54:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-ed9e84eb-f4aa-4bed-a537-d5ddace0ab37 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5q9yhe_j/17327b77300040329354ab969fa3d100.delta 1073741824" returned: 0 in 0.054s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:54:58 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-ed9e84eb-f4aa-4bed-a537-d5ddace0ab37 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 08:54:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:54:58 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-ed9e84eb-f4aa-4bed-a537-d5ddace0ab37 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=73104) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 08:54:59 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-ed9e84eb-f4aa-4bed-a537-d5ddace0ab37 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73104) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 08:54:59 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-ed9e84eb-f4aa-4bed-a537-d5ddace0ab37 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 08:54:59 user nova-compute[73104]: DEBUG nova.privsep.utils [None req-ed9e84eb-f4aa-4bed-a537-d5ddace0ab37 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73104) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 08:54:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-ed9e84eb-f4aa-4bed-a537-d5ddace0ab37 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5q9yhe_j/17327b77300040329354ab969fa3d100.delta /opt/stack/data/nova/instances/snapshots/tmp5q9yhe_j/17327b77300040329354ab969fa3d100 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-ed9e84eb-f4aa-4bed-a537-d5ddace0ab37 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5q9yhe_j/17327b77300040329354ab969fa3d100.delta /opt/stack/data/nova/instances/snapshots/tmp5q9yhe_j/17327b77300040329354ab969fa3d100" returned: 0 in 0.576s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:00 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-ed9e84eb-f4aa-4bed-a537-d5ddace0ab37 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Snapshot extracted, beginning image upload
Aug 26 08:55:00 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:55:00 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:55:00 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:55:02 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:55:02 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:55:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:55:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:55:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:55:02 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 08:55:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:55:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:03 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-ed9e84eb-f4aa-4bed-a537-d5ddace0ab37 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Snapshot image upload complete
Aug 26 08:55:03 user nova-compute[73104]: INFO nova.compute.manager [None req-ed9e84eb-f4aa-4bed-a537-d5ddace0ab37 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Took 6.03 seconds to snapshot the instance on the hypervisor.
Aug 26 08:55:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6550b41d-2414-4b3e-9a50-9bba88033aae/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6550b41d-2414-4b3e-9a50-9bba88033aae/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6550b41d-2414-4b3e-9a50-9bba88033aae/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6550b41d-2414-4b3e-9a50-9bba88033aae/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:04 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:55:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:55:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Acquiring lock "1b45635b-062b-4149-8789-9f5191132cbd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:55:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "1b45635b-062b-4149-8789-9f5191132cbd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:55:06 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:55:06 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:55:06 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=7774MB free_disk=23.998355865478516GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 08:55:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:55:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:55:06 user nova-compute[73104]: DEBUG nova.compute.manager [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:55:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:55:06 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance b5e1f82c-5675-4c37-8ba2-44e6a341a576 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:55:06 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 3cf85d2f-de0d-4e9b-a534-98c799ae8db9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:55:06 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance bef1e493-6b2c-4688-98c2-647261feb571 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:55:06 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance e7ac6a94-05a2-4b11-a541-26b1d1dae070 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:55:06 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 33048996-d559-4b3c-9de9-39bb176c3ec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:55:06 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 945acd46-42e2-4c45-b8e5-9ea94703bc66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:55:06 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance bf35aa10-80b1-4518-88b3-63c6a11e626b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:55:06 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance c08a447c-e25d-4f88-b15f-0c3de12559aa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:55:06 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 6550b41d-2414-4b3e-9a50-9bba88033aae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:55:06 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 1b45635b-062b-4149-8789-9f5191132cbd has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 26 08:55:06 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 08:55:06 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 08:55:06 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:55:06 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:55:06 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 08:55:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.486s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:55:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.377s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:55:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:55:06 user nova-compute[73104]: INFO nova.compute.claims [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Claim successful on node user
Aug 26 08:55:07 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:55:07 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:55:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.574s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:55:07 user nova-compute[73104]: DEBUG nova.compute.manager [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:55:07 user nova-compute[73104]: DEBUG nova.compute.manager [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:55:07 user nova-compute[73104]: DEBUG nova.network.neutron [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:55:07 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:55:07 user nova-compute[73104]: DEBUG nova.compute.manager [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:55:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:55:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3120a597-68a9-425c-a589-5e27c357fe4f tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:55:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3120a597-68a9-425c-a589-5e27c357fe4f tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:55:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3120a597-68a9-425c-a589-5e27c357fe4f tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:55:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3120a597-68a9-425c-a589-5e27c357fe4f tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:55:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3120a597-68a9-425c-a589-5e27c357fe4f tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:55:07 user nova-compute[73104]: INFO nova.compute.manager [None req-3120a597-68a9-425c-a589-5e27c357fe4f tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Terminating instance
Aug 26 08:55:07 user nova-compute[73104]: DEBUG nova.compute.manager [None req-3120a597-68a9-425c-a589-5e27c357fe4f tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 08:55:07 user nova-compute[73104]: DEBUG nova.policy [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dea79c0b1d874d27b63d7e5418d12505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f8b4744aa5450ca396714b74a01049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:55:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:07 user nova-compute[73104]: DEBUG nova.compute.manager [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:55:07 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:55:07 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Creating image(s)
Aug 26 08:55:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Acquiring lock "/opt/stack/data/nova/instances/1b45635b-062b-4149-8789-9f5191132cbd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:55:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "/opt/stack/data/nova/instances/1b45635b-062b-4149-8789-9f5191132cbd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:55:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "/opt/stack/data/nova/instances/1b45635b-062b-4149-8789-9f5191132cbd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.036s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:55:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Acquiring lock "68d231f55e691c5ea3845d5aaa824fe28b7caec4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:55:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "68d231f55e691c5ea3845d5aaa824fe28b7caec4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:55:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68d231f55e691c5ea3845d5aaa824fe28b7caec4.part --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:08 user nova-compute[73104]: DEBUG nova.compute.manager [req-6b8d22bb-cdd4-4d3c-b6b3-2e034fab6ad0 req-0b453fdc-e01c-45dd-9d62-c4ca747dbdda service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Received event network-vif-unplugged-a2c66a9f-398a-4f45-a821-5105e68bb4f4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:55:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6b8d22bb-cdd4-4d3c-b6b3-2e034fab6ad0 req-0b453fdc-e01c-45dd-9d62-c4ca747dbdda service nova] Acquiring lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:55:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6b8d22bb-cdd4-4d3c-b6b3-2e034fab6ad0 req-0b453fdc-e01c-45dd-9d62-c4ca747dbdda service nova] Lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:55:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6b8d22bb-cdd4-4d3c-b6b3-2e034fab6ad0 req-0b453fdc-e01c-45dd-9d62-c4ca747dbdda service nova] Lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:55:08 user nova-compute[73104]: DEBUG nova.compute.manager [req-6b8d22bb-cdd4-4d3c-b6b3-2e034fab6ad0 req-0b453fdc-e01c-45dd-9d62-c4ca747dbdda service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] No waiting events found dispatching network-vif-unplugged-a2c66a9f-398a-4f45-a821-5105e68bb4f4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:55:08 user nova-compute[73104]: DEBUG nova.compute.manager [req-6b8d22bb-cdd4-4d3c-b6b3-2e034fab6ad0 req-0b453fdc-e01c-45dd-9d62-c4ca747dbdda service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Received event network-vif-unplugged-a2c66a9f-398a-4f45-a821-5105e68bb4f4 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:55:08 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Instance destroyed successfully.
Aug 26 08:55:08 user nova-compute[73104]: DEBUG nova.objects.instance [None req-3120a597-68a9-425c-a589-5e27c357fe4f tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lazy-loading 'resources' on Instance uuid e7ac6a94-05a2-4b11-a541-26b1d1dae070 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:55:08 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-3120a597-68a9-425c-a589-5e27c357fe4f tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:49:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2138351221',display_name='tempest-TestMinimumBasicScenario-server-2138351221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2138351221',id=27,image_ref='caf1cead-10a3-4849-8ac8-41228db7483f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDf00vmyBYw2P7QhlbDbc1fxtWuQ5FRLimltxpKURXRzn5zjIkyr4ORgtHBY8o9wAiBvVJ9BzrGsFCqEeA1uJ71YqknXVzsYW5BkhDEkS/bhJees5zknqzrUGDIQpFutQ==',key_name='tempest-TestMinimumBasicScenario-523425789',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:49:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='718e3cb41d5342069cd73b96bade97e7',ramdisk_id='',reservation_id='r-ceg6sez0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='caf1cead-10a3-4849-8ac8-41228db7483f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1112860810',owner_user_name='tempest-TestMinimumBasicScenario-1112860810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:52:23Z,user_data=None,user_id='6fd47a4b6ae846a79a378d6ed543fd1c',uuid=e7ac6a94-05a2-4b11-a541-26b1d1dae070,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "address": "fa:16:3e:12:ae:4a", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c66a9f-39", "ovs_interfaceid": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:55:08 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-3120a597-68a9-425c-a589-5e27c357fe4f tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Converting VIF {"id": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "address": "fa:16:3e:12:ae:4a", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c66a9f-39", "ovs_interfaceid": "a2c66a9f-398a-4f45-a821-5105e68bb4f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:55:08 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-3120a597-68a9-425c-a589-5e27c357fe4f tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:ae:4a,bridge_name='br-int',has_traffic_filtering=True,id=a2c66a9f-398a-4f45-a821-5105e68bb4f4,network=Network(85684c43-d34e-47e3-a067-9c4fb1520baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2c66a9f-39') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:55:08 user nova-compute[73104]: DEBUG os_vif [None req-3120a597-68a9-425c-a589-5e27c357fe4f tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:ae:4a,bridge_name='br-int',has_traffic_filtering=True,id=a2c66a9f-398a-4f45-a821-5105e68bb4f4,network=Network(85684c43-d34e-47e3-a067-9c4fb1520baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2c66a9f-39') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:55:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2c66a9f-39, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:55:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:55:08 user nova-compute[73104]: DEBUG nova.network.neutron [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Successfully created port: 3c47a327-42ad-484a-8cf8-33e131233bcd {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:55:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:08 user nova-compute[73104]: INFO os_vif [None req-3120a597-68a9-425c-a589-5e27c357fe4f tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:ae:4a,bridge_name='br-int',has_traffic_filtering=True,id=a2c66a9f-398a-4f45-a821-5105e68bb4f4,network=Network(85684c43-d34e-47e3-a067-9c4fb1520baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2c66a9f-39')
Aug 26 08:55:08 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-3120a597-68a9-425c-a589-5e27c357fe4f tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Deleting instance files /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070_del
Aug 26 08:55:08 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-3120a597-68a9-425c-a589-5e27c357fe4f tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Deletion of /opt/stack/data/nova/instances/e7ac6a94-05a2-4b11-a541-26b1d1dae070_del complete
Aug 26 08:55:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68d231f55e691c5ea3845d5aaa824fe28b7caec4.part --force-share --output=json" returned: 0 in 0.201s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:08 user nova-compute[73104]: DEBUG nova.virt.images [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] 68910971-ab50-4eeb-8296-e6f5bd45dea6 was qcow2, converting to raw {{(pid=73104) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 08:55:08 user nova-compute[73104]: DEBUG nova.privsep.utils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73104) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 08:55:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/68d231f55e691c5ea3845d5aaa824fe28b7caec4.part /opt/stack/data/nova/instances/_base/68d231f55e691c5ea3845d5aaa824fe28b7caec4.converted {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:08 user nova-compute[73104]: INFO nova.compute.manager [None req-3120a597-68a9-425c-a589-5e27c357fe4f tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Took 1.45 seconds to destroy the instance on the hypervisor.
Aug 26 08:55:08 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-3120a597-68a9-425c-a589-5e27c357fe4f tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 08:55:08 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 08:55:08 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 08:55:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/68d231f55e691c5ea3845d5aaa824fe28b7caec4.part /opt/stack/data/nova/instances/_base/68d231f55e691c5ea3845d5aaa824fe28b7caec4.converted" returned: 0 in 0.684s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68d231f55e691c5ea3845d5aaa824fe28b7caec4.converted --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:09 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:55:09 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Took 0.80 seconds to deallocate network for instance.
Aug 26 08:55:09 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:55:09 user nova-compute[73104]: DEBUG nova.compute.manager [req-e31296de-7287-46ee-91f4-659d51dadc01 req-bf6a1f3d-2dd6-4bae-8430-5cbb142af9ab service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Received event network-vif-deleted-a2c66a9f-398a-4f45-a821-5105e68bb4f4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:55:09 user nova-compute[73104]: INFO nova.compute.manager [req-e31296de-7287-46ee-91f4-659d51dadc01 req-bf6a1f3d-2dd6-4bae-8430-5cbb142af9ab service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Neutron deleted interface a2c66a9f-398a-4f45-a821-5105e68bb4f4; detaching it from the instance and deleting it from the info cache
Aug 26 08:55:09 user nova-compute[73104]: DEBUG nova.network.neutron [req-e31296de-7287-46ee-91f4-659d51dadc01 req-bf6a1f3d-2dd6-4bae-8430-5cbb142af9ab service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:55:09 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:55:09 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 08:55:09 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Rebuilding the list of instances to heal {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 08:55:09 user nova-compute[73104]: DEBUG nova.compute.manager [req-e31296de-7287-46ee-91f4-659d51dadc01 req-bf6a1f3d-2dd6-4bae-8430-5cbb142af9ab service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Detach interface failed, port_id=a2c66a9f-398a-4f45-a821-5105e68bb4f4, reason: Instance e7ac6a94-05a2-4b11-a541-26b1d1dae070 could not be found. {{(pid=73104) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 08:55:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68d231f55e691c5ea3845d5aaa824fe28b7caec4.converted --force-share --output=json" returned: 0 in 0.207s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "68d231f55e691c5ea3845d5aaa824fe28b7caec4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.109s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:55:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68d231f55e691c5ea3845d5aaa824fe28b7caec4 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:09 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Skipping network cache update for instance because it is being deleted. {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Aug 26 08:55:09 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Skipping network cache update for instance because it is Building. {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 26 08:55:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3120a597-68a9-425c-a589-5e27c357fe4f tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:55:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3120a597-68a9-425c-a589-5e27c357fe4f tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:55:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-b5e1f82c-5675-4c37-8ba2-44e6a341a576" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:55:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-b5e1f82c-5675-4c37-8ba2-44e6a341a576" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:55:09 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 08:55:09 user nova-compute[73104]: DEBUG nova.objects.instance [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lazy-loading 'info_cache' on Instance uuid b5e1f82c-5675-4c37-8ba2-44e6a341a576 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:55:09 user nova-compute[73104]: DEBUG nova.compute.manager [req-a5214701-0010-4698-845e-e0e1aea74462 req-7b176d69-81d7-40e1-b49c-5a27bee1fb55 service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Received event network-vif-plugged-a2c66a9f-398a-4f45-a821-5105e68bb4f4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:55:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a5214701-0010-4698-845e-e0e1aea74462 req-7b176d69-81d7-40e1-b49c-5a27bee1fb55 service nova] Acquiring lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:55:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a5214701-0010-4698-845e-e0e1aea74462 req-7b176d69-81d7-40e1-b49c-5a27bee1fb55 service nova] Lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:55:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a5214701-0010-4698-845e-e0e1aea74462 req-7b176d69-81d7-40e1-b49c-5a27bee1fb55 service nova] Lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:55:09 user nova-compute[73104]: DEBUG nova.compute.manager [req-a5214701-0010-4698-845e-e0e1aea74462 req-7b176d69-81d7-40e1-b49c-5a27bee1fb55 service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] No waiting events found dispatching network-vif-plugged-a2c66a9f-398a-4f45-a821-5105e68bb4f4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:55:09 user nova-compute[73104]: WARNING nova.compute.manager [req-a5214701-0010-4698-845e-e0e1aea74462 req-7b176d69-81d7-40e1-b49c-5a27bee1fb55 service nova] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Received unexpected event network-vif-plugged-a2c66a9f-398a-4f45-a821-5105e68bb4f4 for instance with vm_state deleted and task_state None.
Aug 26 08:55:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68d231f55e691c5ea3845d5aaa824fe28b7caec4 --force-share --output=json" returned: 0 in 0.221s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Acquiring lock "68d231f55e691c5ea3845d5aaa824fe28b7caec4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:55:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "68d231f55e691c5ea3845d5aaa824fe28b7caec4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:55:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68d231f55e691c5ea3845d5aaa824fe28b7caec4 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.network.neutron [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Successfully updated port: 3c47a327-42ad-484a-8cf8-33e131233bcd {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Acquiring lock "refresh_cache-1b45635b-062b-4149-8789-9f5191132cbd" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Acquired lock "refresh_cache-1b45635b-062b-4149-8789-9f5191132cbd" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.network.neutron [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68d231f55e691c5ea3845d5aaa824fe28b7caec4 --force-share --output=json" returned: 0 in 0.221s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68d231f55e691c5ea3845d5aaa824fe28b7caec4,backing_fmt=raw /opt/stack/data/nova/instances/1b45635b-062b-4149-8789-9f5191132cbd/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68d231f55e691c5ea3845d5aaa824fe28b7caec4,backing_fmt=raw /opt/stack/data/nova/instances/1b45635b-062b-4149-8789-9f5191132cbd/disk 1073741824" returned: 0 in 0.068s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "68d231f55e691c5ea3845d5aaa824fe28b7caec4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68d231f55e691c5ea3845d5aaa824fe28b7caec4 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.network.neutron [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-3120a597-68a9-425c-a589-5e27c357fe4f tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-3120a597-68a9-425c-a589-5e27c357fe4f tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3120a597-68a9-425c-a589-5e27c357fe4f tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.583s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:55:10 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-3120a597-68a9-425c-a589-5e27c357fe4f tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Deleted allocations for instance e7ac6a94-05a2-4b11-a541-26b1d1dae070
Aug 26 08:55:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68d231f55e691c5ea3845d5aaa824fe28b7caec4 --force-share --output=json" returned: 0 in 0.188s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Ensure instance console log exists: /opt/stack/data/nova/instances/1b45635b-062b-4149-8789-9f5191132cbd/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3120a597-68a9-425c-a589-5e27c357fe4f tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "e7ac6a94-05a2-4b11-a541-26b1d1dae070" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.083s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Updating instance_info_cache with network_info: [{"id": "3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96", "address": "fa:16:3e:c0:56:86", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3913bdf7-1f", "ovs_interfaceid": "3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-b5e1f82c-5675-4c37-8ba2-44e6a341a576" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.network.neutron [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Updating instance_info_cache with network_info: [{"id": "3c47a327-42ad-484a-8cf8-33e131233bcd", "address": "fa:16:3e:0a:fc:e5", "network": {"id": "bb0ed7b6-f1d2-41e5-b975-926555200ac9", "bridge": "br-int", "label": "tempest-TestStampPattern-89239905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f8b4744aa5450ca396714b74a01049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c47a327-42", "ovs_interfaceid": "3c47a327-42ad-484a-8cf8-33e131233bcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Releasing lock "refresh_cache-1b45635b-062b-4149-8789-9f5191132cbd" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.compute.manager [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Instance network_info: |[{"id": "3c47a327-42ad-484a-8cf8-33e131233bcd", "address": "fa:16:3e:0a:fc:e5", "network": {"id": "bb0ed7b6-f1d2-41e5-b975-926555200ac9", "bridge": "br-int", "label": "tempest-TestStampPattern-89239905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f8b4744aa5450ca396714b74a01049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c47a327-42", "ovs_interfaceid": "3c47a327-42ad-484a-8cf8-33e131233bcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Start _get_guest_xml network_info=[{"id": "3c47a327-42ad-484a-8cf8-33e131233bcd", "address": "fa:16:3e:0a:fc:e5", "network": {"id": "bb0ed7b6-f1d2-41e5-b975-926555200ac9", "bridge": "br-int", "label": "tempest-TestStampPattern-89239905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f8b4744aa5450ca396714b74a01049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c47a327-42", "ovs_interfaceid": "3c47a327-42ad-484a-8cf8-33e131233bcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='4441a20737082f6086b37df670b1778d',container_format='bare',created_at=2023-08-26T08:54:57Z,direct_url=<?>,disk_format='qcow2',id=68910971-ab50-4eeb-8296-e6f5bd45dea6,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1084292132',owner='b4f8b4744aa5450ca396714b74a01049',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T08:55:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '68910971-ab50-4eeb-8296-e6f5bd45dea6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:55:10 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:55:10 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='4441a20737082f6086b37df670b1778d',container_format='bare',created_at=2023-08-26T08:54:57Z,direct_url=<?>,disk_format='qcow2',id=68910971-ab50-4eeb-8296-e6f5bd45dea6,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1084292132',owner='b4f8b4744aa5450ca396714b74a01049',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T08:55:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:55:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1006978630',display_name='tempest-TestStampPattern-server-1006978630',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1006978630',id=33,image_ref='68910971-ab50-4eeb-8296-e6f5bd45dea6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8q5d7Z9/2Nnhi0JZhZxh3ataNnlHeSdFDCIuYvXZBV7m47ag+i9lJBSd6jnykjIfpVABlmqnqwhluVSlzPsJtT5zAJjK/bV+KbeeT0wsKSGG3sFgDqmXkgbk2fMo0ekA==',key_name='tempest-TestStampPattern-1398766845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4f8b4744aa5450ca396714b74a01049',ramdisk_id='',reservation_id='r-zfd9a83l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='945acd46-42e2-4c45-b8e5-9ea94703bc66',image_min_disk='1',image_min_ram='0',image_owner_id='b4f8b4744aa5450ca396714b74a01049',image_owner_project_name='tempest-TestStampPattern-1989133217',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1989133217-project-member',image_user_id='dea79c0b1d874d27b63d7e5418d12505',network_allocated='True',owner_project_name='tempest-TestStampPattern-1989133217',owner_user_name='tempest-TestStampPattern-1989133217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:55:07Z,user_data=None,user_id='dea79c0b1d874d27b63d7e5418d12505',uuid=1b45635b-062b-4149-8789-9f5191132cbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c47a327-42ad-484a-8cf8-33e131233bcd", "address": "fa:16:3e:0a:fc:e5", "network": {"id": "bb0ed7b6-f1d2-41e5-b975-926555200ac9", "bridge": "br-int", "label": "tempest-TestStampPattern-89239905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f8b4744aa5450ca396714b74a01049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c47a327-42", "ovs_interfaceid": "3c47a327-42ad-484a-8cf8-33e131233bcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Converting VIF {"id": "3c47a327-42ad-484a-8cf8-33e131233bcd", "address": "fa:16:3e:0a:fc:e5", "network": {"id": "bb0ed7b6-f1d2-41e5-b975-926555200ac9", "bridge": "br-int", "label": "tempest-TestStampPattern-89239905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f8b4744aa5450ca396714b74a01049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c47a327-42", "ovs_interfaceid": "3c47a327-42ad-484a-8cf8-33e131233bcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fc:e5,bridge_name='br-int',has_traffic_filtering=True,id=3c47a327-42ad-484a-8cf8-33e131233bcd,network=Network(bb0ed7b6-f1d2-41e5-b975-926555200ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c47a327-42') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.objects.instance [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b45635b-062b-4149-8789-9f5191132cbd {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:55:10 user nova-compute[73104]:   <uuid>1b45635b-062b-4149-8789-9f5191132cbd</uuid>
Aug 26 08:55:10 user nova-compute[73104]:   <name>instance-00000021</name>
Aug 26 08:55:10 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:55:10 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:55:10 user nova-compute[73104]:   <metadata>
Aug 26 08:55:10 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:55:10 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:55:10 user nova-compute[73104]:       <nova:name>tempest-TestStampPattern-server-1006978630</nova:name>
Aug 26 08:55:10 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:55:10</nova:creationTime>
Aug 26 08:55:10 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:55:10 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:55:10 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:55:10 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:55:10 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:55:10 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:55:10 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:55:10 user nova-compute[73104]:       <nova:owner>
Aug 26 08:55:10 user nova-compute[73104]:         <nova:user uuid="dea79c0b1d874d27b63d7e5418d12505">tempest-TestStampPattern-1989133217-project-member</nova:user>
Aug 26 08:55:10 user nova-compute[73104]:         <nova:project uuid="b4f8b4744aa5450ca396714b74a01049">tempest-TestStampPattern-1989133217</nova:project>
Aug 26 08:55:10 user nova-compute[73104]:       </nova:owner>
Aug 26 08:55:10 user nova-compute[73104]:       <nova:root type="image" uuid="68910971-ab50-4eeb-8296-e6f5bd45dea6"/>
Aug 26 08:55:10 user nova-compute[73104]:       <nova:ports>
Aug 26 08:55:10 user nova-compute[73104]:         <nova:port uuid="3c47a327-42ad-484a-8cf8-33e131233bcd">
Aug 26 08:55:10 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 08:55:10 user nova-compute[73104]:         </nova:port>
Aug 26 08:55:10 user nova-compute[73104]:       </nova:ports>
Aug 26 08:55:10 user nova-compute[73104]:     </nova:instance>
Aug 26 08:55:10 user nova-compute[73104]:   </metadata>
Aug 26 08:55:10 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:55:10 user nova-compute[73104]:     <system>
Aug 26 08:55:10 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:55:10 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:55:10 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:55:10 user nova-compute[73104]:       <entry name="serial">1b45635b-062b-4149-8789-9f5191132cbd</entry>
Aug 26 08:55:10 user nova-compute[73104]:       <entry name="uuid">1b45635b-062b-4149-8789-9f5191132cbd</entry>
Aug 26 08:55:10 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:55:10 user nova-compute[73104]:     </system>
Aug 26 08:55:10 user nova-compute[73104]:   </sysinfo>
Aug 26 08:55:10 user nova-compute[73104]:   <os>
Aug 26 08:55:10 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:55:10 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:55:10 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:55:10 user nova-compute[73104]:   </os>
Aug 26 08:55:10 user nova-compute[73104]:   <features>
Aug 26 08:55:10 user nova-compute[73104]:     <acpi/>
Aug 26 08:55:10 user nova-compute[73104]:     <apic/>
Aug 26 08:55:10 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:55:10 user nova-compute[73104]:   </features>
Aug 26 08:55:10 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:55:10 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:55:10 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:55:10 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:55:10 user nova-compute[73104]:   </clock>
Aug 26 08:55:10 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:55:10 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:55:10 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:55:10 user nova-compute[73104]:   </cpu>
Aug 26 08:55:10 user nova-compute[73104]:   <devices>
Aug 26 08:55:10 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:55:10 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:55:10 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/1b45635b-062b-4149-8789-9f5191132cbd/disk"/>
Aug 26 08:55:10 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:55:10 user nova-compute[73104]:     </disk>
Aug 26 08:55:10 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:55:10 user nova-compute[73104]:       <mac address="fa:16:3e:0a:fc:e5"/>
Aug 26 08:55:10 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:55:10 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:55:10 user nova-compute[73104]:       <target dev="tap3c47a327-42"/>
Aug 26 08:55:10 user nova-compute[73104]:     </interface>
Aug 26 08:55:10 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:55:10 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/1b45635b-062b-4149-8789-9f5191132cbd/console.log" append="off"/>
Aug 26 08:55:10 user nova-compute[73104]:     </serial>
Aug 26 08:55:10 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:55:10 user nova-compute[73104]:     <video>
Aug 26 08:55:10 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:55:10 user nova-compute[73104]:     </video>
Aug 26 08:55:10 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:55:10 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:55:10 user nova-compute[73104]:     </rng>
Aug 26 08:55:10 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:55:10 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:55:10 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:55:10 user nova-compute[73104]:     </memballoon>
Aug 26 08:55:10 user nova-compute[73104]:   </devices>
Aug 26 08:55:10 user nova-compute[73104]: </domain>
Aug 26 08:55:10 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:55:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1006978630',display_name='tempest-TestStampPattern-server-1006978630',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1006978630',id=33,image_ref='68910971-ab50-4eeb-8296-e6f5bd45dea6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8q5d7Z9/2Nnhi0JZhZxh3ataNnlHeSdFDCIuYvXZBV7m47ag+i9lJBSd6jnykjIfpVABlmqnqwhluVSlzPsJtT5zAJjK/bV+KbeeT0wsKSGG3sFgDqmXkgbk2fMo0ekA==',key_name='tempest-TestStampPattern-1398766845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4f8b4744aa5450ca396714b74a01049',ramdisk_id='',reservation_id='r-zfd9a83l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='945acd46-42e2-4c45-b8e5-9ea94703bc66',image_min_disk='1',image_min_ram='0',image_owner_id='b4f8b4744aa5450ca396714b74a01049',image_owner_project_name='tempest-TestStampPattern-1989133217',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1989133217-project-member',image_user_id='dea79c0b1d874d27b63d7e5418d12505',network_allocated='True',owner_project_name='tempest-TestStampPattern-1989133217',owner_user_name='tempest-TestStampPattern-1989133217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:55:07Z,user_data=None,user_id='dea79c0b1d874d27b63d7e5418d12505',uuid=1b45635b-062b-4149-8789-9f5191132cbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c47a327-42ad-484a-8cf8-33e131233bcd", "address": "fa:16:3e:0a:fc:e5", "network": {"id": "bb0ed7b6-f1d2-41e5-b975-926555200ac9", "bridge": "br-int", "label": "tempest-TestStampPattern-89239905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f8b4744aa5450ca396714b74a01049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c47a327-42", "ovs_interfaceid": "3c47a327-42ad-484a-8cf8-33e131233bcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Converting VIF {"id": "3c47a327-42ad-484a-8cf8-33e131233bcd", "address": "fa:16:3e:0a:fc:e5", "network": {"id": "bb0ed7b6-f1d2-41e5-b975-926555200ac9", "bridge": "br-int", "label": "tempest-TestStampPattern-89239905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f8b4744aa5450ca396714b74a01049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c47a327-42", "ovs_interfaceid": "3c47a327-42ad-484a-8cf8-33e131233bcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fc:e5,bridge_name='br-int',has_traffic_filtering=True,id=3c47a327-42ad-484a-8cf8-33e131233bcd,network=Network(bb0ed7b6-f1d2-41e5-b975-926555200ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c47a327-42') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG os_vif [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fc:e5,bridge_name='br-int',has_traffic_filtering=True,id=3c47a327-42ad-484a-8cf8-33e131233bcd,network=Network(bb0ed7b6-f1d2-41e5-b975-926555200ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c47a327-42') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c47a327-42, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3c47a327-42, col_values=(('external_ids', {'iface-id': '3c47a327-42ad-484a-8cf8-33e131233bcd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:fc:e5', 'vm-uuid': '1b45635b-062b-4149-8789-9f5191132cbd'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:10 user nova-compute[73104]: INFO os_vif [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fc:e5,bridge_name='br-int',has_traffic_filtering=True,id=3c47a327-42ad-484a-8cf8-33e131233bcd,network=Network(bb0ed7b6-f1d2-41e5-b975-926555200ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c47a327-42')
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:55:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] No VIF found with MAC fa:16:3e:0a:fc:e5, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:55:11 user nova-compute[73104]: DEBUG nova.compute.manager [req-e5bdf6c9-6ba5-4957-998f-a4ed7badbe6c req-e740d708-dcc7-4f63-a49d-c650346f0374 service nova] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Received event network-changed-3c47a327-42ad-484a-8cf8-33e131233bcd {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:55:11 user nova-compute[73104]: DEBUG nova.compute.manager [req-e5bdf6c9-6ba5-4957-998f-a4ed7badbe6c req-e740d708-dcc7-4f63-a49d-c650346f0374 service nova] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Refreshing instance network info cache due to event network-changed-3c47a327-42ad-484a-8cf8-33e131233bcd. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:55:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e5bdf6c9-6ba5-4957-998f-a4ed7badbe6c req-e740d708-dcc7-4f63-a49d-c650346f0374 service nova] Acquiring lock "refresh_cache-1b45635b-062b-4149-8789-9f5191132cbd" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:55:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e5bdf6c9-6ba5-4957-998f-a4ed7badbe6c req-e740d708-dcc7-4f63-a49d-c650346f0374 service nova] Acquired lock "refresh_cache-1b45635b-062b-4149-8789-9f5191132cbd" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:55:11 user nova-compute[73104]: DEBUG nova.network.neutron [req-e5bdf6c9-6ba5-4957-998f-a4ed7badbe6c req-e740d708-dcc7-4f63-a49d-c650346f0374 service nova] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Refreshing network info cache for port 3c47a327-42ad-484a-8cf8-33e131233bcd {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:55:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:12 user nova-compute[73104]: DEBUG nova.network.neutron [req-e5bdf6c9-6ba5-4957-998f-a4ed7badbe6c req-e740d708-dcc7-4f63-a49d-c650346f0374 service nova] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Updated VIF entry in instance network info cache for port 3c47a327-42ad-484a-8cf8-33e131233bcd. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:55:12 user nova-compute[73104]: DEBUG nova.network.neutron [req-e5bdf6c9-6ba5-4957-998f-a4ed7badbe6c req-e740d708-dcc7-4f63-a49d-c650346f0374 service nova] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Updating instance_info_cache with network_info: [{"id": "3c47a327-42ad-484a-8cf8-33e131233bcd", "address": "fa:16:3e:0a:fc:e5", "network": {"id": "bb0ed7b6-f1d2-41e5-b975-926555200ac9", "bridge": "br-int", "label": "tempest-TestStampPattern-89239905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f8b4744aa5450ca396714b74a01049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c47a327-42", "ovs_interfaceid": "3c47a327-42ad-484a-8cf8-33e131233bcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:55:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e5bdf6c9-6ba5-4957-998f-a4ed7badbe6c req-e740d708-dcc7-4f63-a49d-c650346f0374 service nova] Releasing lock "refresh_cache-1b45635b-062b-4149-8789-9f5191132cbd" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:55:14 user nova-compute[73104]: DEBUG nova.compute.manager [req-1d899e57-36cf-4f95-a483-01c6cae78d0c req-22f3e653-4063-4206-8094-18442153a954 service nova] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Received event network-vif-plugged-3c47a327-42ad-484a-8cf8-33e131233bcd {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:55:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1d899e57-36cf-4f95-a483-01c6cae78d0c req-22f3e653-4063-4206-8094-18442153a954 service nova] Acquiring lock "1b45635b-062b-4149-8789-9f5191132cbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:55:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1d899e57-36cf-4f95-a483-01c6cae78d0c req-22f3e653-4063-4206-8094-18442153a954 service nova] Lock "1b45635b-062b-4149-8789-9f5191132cbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:55:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1d899e57-36cf-4f95-a483-01c6cae78d0c req-22f3e653-4063-4206-8094-18442153a954 service nova] Lock "1b45635b-062b-4149-8789-9f5191132cbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:55:14 user nova-compute[73104]: DEBUG nova.compute.manager [req-1d899e57-36cf-4f95-a483-01c6cae78d0c req-22f3e653-4063-4206-8094-18442153a954 service nova] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] No waiting events found dispatching network-vif-plugged-3c47a327-42ad-484a-8cf8-33e131233bcd {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:55:14 user nova-compute[73104]: WARNING nova.compute.manager [req-1d899e57-36cf-4f95-a483-01c6cae78d0c req-22f3e653-4063-4206-8094-18442153a954 service nova] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Received unexpected event network-vif-plugged-3c47a327-42ad-484a-8cf8-33e131233bcd for instance with vm_state building and task_state spawning.
Aug 26 08:55:14 user nova-compute[73104]: DEBUG nova.compute.manager [req-1d899e57-36cf-4f95-a483-01c6cae78d0c req-22f3e653-4063-4206-8094-18442153a954 service nova] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Received event network-vif-plugged-3c47a327-42ad-484a-8cf8-33e131233bcd {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:55:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1d899e57-36cf-4f95-a483-01c6cae78d0c req-22f3e653-4063-4206-8094-18442153a954 service nova] Acquiring lock "1b45635b-062b-4149-8789-9f5191132cbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:55:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1d899e57-36cf-4f95-a483-01c6cae78d0c req-22f3e653-4063-4206-8094-18442153a954 service nova] Lock "1b45635b-062b-4149-8789-9f5191132cbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:55:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1d899e57-36cf-4f95-a483-01c6cae78d0c req-22f3e653-4063-4206-8094-18442153a954 service nova] Lock "1b45635b-062b-4149-8789-9f5191132cbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:55:14 user nova-compute[73104]: DEBUG nova.compute.manager [req-1d899e57-36cf-4f95-a483-01c6cae78d0c req-22f3e653-4063-4206-8094-18442153a954 service nova] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] No waiting events found dispatching network-vif-plugged-3c47a327-42ad-484a-8cf8-33e131233bcd {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:55:14 user nova-compute[73104]: WARNING nova.compute.manager [req-1d899e57-36cf-4f95-a483-01c6cae78d0c req-22f3e653-4063-4206-8094-18442153a954 service nova] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Received unexpected event network-vif-plugged-3c47a327-42ad-484a-8cf8-33e131233bcd for instance with vm_state building and task_state spawning.
Aug 26 08:55:14 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040114.2671032, 1b45635b-062b-4149-8789-9f5191132cbd => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:55:14 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] VM Resumed (Lifecycle Event)
Aug 26 08:55:14 user nova-compute[73104]: DEBUG nova.compute.manager [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:55:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:55:14 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Instance spawned successfully.
Aug 26 08:55:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:55:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:55:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:55:14 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:55:14 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:55:14 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:55:14 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040114.2704852, 1b45635b-062b-4149-8789-9f5191132cbd => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:55:14 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] VM Started (Lifecycle Event)
Aug 26 08:55:14 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:55:14 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:55:14 user nova-compute[73104]: INFO nova.compute.manager [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Took 6.82 seconds to spawn the instance on the hypervisor.
Aug 26 08:55:14 user nova-compute[73104]: DEBUG nova.compute.manager [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:55:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:14 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:55:14 user nova-compute[73104]: INFO nova.compute.manager [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Took 8.21 seconds to build instance.
Aug 26 08:55:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9a7d747f-6a0c-4549-9758-f1c3d284c3f5 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "1b45635b-062b-4149-8789-9f5191132cbd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.329s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:55:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:55:23 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693040108.1487615, e7ac6a94-05a2-4b11-a541-26b1d1dae070 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:55:23 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] VM Stopped (Lifecycle Event)
Aug 26 08:55:23 user nova-compute[73104]: DEBUG nova.compute.manager [None req-04518ee2-3ac8-439e-944f-cc1ee2fa9171 None None] [instance: e7ac6a94-05a2-4b11-a541-26b1d1dae070] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:55:25 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:55:25 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:25 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 08:55:25 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 08:55:25 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 08:55:25 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Acquiring lock "67c5d379-7e2a-415b-a0a5-530afec0b1ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:55:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Lock "67c5d379-7e2a-415b-a0a5-530afec0b1ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:55:27 user nova-compute[73104]: DEBUG nova.compute.manager [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:55:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:55:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:55:27 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:55:27 user nova-compute[73104]: INFO nova.compute.claims [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Claim successful on node user
Aug 26 08:55:27 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:55:27 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:55:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:55:27 user nova-compute[73104]: DEBUG nova.compute.manager [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:55:27 user nova-compute[73104]: DEBUG nova.compute.manager [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:55:27 user nova-compute[73104]: DEBUG nova.network.neutron [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:55:27 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:55:27 user nova-compute[73104]: DEBUG nova.compute.manager [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:55:27 user nova-compute[73104]: DEBUG nova.compute.manager [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:55:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:55:27 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Creating image(s)
Aug 26 08:55:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Acquiring lock "/opt/stack/data/nova/instances/67c5d379-7e2a-415b-a0a5-530afec0b1ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:55:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Lock "/opt/stack/data/nova/instances/67c5d379-7e2a-415b-a0a5-530afec0b1ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:55:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Lock "/opt/stack/data/nova/instances/67c5d379-7e2a-415b-a0a5-530afec0b1ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:55:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:27 user nova-compute[73104]: DEBUG nova.policy [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec87ee15022146bcaaad23e2196d21aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf19366c85c84b958e80d3dd3f7ad885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:55:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.188s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:55:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:55:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.188s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/67c5d379-7e2a-415b-a0a5-530afec0b1ea/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/67c5d379-7e2a-415b-a0a5-530afec0b1ea/disk 1073741824" returned: 0 in 0.054s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:55:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.191s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:28 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Checking if we can resize image /opt/stack/data/nova/instances/67c5d379-7e2a-415b-a0a5-530afec0b1ea/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 08:55:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5d379-7e2a-415b-a0a5-530afec0b1ea/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:28 user nova-compute[73104]: DEBUG nova.network.neutron [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Successfully created port: 1d3ab149-29a3-4045-934c-4930ed714adc {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:55:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5d379-7e2a-415b-a0a5-530afec0b1ea/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:28 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Cannot resize image /opt/stack/data/nova/instances/67c5d379-7e2a-415b-a0a5-530afec0b1ea/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 08:55:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:55:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Ensure instance console log exists: /opt/stack/data/nova/instances/67c5d379-7e2a-415b-a0a5-530afec0b1ea/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:55:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:55:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:55:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.network.neutron [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Successfully updated port: 1d3ab149-29a3-4045-934c-4930ed714adc {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Acquiring lock "refresh_cache-67c5d379-7e2a-415b-a0a5-530afec0b1ea" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Acquired lock "refresh_cache-67c5d379-7e2a-415b-a0a5-530afec0b1ea" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.network.neutron [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.compute.manager [req-2d93d8d6-3609-4f6e-a53f-7dd4655b89d7 req-74ca74f4-4bb8-4089-bf7c-d24d9f0382f1 service nova] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Received event network-changed-1d3ab149-29a3-4045-934c-4930ed714adc {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.compute.manager [req-2d93d8d6-3609-4f6e-a53f-7dd4655b89d7 req-74ca74f4-4bb8-4089-bf7c-d24d9f0382f1 service nova] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Refreshing instance network info cache due to event network-changed-1d3ab149-29a3-4045-934c-4930ed714adc. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2d93d8d6-3609-4f6e-a53f-7dd4655b89d7 req-74ca74f4-4bb8-4089-bf7c-d24d9f0382f1 service nova] Acquiring lock "refresh_cache-67c5d379-7e2a-415b-a0a5-530afec0b1ea" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.network.neutron [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.network.neutron [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Updating instance_info_cache with network_info: [{"id": "1d3ab149-29a3-4045-934c-4930ed714adc", "address": "fa:16:3e:22:52:e6", "network": {"id": "3668555c-8072-4c8c-8617-bdbcc4cc7f8b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "549d3fed307c4f4c84128afef97a358e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3ab149-29", "ovs_interfaceid": "1d3ab149-29a3-4045-934c-4930ed714adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Releasing lock "refresh_cache-67c5d379-7e2a-415b-a0a5-530afec0b1ea" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.compute.manager [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Instance network_info: |[{"id": "1d3ab149-29a3-4045-934c-4930ed714adc", "address": "fa:16:3e:22:52:e6", "network": {"id": "3668555c-8072-4c8c-8617-bdbcc4cc7f8b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "549d3fed307c4f4c84128afef97a358e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3ab149-29", "ovs_interfaceid": "1d3ab149-29a3-4045-934c-4930ed714adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2d93d8d6-3609-4f6e-a53f-7dd4655b89d7 req-74ca74f4-4bb8-4089-bf7c-d24d9f0382f1 service nova] Acquired lock "refresh_cache-67c5d379-7e2a-415b-a0a5-530afec0b1ea" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.network.neutron [req-2d93d8d6-3609-4f6e-a53f-7dd4655b89d7 req-74ca74f4-4bb8-4089-bf7c-d24d9f0382f1 service nova] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Refreshing network info cache for port 1d3ab149-29a3-4045-934c-4930ed714adc {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Start _get_guest_xml network_info=[{"id": "1d3ab149-29a3-4045-934c-4930ed714adc", "address": "fa:16:3e:22:52:e6", "network": {"id": "3668555c-8072-4c8c-8617-bdbcc4cc7f8b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "549d3fed307c4f4c84128afef97a358e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3ab149-29", "ovs_interfaceid": "1d3ab149-29a3-4045-934c-4930ed714adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:55:29 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:55:29 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:55:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-334998335',display_name='tempest-VolumesNegativeTest-instance-334998335',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-334998335',id=34,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf19366c85c84b958e80d3dd3f7ad885',ramdisk_id='',reservation_id='r-1kvzay1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-30423543',owner_user_name='tempest-VolumesNegativeTest-30423543-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:55:28Z,user_data=None,user_id='ec87ee15022146bcaaad23e2196d21aa',uuid=67c5d379-7e2a-415b-a0a5-530afec0b1ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d3ab149-29a3-4045-934c-4930ed714adc", "address": "fa:16:3e:22:52:e6", "network": {"id": "3668555c-8072-4c8c-8617-bdbcc4cc7f8b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "549d3fed307c4f4c84128afef97a358e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3ab149-29", "ovs_interfaceid": "1d3ab149-29a3-4045-934c-4930ed714adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Converting VIF {"id": "1d3ab149-29a3-4045-934c-4930ed714adc", "address": "fa:16:3e:22:52:e6", "network": {"id": "3668555c-8072-4c8c-8617-bdbcc4cc7f8b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "549d3fed307c4f4c84128afef97a358e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3ab149-29", "ovs_interfaceid": "1d3ab149-29a3-4045-934c-4930ed714adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:52:e6,bridge_name='br-int',has_traffic_filtering=True,id=1d3ab149-29a3-4045-934c-4930ed714adc,network=Network(3668555c-8072-4c8c-8617-bdbcc4cc7f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d3ab149-29') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.objects.instance [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Lazy-loading 'pci_devices' on Instance uuid 67c5d379-7e2a-415b-a0a5-530afec0b1ea {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:55:29 user nova-compute[73104]:   <uuid>67c5d379-7e2a-415b-a0a5-530afec0b1ea</uuid>
Aug 26 08:55:29 user nova-compute[73104]:   <name>instance-00000022</name>
Aug 26 08:55:29 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:55:29 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:55:29 user nova-compute[73104]:   <metadata>
Aug 26 08:55:29 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:55:29 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:55:29 user nova-compute[73104]:       <nova:name>tempest-VolumesNegativeTest-instance-334998335</nova:name>
Aug 26 08:55:29 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:55:29</nova:creationTime>
Aug 26 08:55:29 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:55:29 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:55:29 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:55:29 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:55:29 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:55:29 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:55:29 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:55:29 user nova-compute[73104]:       <nova:owner>
Aug 26 08:55:29 user nova-compute[73104]:         <nova:user uuid="ec87ee15022146bcaaad23e2196d21aa">tempest-VolumesNegativeTest-30423543-project-member</nova:user>
Aug 26 08:55:29 user nova-compute[73104]:         <nova:project uuid="cf19366c85c84b958e80d3dd3f7ad885">tempest-VolumesNegativeTest-30423543</nova:project>
Aug 26 08:55:29 user nova-compute[73104]:       </nova:owner>
Aug 26 08:55:29 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:55:29 user nova-compute[73104]:       <nova:ports>
Aug 26 08:55:29 user nova-compute[73104]:         <nova:port uuid="1d3ab149-29a3-4045-934c-4930ed714adc">
Aug 26 08:55:29 user nova-compute[73104]:           <nova:ip type="fixed" address="192.168.233.144" ipVersion="4"/>
Aug 26 08:55:29 user nova-compute[73104]:         </nova:port>
Aug 26 08:55:29 user nova-compute[73104]:       </nova:ports>
Aug 26 08:55:29 user nova-compute[73104]:     </nova:instance>
Aug 26 08:55:29 user nova-compute[73104]:   </metadata>
Aug 26 08:55:29 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:55:29 user nova-compute[73104]:     <system>
Aug 26 08:55:29 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:55:29 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:55:29 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:55:29 user nova-compute[73104]:       <entry name="serial">67c5d379-7e2a-415b-a0a5-530afec0b1ea</entry>
Aug 26 08:55:29 user nova-compute[73104]:       <entry name="uuid">67c5d379-7e2a-415b-a0a5-530afec0b1ea</entry>
Aug 26 08:55:29 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:55:29 user nova-compute[73104]:     </system>
Aug 26 08:55:29 user nova-compute[73104]:   </sysinfo>
Aug 26 08:55:29 user nova-compute[73104]:   <os>
Aug 26 08:55:29 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:55:29 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:55:29 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:55:29 user nova-compute[73104]:   </os>
Aug 26 08:55:29 user nova-compute[73104]:   <features>
Aug 26 08:55:29 user nova-compute[73104]:     <acpi/>
Aug 26 08:55:29 user nova-compute[73104]:     <apic/>
Aug 26 08:55:29 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:55:29 user nova-compute[73104]:   </features>
Aug 26 08:55:29 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:55:29 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:55:29 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:55:29 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:55:29 user nova-compute[73104]:   </clock>
Aug 26 08:55:29 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:55:29 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:55:29 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:55:29 user nova-compute[73104]:   </cpu>
Aug 26 08:55:29 user nova-compute[73104]:   <devices>
Aug 26 08:55:29 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:55:29 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:55:29 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/67c5d379-7e2a-415b-a0a5-530afec0b1ea/disk"/>
Aug 26 08:55:29 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:55:29 user nova-compute[73104]:     </disk>
Aug 26 08:55:29 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:55:29 user nova-compute[73104]:       <mac address="fa:16:3e:22:52:e6"/>
Aug 26 08:55:29 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:55:29 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:55:29 user nova-compute[73104]:       <target dev="tap1d3ab149-29"/>
Aug 26 08:55:29 user nova-compute[73104]:     </interface>
Aug 26 08:55:29 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:55:29 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/67c5d379-7e2a-415b-a0a5-530afec0b1ea/console.log" append="off"/>
Aug 26 08:55:29 user nova-compute[73104]:     </serial>
Aug 26 08:55:29 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:55:29 user nova-compute[73104]:     <video>
Aug 26 08:55:29 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:55:29 user nova-compute[73104]:     </video>
Aug 26 08:55:29 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:55:29 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:55:29 user nova-compute[73104]:     </rng>
Aug 26 08:55:29 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:55:29 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:55:29 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:55:29 user nova-compute[73104]:     </memballoon>
Aug 26 08:55:29 user nova-compute[73104]:   </devices>
Aug 26 08:55:29 user nova-compute[73104]: </domain>
Aug 26 08:55:29 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:55:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-334998335',display_name='tempest-VolumesNegativeTest-instance-334998335',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-334998335',id=34,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf19366c85c84b958e80d3dd3f7ad885',ramdisk_id='',reservation_id='r-1kvzay1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-30423543',owner_user_name='tempest-VolumesNegativeTest-30423543-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:55:28Z,user_data=None,user_id='ec87ee15022146bcaaad23e2196d21aa',uuid=67c5d379-7e2a-415b-a0a5-530afec0b1ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d3ab149-29a3-4045-934c-4930ed714adc", "address": "fa:16:3e:22:52:e6", "network": {"id": "3668555c-8072-4c8c-8617-bdbcc4cc7f8b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "549d3fed307c4f4c84128afef97a358e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3ab149-29", "ovs_interfaceid": "1d3ab149-29a3-4045-934c-4930ed714adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Converting VIF {"id": "1d3ab149-29a3-4045-934c-4930ed714adc", "address": "fa:16:3e:22:52:e6", "network": {"id": "3668555c-8072-4c8c-8617-bdbcc4cc7f8b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "549d3fed307c4f4c84128afef97a358e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3ab149-29", "ovs_interfaceid": "1d3ab149-29a3-4045-934c-4930ed714adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:52:e6,bridge_name='br-int',has_traffic_filtering=True,id=1d3ab149-29a3-4045-934c-4930ed714adc,network=Network(3668555c-8072-4c8c-8617-bdbcc4cc7f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d3ab149-29') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG os_vif [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:52:e6,bridge_name='br-int',has_traffic_filtering=True,id=1d3ab149-29a3-4045-934c-4930ed714adc,network=Network(3668555c-8072-4c8c-8617-bdbcc4cc7f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d3ab149-29') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d3ab149-29, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1d3ab149-29, col_values=(('external_ids', {'iface-id': '1d3ab149-29a3-4045-934c-4930ed714adc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:52:e6', 'vm-uuid': '67c5d379-7e2a-415b-a0a5-530afec0b1ea'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:29 user nova-compute[73104]: INFO os_vif [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:52:e6,bridge_name='br-int',has_traffic_filtering=True,id=1d3ab149-29a3-4045-934c-4930ed714adc,network=Network(3668555c-8072-4c8c-8617-bdbcc4cc7f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d3ab149-29')
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:55:29 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] No VIF found with MAC fa:16:3e:22:52:e6, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:55:30 user nova-compute[73104]: DEBUG nova.network.neutron [req-2d93d8d6-3609-4f6e-a53f-7dd4655b89d7 req-74ca74f4-4bb8-4089-bf7c-d24d9f0382f1 service nova] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Updated VIF entry in instance network info cache for port 1d3ab149-29a3-4045-934c-4930ed714adc. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:55:30 user nova-compute[73104]: DEBUG nova.network.neutron [req-2d93d8d6-3609-4f6e-a53f-7dd4655b89d7 req-74ca74f4-4bb8-4089-bf7c-d24d9f0382f1 service nova] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Updating instance_info_cache with network_info: [{"id": "1d3ab149-29a3-4045-934c-4930ed714adc", "address": "fa:16:3e:22:52:e6", "network": {"id": "3668555c-8072-4c8c-8617-bdbcc4cc7f8b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "549d3fed307c4f4c84128afef97a358e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3ab149-29", "ovs_interfaceid": "1d3ab149-29a3-4045-934c-4930ed714adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:55:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2d93d8d6-3609-4f6e-a53f-7dd4655b89d7 req-74ca74f4-4bb8-4089-bf7c-d24d9f0382f1 service nova] Releasing lock "refresh_cache-67c5d379-7e2a-415b-a0a5-530afec0b1ea" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:55:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:31 user nova-compute[73104]: DEBUG nova.compute.manager [req-e95bde4f-2c29-4316-8e8a-410f131757b5 req-fec121a7-d5ad-4aa2-90db-92d82b842620 service nova] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Received event network-vif-plugged-1d3ab149-29a3-4045-934c-4930ed714adc {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:55:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e95bde4f-2c29-4316-8e8a-410f131757b5 req-fec121a7-d5ad-4aa2-90db-92d82b842620 service nova] Acquiring lock "67c5d379-7e2a-415b-a0a5-530afec0b1ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:55:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e95bde4f-2c29-4316-8e8a-410f131757b5 req-fec121a7-d5ad-4aa2-90db-92d82b842620 service nova] Lock "67c5d379-7e2a-415b-a0a5-530afec0b1ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:55:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e95bde4f-2c29-4316-8e8a-410f131757b5 req-fec121a7-d5ad-4aa2-90db-92d82b842620 service nova] Lock "67c5d379-7e2a-415b-a0a5-530afec0b1ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:55:31 user nova-compute[73104]: DEBUG nova.compute.manager [req-e95bde4f-2c29-4316-8e8a-410f131757b5 req-fec121a7-d5ad-4aa2-90db-92d82b842620 service nova] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] No waiting events found dispatching network-vif-plugged-1d3ab149-29a3-4045-934c-4930ed714adc {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:55:31 user nova-compute[73104]: WARNING nova.compute.manager [req-e95bde4f-2c29-4316-8e8a-410f131757b5 req-fec121a7-d5ad-4aa2-90db-92d82b842620 service nova] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Received unexpected event network-vif-plugged-1d3ab149-29a3-4045-934c-4930ed714adc for instance with vm_state building and task_state spawning.
Aug 26 08:55:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "0e3fb03a-d317-4eed-ad52-d066242a13e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:55:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "0e3fb03a-d317-4eed-ad52-d066242a13e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:55:32 user nova-compute[73104]: DEBUG nova.compute.manager [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:55:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:55:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:55:32 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:55:32 user nova-compute[73104]: INFO nova.compute.claims [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Claim successful on node user
Aug 26 08:55:32 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:55:32 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:55:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:55:33 user nova-compute[73104]: DEBUG nova.compute.manager [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:55:33 user nova-compute[73104]: DEBUG nova.compute.manager [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:55:33 user nova-compute[73104]: DEBUG nova.network.neutron [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:55:33 user nova-compute[73104]: DEBUG nova.policy [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bcd11beb7046440f814cbf4a13ab0272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a37356203d547c2abf0aa634c2ad548', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:55:33 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:55:33 user nova-compute[73104]: DEBUG nova.compute.manager [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:55:33 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040133.349538, 67c5d379-7e2a-415b-a0a5-530afec0b1ea => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:55:33 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] VM Resumed (Lifecycle Event)
Aug 26 08:55:33 user nova-compute[73104]: DEBUG nova.compute.manager [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:55:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:55:33 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Instance spawned successfully.
Aug 26 08:55:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:55:33 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:55:33 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:55:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:55:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:55:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:55:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:55:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:55:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:55:33 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:55:33 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040133.352904, 67c5d379-7e2a-415b-a0a5-530afec0b1ea => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:55:33 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] VM Started (Lifecycle Event)
Aug 26 08:55:33 user nova-compute[73104]: INFO nova.virt.block_device [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Booting with volume-backed-image e28116ef-1f27-40e2-be41-f8cc5c10ee86 at /dev/vda
Aug 26 08:55:33 user nova-compute[73104]: DEBUG nova.compute.manager [req-3857f5c1-7718-47ab-a716-aba7f56b2b7b req-1d6997c7-9c4f-4348-a2b7-9b8f1884a594 service nova] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Received event network-vif-plugged-1d3ab149-29a3-4045-934c-4930ed714adc {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:55:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3857f5c1-7718-47ab-a716-aba7f56b2b7b req-1d6997c7-9c4f-4348-a2b7-9b8f1884a594 service nova] Acquiring lock "67c5d379-7e2a-415b-a0a5-530afec0b1ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:55:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3857f5c1-7718-47ab-a716-aba7f56b2b7b req-1d6997c7-9c4f-4348-a2b7-9b8f1884a594 service nova] Lock "67c5d379-7e2a-415b-a0a5-530afec0b1ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:55:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3857f5c1-7718-47ab-a716-aba7f56b2b7b req-1d6997c7-9c4f-4348-a2b7-9b8f1884a594 service nova] Lock "67c5d379-7e2a-415b-a0a5-530afec0b1ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:55:33 user nova-compute[73104]: DEBUG nova.compute.manager [req-3857f5c1-7718-47ab-a716-aba7f56b2b7b req-1d6997c7-9c4f-4348-a2b7-9b8f1884a594 service nova] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] No waiting events found dispatching network-vif-plugged-1d3ab149-29a3-4045-934c-4930ed714adc {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:55:33 user nova-compute[73104]: WARNING nova.compute.manager [req-3857f5c1-7718-47ab-a716-aba7f56b2b7b req-1d6997c7-9c4f-4348-a2b7-9b8f1884a594 service nova] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Received unexpected event network-vif-plugged-1d3ab149-29a3-4045-934c-4930ed714adc for instance with vm_state building and task_state spawning.
Aug 26 08:55:33 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:55:33 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:55:33 user nova-compute[73104]: INFO nova.compute.manager [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Took 5.64 seconds to spawn the instance on the hypervisor.
Aug 26 08:55:33 user nova-compute[73104]: DEBUG nova.compute.manager [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:55:33 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:55:33 user nova-compute[73104]: INFO nova.compute.manager [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Took 6.36 seconds to build instance.
Aug 26 08:55:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-96ed71f2-954e-4876-b0a7-b185acef80a7 tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Lock "67c5d379-7e2a-415b-a0a5-530afec0b1ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.459s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:55:33 user nova-compute[73104]: DEBUG nova.network.neutron [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Successfully created port: fd9b2f61-e1a4-47ba-8890-72715a8e241e {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:55:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:34 user nova-compute[73104]: DEBUG nova.network.neutron [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Successfully updated port: fd9b2f61-e1a4-47ba-8890-72715a8e241e {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:55:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "refresh_cache-0e3fb03a-d317-4eed-ad52-d066242a13e0" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:55:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquired lock "refresh_cache-0e3fb03a-d317-4eed-ad52-d066242a13e0" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:55:34 user nova-compute[73104]: DEBUG nova.network.neutron [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:55:34 user nova-compute[73104]: DEBUG nova.compute.manager [req-e37df086-af7b-4db9-92a8-0baced8790f5 req-7f6f61b7-a2bc-4e03-928c-7cfab00a4068 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Received event network-changed-fd9b2f61-e1a4-47ba-8890-72715a8e241e {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:55:34 user nova-compute[73104]: DEBUG nova.compute.manager [req-e37df086-af7b-4db9-92a8-0baced8790f5 req-7f6f61b7-a2bc-4e03-928c-7cfab00a4068 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Refreshing instance network info cache due to event network-changed-fd9b2f61-e1a4-47ba-8890-72715a8e241e. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:55:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e37df086-af7b-4db9-92a8-0baced8790f5 req-7f6f61b7-a2bc-4e03-928c-7cfab00a4068 service nova] Acquiring lock "refresh_cache-0e3fb03a-d317-4eed-ad52-d066242a13e0" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:55:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:34 user nova-compute[73104]: DEBUG nova.network.neutron [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:55:35 user nova-compute[73104]: DEBUG nova.network.neutron [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Updating instance_info_cache with network_info: [{"id": "fd9b2f61-e1a4-47ba-8890-72715a8e241e", "address": "fa:16:3e:ed:2c:7f", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd9b2f61-e1", "ovs_interfaceid": "fd9b2f61-e1a4-47ba-8890-72715a8e241e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:55:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Releasing lock "refresh_cache-0e3fb03a-d317-4eed-ad52-d066242a13e0" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:55:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Instance network_info: |[{"id": "fd9b2f61-e1a4-47ba-8890-72715a8e241e", "address": "fa:16:3e:ed:2c:7f", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd9b2f61-e1", "ovs_interfaceid": "fd9b2f61-e1a4-47ba-8890-72715a8e241e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:55:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e37df086-af7b-4db9-92a8-0baced8790f5 req-7f6f61b7-a2bc-4e03-928c-7cfab00a4068 service nova] Acquired lock "refresh_cache-0e3fb03a-d317-4eed-ad52-d066242a13e0" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:55:35 user nova-compute[73104]: DEBUG nova.network.neutron [req-e37df086-af7b-4db9-92a8-0baced8790f5 req-7f6f61b7-a2bc-4e03-928c-7cfab00a4068 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Refreshing network info cache for port fd9b2f61-e1a4-47ba-8890-72715a8e241e {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:55:35 user nova-compute[73104]: DEBUG nova.network.neutron [req-e37df086-af7b-4db9-92a8-0baced8790f5 req-7f6f61b7-a2bc-4e03-928c-7cfab00a4068 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Updated VIF entry in instance network info cache for port fd9b2f61-e1a4-47ba-8890-72715a8e241e. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:55:35 user nova-compute[73104]: DEBUG nova.network.neutron [req-e37df086-af7b-4db9-92a8-0baced8790f5 req-7f6f61b7-a2bc-4e03-928c-7cfab00a4068 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Updating instance_info_cache with network_info: [{"id": "fd9b2f61-e1a4-47ba-8890-72715a8e241e", "address": "fa:16:3e:ed:2c:7f", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd9b2f61-e1", "ovs_interfaceid": "fd9b2f61-e1a4-47ba-8890-72715a8e241e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:55:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e37df086-af7b-4db9-92a8-0baced8790f5 req-7f6f61b7-a2bc-4e03-928c-7cfab00a4068 service nova] Releasing lock "refresh_cache-0e3fb03a-d317-4eed-ad52-d066242a13e0" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:55:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:39 user nova-compute[73104]: DEBUG nova.objects.instance [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lazy-loading 'flavor' on Instance uuid 33048996-d559-4b3c-9de9-39bb176c3ec9 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:55:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "refresh_cache-33048996-d559-4b3c-9de9-39bb176c3ec9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:55:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquired lock "refresh_cache-33048996-d559-4b3c-9de9-39bb176c3ec9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:55:39 user nova-compute[73104]: DEBUG nova.network.neutron [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:55:39 user nova-compute[73104]: DEBUG nova.objects.instance [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lazy-loading 'info_cache' on Instance uuid 33048996-d559-4b3c-9de9-39bb176c3ec9 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:55:39 user nova-compute[73104]: DEBUG nova.objects.base [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Object Instance<33048996-d559-4b3c-9de9-39bb176c3ec9> lazy-loaded attributes: flavor,info_cache {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG nova.network.neutron [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Updating instance_info_cache with network_info: [{"id": "4c1b906e-2c49-4642-9183-06292be46de4", "address": "fa:16:3e:7e:7d:6c", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1b906e-2c", "ovs_interfaceid": "4c1b906e-2c49-4642-9183-06292be46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Releasing lock "refresh_cache-33048996-d559-4b3c-9de9-39bb176c3ec9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:55:40 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Instance destroyed successfully.
Aug 26 08:55:40 user nova-compute[73104]: DEBUG nova.objects.instance [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lazy-loading 'resources' on Instance uuid 33048996-d559-4b3c-9de9-39bb176c3ec9 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG nova.objects.base [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Object Instance<33048996-d559-4b3c-9de9-39bb176c3ec9> lazy-loaded attributes: flavor,info_cache,resources {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:51:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1372648210',display_name='tempest-AttachVolumeTestJSON-server-1372648210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1372648210',id=28,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3ruAnm8wJOtkM5YpWf3zux9ipeTcCrtMwmPCNqS87cjfXmG7Jo5HHNQzK7O8JS5TTbG/bKm+6qFm/BZVW6gKLbnDGC/QXgHLRc1/aNdWcQz6PVhir0ZiiZKQ1S1B0vIg==',key_name='tempest-keypair-1147096816',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:51:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d101cd585e604a1881c981c946f70849',ramdisk_id='',reservation_id='r-hfyybj1j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-684994869',owner_user_name='tempest-AttachVolumeTestJSON-684994869-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:53:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4191d8a10ac54389b6b633701f6e6c77',uuid=33048996-d559-4b3c-9de9-39bb176c3ec9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4c1b906e-2c49-4642-9183-06292be46de4", "address": "fa:16:3e:7e:7d:6c", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1b906e-2c", "ovs_interfaceid": "4c1b906e-2c49-4642-9183-06292be46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Converting VIF {"id": "4c1b906e-2c49-4642-9183-06292be46de4", "address": "fa:16:3e:7e:7d:6c", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1b906e-2c", "ovs_interfaceid": "4c1b906e-2c49-4642-9183-06292be46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7d:6c,bridge_name='br-int',has_traffic_filtering=True,id=4c1b906e-2c49-4642-9183-06292be46de4,network=Network(e6ddfc91-c02c-429c-90ff-aaad54b98cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1b906e-2c') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG os_vif [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7d:6c,bridge_name='br-int',has_traffic_filtering=True,id=4c1b906e-2c49-4642-9183-06292be46de4,network=Network(e6ddfc91-c02c-429c-90ff-aaad54b98cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1b906e-2c') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c1b906e-2c, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:55:40 user nova-compute[73104]: INFO os_vif [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7d:6c,bridge_name='br-int',has_traffic_filtering=True,id=4c1b906e-2c49-4642-9183-06292be46de4,network=Network(e6ddfc91-c02c-429c-90ff-aaad54b98cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1b906e-2c')
Aug 26 08:55:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cnwzLsMB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:55:40 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:55:40 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5b46c5-954c-4f1e-87e3-c58d38ed1c83]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b634aa-9e84-4d19-9d38-be2b1215f85d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:55:40 user nova-compute[73104]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:55:40 user nova-compute[73104]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:55:40 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:55:40 user nova-compute[73104]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:55:40 user nova-compute[73104]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:55:40 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b4795a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16'): ({'sdd'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Removing single pathed devices sdd {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4ec447-075b-425e-9f1f-4e8ff0b51c06]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a062a472-8237-408c-9a42-750382c4478b]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Flushing IO for device /dev/sdd {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b56f7f0-4af4-4709-a30f-c940be622f52]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.100s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0886ec11-de82-4c19-8213-580cb7002bca]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] SCSI volumes sdd have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c31761-636e-4161-a0f6-6c4917c82e07]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0776b06e-0e02-41e5-a674-575b683e011a]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16, portal: 172.16.0.220,3260]
Aug 26 08:55:40 user nova-compute[73104]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16, portal: 172.16.0.220,3260] successful.
Aug 26 08:55:40 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f34ffd0-5e76-4c55-a76f-1175d5999420]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] <== disconnect_volume: return (355ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Start _get_guest_xml network_info=[{"id": "4c1b906e-2c49-4642-9183-06292be46de4", "address": "fa:16:3e:7e:7d:6c", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1b906e-2c", "ovs_interfaceid": "4c1b906e-2c49-4642-9183-06292be46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'faf16012-bcba-4e7b-bccf-50b960a8b212', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cnwzLsMB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '33048996-d559-4b3c-9de9-39bb176c3ec9', 'attached_at': '', 'detached_at': '', 'volume_id': '575b4aa5-1edc-47c1-88ed-42ab59f35a16', 'serial': '575b4aa5-1edc-47c1-88ed-42ab59f35a16'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG nova.objects.instance [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lazy-loading 'numa_topology' on Instance uuid 33048996-d559-4b3c-9de9-39bb176c3ec9 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG nova.objects.base [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Object Instance<33048996-d559-4b3c-9de9-39bb176c3ec9> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:55:40 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:55:40 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:55:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:55:40 user nova-compute[73104]: DEBUG nova.objects.instance [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lazy-loading 'vcpu_model' on Instance uuid 33048996-d559-4b3c-9de9-39bb176c3ec9 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG nova.objects.base [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Object Instance<33048996-d559-4b3c-9de9-39bb176c3ec9> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cnwzLsMB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:55:41 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:55:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:55:41 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:55:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:55:41 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:55:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d6f691-959d-40cf-8ad9-e409c8549d93]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:55:41 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc60c27-1918-4899-968a-d1d1018de80d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16] added
Aug 26 08:55:41 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bccaeed-3657-493a-b46b-9004fc10f3d8]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee6a023-5979-4c32-897c-41d58ebb2ef3]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cnwzLsMB {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cnwzLsMB" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2965fc42-b21b-438b-ac3c-a0d41ac6ed28]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cnwzLsMB'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98cb88e-18f2-4c37-a969-8387eaa4c599]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d784d060-a1f0-4160-b986-c257ed7164c2]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:55:41 user nova-compute[73104]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:55:41 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:55:41 user nova-compute[73104]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:55:41 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8f055a-c08d-4595-9afc-1bedaeb87f9b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16, portal: 172.16.0.220,3260]
Aug 26 08:55:41 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16, portal: 172.16.0.220,3260] successful.
Aug 26 08:55:41 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b5d38a-d8d3-478d-b34b-4ce92a083334]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa78db1-731c-4574-b216-5c0857ef2224]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:55:41 user nova-compute[73104]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:55:41 user nova-compute[73104]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:55:41 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:55:41 user nova-compute[73104]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:55:41 user nova-compute[73104]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:55:41 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b0b91b-16a3-4160-bb66-b20fe83bf7aa]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:55:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cnwzLsMB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:55:42 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:55:42 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23137653639613433', 'path': '/dev/sdd'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:55:42 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137653639613433', 'path': '/dev/sdd'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:55:42 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:51:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1372648210',display_name='tempest-AttachVolumeTestJSON-server-1372648210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1372648210',id=28,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3ruAnm8wJOtkM5YpWf3zux9ipeTcCrtMwmPCNqS87cjfXmG7Jo5HHNQzK7O8JS5TTbG/bKm+6qFm/BZVW6gKLbnDGC/QXgHLRc1/aNdWcQz6PVhir0ZiiZKQ1S1B0vIg==',key_name='tempest-keypair-1147096816',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:51:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d101cd585e604a1881c981c946f70849',ramdisk_id='',reservation_id='r-hfyybj1j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-684994869',owner_user_name='tempest-AttachVolumeTestJSON-684994869-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:53:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4191d8a10ac54389b6b633701f6e6c77',uuid=33048996-d559-4b3c-9de9-39bb176c3ec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4c1b906e-2c49-4642-9183-06292be46de4", "address": "fa:16:3e:7e:7d:6c", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1b906e-2c", "ovs_interfaceid": "4c1b906e-2c49-4642-9183-06292be46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:55:42 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Converting VIF {"id": "4c1b906e-2c49-4642-9183-06292be46de4", "address": "fa:16:3e:7e:7d:6c", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1b906e-2c", "ovs_interfaceid": "4c1b906e-2c49-4642-9183-06292be46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:55:42 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7d:6c,bridge_name='br-int',has_traffic_filtering=True,id=4c1b906e-2c49-4642-9183-06292be46de4,network=Network(e6ddfc91-c02c-429c-90ff-aaad54b98cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1b906e-2c') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:55:42 user nova-compute[73104]: DEBUG nova.objects.instance [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lazy-loading 'pci_devices' on Instance uuid 33048996-d559-4b3c-9de9-39bb176c3ec9 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:55:42 user nova-compute[73104]: DEBUG nova.objects.base [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Object Instance<33048996-d559-4b3c-9de9-39bb176c3ec9> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:55:42 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:55:42 user nova-compute[73104]:   <uuid>33048996-d559-4b3c-9de9-39bb176c3ec9</uuid>
Aug 26 08:55:42 user nova-compute[73104]:   <name>instance-0000001c</name>
Aug 26 08:55:42 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:55:42 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:55:42 user nova-compute[73104]:   <metadata>
Aug 26 08:55:42 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:55:42 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:55:42 user nova-compute[73104]:       <nova:name>tempest-AttachVolumeTestJSON-server-1372648210</nova:name>
Aug 26 08:55:42 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:55:40</nova:creationTime>
Aug 26 08:55:42 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:55:42 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:55:42 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:55:42 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:55:42 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:55:42 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:55:42 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:55:42 user nova-compute[73104]:       <nova:owner>
Aug 26 08:55:42 user nova-compute[73104]:         <nova:user uuid="4191d8a10ac54389b6b633701f6e6c77">tempest-AttachVolumeTestJSON-684994869-project-member</nova:user>
Aug 26 08:55:42 user nova-compute[73104]:         <nova:project uuid="d101cd585e604a1881c981c946f70849">tempest-AttachVolumeTestJSON-684994869</nova:project>
Aug 26 08:55:42 user nova-compute[73104]:       </nova:owner>
Aug 26 08:55:42 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:55:42 user nova-compute[73104]:       <nova:ports>
Aug 26 08:55:42 user nova-compute[73104]:         <nova:port uuid="4c1b906e-2c49-4642-9183-06292be46de4">
Aug 26 08:55:42 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 08:55:42 user nova-compute[73104]:         </nova:port>
Aug 26 08:55:42 user nova-compute[73104]:       </nova:ports>
Aug 26 08:55:42 user nova-compute[73104]:     </nova:instance>
Aug 26 08:55:42 user nova-compute[73104]:   </metadata>
Aug 26 08:55:42 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:55:42 user nova-compute[73104]:     <system>
Aug 26 08:55:42 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:55:42 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:55:42 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:55:42 user nova-compute[73104]:       <entry name="serial">33048996-d559-4b3c-9de9-39bb176c3ec9</entry>
Aug 26 08:55:42 user nova-compute[73104]:       <entry name="uuid">33048996-d559-4b3c-9de9-39bb176c3ec9</entry>
Aug 26 08:55:42 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:55:42 user nova-compute[73104]:     </system>
Aug 26 08:55:42 user nova-compute[73104]:   </sysinfo>
Aug 26 08:55:42 user nova-compute[73104]:   <os>
Aug 26 08:55:42 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:55:42 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:55:42 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:55:42 user nova-compute[73104]:   </os>
Aug 26 08:55:42 user nova-compute[73104]:   <features>
Aug 26 08:55:42 user nova-compute[73104]:     <acpi/>
Aug 26 08:55:42 user nova-compute[73104]:     <apic/>
Aug 26 08:55:42 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:55:42 user nova-compute[73104]:   </features>
Aug 26 08:55:42 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:55:42 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:55:42 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:55:42 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:55:42 user nova-compute[73104]:   </clock>
Aug 26 08:55:42 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:55:42 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:55:42 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:55:42 user nova-compute[73104]:   </cpu>
Aug 26 08:55:42 user nova-compute[73104]:   <devices>
Aug 26 08:55:42 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:55:42 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:55:42 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk"/>
Aug 26 08:55:42 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:55:42 user nova-compute[73104]:     </disk>
Aug 26 08:55:42 user nova-compute[73104]:     <disk type="block" device="disk">
Aug 26 08:55:42 user nova-compute[73104]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:55:42 user nova-compute[73104]:       <source dev="/dev/sdd"/>
Aug 26 08:55:42 user nova-compute[73104]:       <target dev="vdb" bus="virtio"/>
Aug 26 08:55:42 user nova-compute[73104]:       <serial>575b4aa5-1edc-47c1-88ed-42ab59f35a16</serial>
Aug 26 08:55:42 user nova-compute[73104]:     </disk>
Aug 26 08:55:42 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:55:42 user nova-compute[73104]:       <mac address="fa:16:3e:7e:7d:6c"/>
Aug 26 08:55:42 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:55:42 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:55:42 user nova-compute[73104]:       <target dev="tap4c1b906e-2c"/>
Aug 26 08:55:42 user nova-compute[73104]:     </interface>
Aug 26 08:55:42 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:55:42 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/console.log" append="off"/>
Aug 26 08:55:42 user nova-compute[73104]:     </serial>
Aug 26 08:55:42 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:55:42 user nova-compute[73104]:     <video>
Aug 26 08:55:42 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:55:42 user nova-compute[73104]:     </video>
Aug 26 08:55:42 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:55:42 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:55:42 user nova-compute[73104]:     </rng>
Aug 26 08:55:42 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:55:42 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:55:42 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:55:42 user nova-compute[73104]:     </memballoon>
Aug 26 08:55:42 user nova-compute[73104]:   </devices>
Aug 26 08:55:42 user nova-compute[73104]: </domain>
Aug 26 08:55:42 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:55:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json" returned: 0 in 0.336s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:42 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:55:42 user nova-compute[73104]: DEBUG nova.objects.instance [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lazy-loading 'trusted_certs' on Instance uuid 33048996-d559-4b3c-9de9-39bb176c3ec9 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:55:42 user nova-compute[73104]: DEBUG nova.objects.base [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Object Instance<33048996-d559-4b3c-9de9-39bb176c3ec9> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:55:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:43 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.204s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:43 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 08:55:43 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:43 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:43 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Cannot resize image /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 08:55:43 user nova-compute[73104]: DEBUG nova.objects.instance [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lazy-loading 'migration_context' on Instance uuid 33048996-d559-4b3c-9de9-39bb176c3ec9 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:55:43 user nova-compute[73104]: DEBUG nova.objects.base [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Object Instance<33048996-d559-4b3c-9de9-39bb176c3ec9> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:55:43 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:51:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1372648210',display_name='tempest-AttachVolumeTestJSON-server-1372648210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1372648210',id=28,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3ruAnm8wJOtkM5YpWf3zux9ipeTcCrtMwmPCNqS87cjfXmG7Jo5HHNQzK7O8JS5TTbG/bKm+6qFm/BZVW6gKLbnDGC/QXgHLRc1/aNdWcQz6PVhir0ZiiZKQ1S1B0vIg==',key_name='tempest-keypair-1147096816',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:51:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='d101cd585e604a1881c981c946f70849',ramdisk_id='',reservation_id='r-hfyybj1j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-684994869',owner_user_name='tempest-AttachVolumeTestJSON-684994869-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:53:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4191d8a10ac54389b6b633701f6e6c77',uuid=33048996-d559-4b3c-9de9-39bb176c3ec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4c1b906e-2c49-4642-9183-06292be46de4", "address": "fa:16:3e:7e:7d:6c", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1b906e-2c", "ovs_interfaceid": "4c1b906e-2c49-4642-9183-06292be46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:55:43 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Converting VIF {"id": "4c1b906e-2c49-4642-9183-06292be46de4", "address": "fa:16:3e:7e:7d:6c", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1b906e-2c", "ovs_interfaceid": "4c1b906e-2c49-4642-9183-06292be46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:55:43 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7d:6c,bridge_name='br-int',has_traffic_filtering=True,id=4c1b906e-2c49-4642-9183-06292be46de4,network=Network(e6ddfc91-c02c-429c-90ff-aaad54b98cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1b906e-2c') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:55:43 user nova-compute[73104]: DEBUG os_vif [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7d:6c,bridge_name='br-int',has_traffic_filtering=True,id=4c1b906e-2c49-4642-9183-06292be46de4,network=Network(e6ddfc91-c02c-429c-90ff-aaad54b98cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1b906e-2c') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:55:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:55:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:55:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c1b906e-2c, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:55:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4c1b906e-2c, col_values=(('external_ids', {'iface-id': '4c1b906e-2c49-4642-9183-06292be46de4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:7d:6c', 'vm-uuid': '33048996-d559-4b3c-9de9-39bb176c3ec9'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:55:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:55:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:43 user nova-compute[73104]: INFO os_vif [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7d:6c,bridge_name='br-int',has_traffic_filtering=True,id=4c1b906e-2c49-4642-9183-06292be46de4,network=Network(e6ddfc91-c02c-429c-90ff-aaad54b98cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1b906e-2c')
Aug 26 08:55:44 user nova-compute[73104]: DEBUG os_brick.utils [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:55:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:44 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d210d2a3-5001-4129-bcb6-ff5ef2c67bd1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:44 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3ee511-48c9-4209-b2ae-62b3a2ef6190]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:44 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6500c44-2730-4917-91f9-197f2a44eca5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:44 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7226b290-6916-4b49-9f4c-c7162cd1466d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:55:44 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:55:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:55:44 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:55:44 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c25ee5-8655-49b9-a793-4354a9c024a8]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:44 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:55:44 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:55:44 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:55:44 user nova-compute[73104]: DEBUG os_brick.utils [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:55:44 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Updating existing volume attachment record: 05f96459-99ff-4415-9614-53964cd1ca73 {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 08:55:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:44 user nova-compute[73104]: DEBUG nova.compute.manager [req-f97c1c0f-638a-49a4-a20c-56018407fbe1 req-5f2059b3-e5c2-43c4-a270-3dcd7d09a095 service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Received event network-vif-plugged-4c1b906e-2c49-4642-9183-06292be46de4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:55:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f97c1c0f-638a-49a4-a20c-56018407fbe1 req-5f2059b3-e5c2-43c4-a270-3dcd7d09a095 service nova] Acquiring lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:55:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f97c1c0f-638a-49a4-a20c-56018407fbe1 req-5f2059b3-e5c2-43c4-a270-3dcd7d09a095 service nova] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:55:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f97c1c0f-638a-49a4-a20c-56018407fbe1 req-5f2059b3-e5c2-43c4-a270-3dcd7d09a095 service nova] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:55:44 user nova-compute[73104]: DEBUG nova.compute.manager [req-f97c1c0f-638a-49a4-a20c-56018407fbe1 req-5f2059b3-e5c2-43c4-a270-3dcd7d09a095 service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] No waiting events found dispatching network-vif-plugged-4c1b906e-2c49-4642-9183-06292be46de4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:55:44 user nova-compute[73104]: WARNING nova.compute.manager [req-f97c1c0f-638a-49a4-a20c-56018407fbe1 req-5f2059b3-e5c2-43c4-a270-3dcd7d09a095 service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Received unexpected event network-vif-plugged-4c1b906e-2c49-4642-9183-06292be46de4 for instance with vm_state stopped and task_state powering-on.
Aug 26 08:55:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:46 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040146.871928, 33048996-d559-4b3c-9de9-39bb176c3ec9 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:55:46 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] VM Resumed (Lifecycle Event)
Aug 26 08:55:46 user nova-compute[73104]: DEBUG nova.compute.manager [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:55:46 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Instance rebooted successfully.
Aug 26 08:55:46 user nova-compute[73104]: DEBUG nova.compute.manager [None req-350392f8-e107-435f-9648-c6785c082704 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:55:46 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:55:46 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:55:46 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 26 08:55:46 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040146.8738441, 33048996-d559-4b3c-9de9-39bb176c3ec9 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:55:46 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] VM Started (Lifecycle Event)
Aug 26 08:55:46 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:55:46 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:55:47 user nova-compute[73104]: DEBUG nova.compute.manager [req-88857bc7-c672-475f-aea0-c6b6a2eb93b4 req-c9e19ef5-fa88-4c2b-b8fa-364881be5f5f service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Received event network-vif-plugged-4c1b906e-2c49-4642-9183-06292be46de4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:55:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-88857bc7-c672-475f-aea0-c6b6a2eb93b4 req-c9e19ef5-fa88-4c2b-b8fa-364881be5f5f service nova] Acquiring lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:55:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-88857bc7-c672-475f-aea0-c6b6a2eb93b4 req-c9e19ef5-fa88-4c2b-b8fa-364881be5f5f service nova] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:55:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-88857bc7-c672-475f-aea0-c6b6a2eb93b4 req-c9e19ef5-fa88-4c2b-b8fa-364881be5f5f service nova] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:55:47 user nova-compute[73104]: DEBUG nova.compute.manager [req-88857bc7-c672-475f-aea0-c6b6a2eb93b4 req-c9e19ef5-fa88-4c2b-b8fa-364881be5f5f service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] No waiting events found dispatching network-vif-plugged-4c1b906e-2c49-4642-9183-06292be46de4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:55:47 user nova-compute[73104]: WARNING nova.compute.manager [req-88857bc7-c672-475f-aea0-c6b6a2eb93b4 req-c9e19ef5-fa88-4c2b-b8fa-364881be5f5f service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Received unexpected event network-vif-plugged-4c1b906e-2c49-4642-9183-06292be46de4 for instance with vm_state active and task_state None.
Aug 26 08:55:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-17f740e4-f8e8-415d-b599-e28f00b6f73e req-77ef0107-bed9-48ef-8bcd-82ea44f32f48 service nova] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Received event network-changed-3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:55:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-17f740e4-f8e8-415d-b599-e28f00b6f73e req-77ef0107-bed9-48ef-8bcd-82ea44f32f48 service nova] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Refreshing instance network info cache due to event network-changed-3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:55:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-17f740e4-f8e8-415d-b599-e28f00b6f73e req-77ef0107-bed9-48ef-8bcd-82ea44f32f48 service nova] Acquiring lock "refresh_cache-b5e1f82c-5675-4c37-8ba2-44e6a341a576" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:55:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-17f740e4-f8e8-415d-b599-e28f00b6f73e req-77ef0107-bed9-48ef-8bcd-82ea44f32f48 service nova] Acquired lock "refresh_cache-b5e1f82c-5675-4c37-8ba2-44e6a341a576" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:55:49 user nova-compute[73104]: DEBUG nova.network.neutron [req-17f740e4-f8e8-415d-b599-e28f00b6f73e req-77ef0107-bed9-48ef-8bcd-82ea44f32f48 service nova] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Refreshing network info cache for port 3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:55:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:49 user nova-compute[73104]: DEBUG nova.network.neutron [req-17f740e4-f8e8-415d-b599-e28f00b6f73e req-77ef0107-bed9-48ef-8bcd-82ea44f32f48 service nova] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Updated VIF entry in instance network info cache for port 3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:55:49 user nova-compute[73104]: DEBUG nova.network.neutron [req-17f740e4-f8e8-415d-b599-e28f00b6f73e req-77ef0107-bed9-48ef-8bcd-82ea44f32f48 service nova] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Updating instance_info_cache with network_info: [{"id": "3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96", "address": "fa:16:3e:c0:56:86", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3913bdf7-1f", "ovs_interfaceid": "3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:55:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-17f740e4-f8e8-415d-b599-e28f00b6f73e req-77ef0107-bed9-48ef-8bcd-82ea44f32f48 service nova] Releasing lock "refresh_cache-b5e1f82c-5675-4c37-8ba2-44e6a341a576" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:55:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-17f740e4-f8e8-415d-b599-e28f00b6f73e req-77ef0107-bed9-48ef-8bcd-82ea44f32f48 service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Received event network-changed-15317ff8-610b-4e0a-b0a8-ef37bb219ba8 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:55:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-17f740e4-f8e8-415d-b599-e28f00b6f73e req-77ef0107-bed9-48ef-8bcd-82ea44f32f48 service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Refreshing instance network info cache due to event network-changed-15317ff8-610b-4e0a-b0a8-ef37bb219ba8. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:55:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-17f740e4-f8e8-415d-b599-e28f00b6f73e req-77ef0107-bed9-48ef-8bcd-82ea44f32f48 service nova] Acquiring lock "refresh_cache-c08a447c-e25d-4f88-b15f-0c3de12559aa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:55:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-17f740e4-f8e8-415d-b599-e28f00b6f73e req-77ef0107-bed9-48ef-8bcd-82ea44f32f48 service nova] Acquired lock "refresh_cache-c08a447c-e25d-4f88-b15f-0c3de12559aa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:55:49 user nova-compute[73104]: DEBUG nova.network.neutron [req-17f740e4-f8e8-415d-b599-e28f00b6f73e req-77ef0107-bed9-48ef-8bcd-82ea44f32f48 service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Refreshing network info cache for port 15317ff8-610b-4e0a-b0a8-ef37bb219ba8 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:55:50 user nova-compute[73104]: DEBUG nova.network.neutron [req-17f740e4-f8e8-415d-b599-e28f00b6f73e req-77ef0107-bed9-48ef-8bcd-82ea44f32f48 service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Updated VIF entry in instance network info cache for port 15317ff8-610b-4e0a-b0a8-ef37bb219ba8. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:55:50 user nova-compute[73104]: DEBUG nova.network.neutron [req-17f740e4-f8e8-415d-b599-e28f00b6f73e req-77ef0107-bed9-48ef-8bcd-82ea44f32f48 service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Updating instance_info_cache with network_info: [{"id": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "address": "fa:16:3e:3a:b1:b8", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15317ff8-61", "ovs_interfaceid": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:55:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-17f740e4-f8e8-415d-b599-e28f00b6f73e req-77ef0107-bed9-48ef-8bcd-82ea44f32f48 service nova] Releasing lock "refresh_cache-c08a447c-e25d-4f88-b15f-0c3de12559aa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:55:51 user nova-compute[73104]: DEBUG nova.compute.manager [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Stashing vm_state: active {{(pid=73104) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 26 08:55:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:55:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:55:51 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:55:51 user nova-compute[73104]: INFO nova.compute.claims [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Claim successful on node user
Aug 26 08:55:51 user nova-compute[73104]: INFO nova.compute.resource_tracker [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Updating resource usage from migration ab4b68e2-bb57-4dbe-ae35-63217e962a8b
Aug 26 08:55:51 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:55:51 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:55:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.493s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:55:51 user nova-compute[73104]: INFO nova.compute.manager [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Migrating
Aug 26 08:55:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "refresh_cache-c08a447c-e25d-4f88-b15f-0c3de12559aa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:55:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquired lock "refresh_cache-c08a447c-e25d-4f88-b15f-0c3de12559aa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:55:51 user nova-compute[73104]: DEBUG nova.network.neutron [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:55:52 user nova-compute[73104]: DEBUG nova.network.neutron [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Updating instance_info_cache with network_info: [{"id": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "address": "fa:16:3e:3a:b1:b8", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15317ff8-61", "ovs_interfaceid": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:55:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Releasing lock "refresh_cache-c08a447c-e25d-4f88-b15f-0c3de12559aa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:55:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Starting migrate_disk_and_power_off {{(pid=73104) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 26 08:55:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:52 user nova-compute[73104]: DEBUG nova.compute.manager [req-b48d4e19-acca-4764-82f1-b8671b29e993 req-b24735f0-52ef-4d2b-a402-23d7c3888aea service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Received event network-vif-unplugged-15317ff8-610b-4e0a-b0a8-ef37bb219ba8 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:55:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b48d4e19-acca-4764-82f1-b8671b29e993 req-b24735f0-52ef-4d2b-a402-23d7c3888aea service nova] Acquiring lock "c08a447c-e25d-4f88-b15f-0c3de12559aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:55:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b48d4e19-acca-4764-82f1-b8671b29e993 req-b24735f0-52ef-4d2b-a402-23d7c3888aea service nova] Lock "c08a447c-e25d-4f88-b15f-0c3de12559aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:55:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b48d4e19-acca-4764-82f1-b8671b29e993 req-b24735f0-52ef-4d2b-a402-23d7c3888aea service nova] Lock "c08a447c-e25d-4f88-b15f-0c3de12559aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:55:52 user nova-compute[73104]: DEBUG nova.compute.manager [req-b48d4e19-acca-4764-82f1-b8671b29e993 req-b24735f0-52ef-4d2b-a402-23d7c3888aea service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] No waiting events found dispatching network-vif-unplugged-15317ff8-610b-4e0a-b0a8-ef37bb219ba8 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:55:52 user nova-compute[73104]: WARNING nova.compute.manager [req-b48d4e19-acca-4764-82f1-b8671b29e993 req-b24735f0-52ef-4d2b-a402-23d7c3888aea service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Received unexpected event network-vif-unplugged-15317ff8-610b-4e0a-b0a8-ef37bb219ba8 for instance with vm_state active and task_state resize_migrating.
Aug 26 08:55:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:53 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Instance destroyed successfully.
Aug 26 08:55:53 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:53:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-437929114',display_name='tempest-ServerActionsTestOtherA-server-437929114',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-437929114',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDd7CVbfrgJk+LANTVyASPXlTQ9/WFcC61mCbmrDUGOXT5afWNcplXvZ22xaA7blYJtw8QDJAtG8f1dybdt3ItZCTVqOwov6sASWzyNlxMeQebqYtQoQd/bQsWZ9J2R2Q==',key_name='tempest-keypair-923484929',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:54:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='efb864c0a34541dca00c6dbbcea17319',ramdisk_id='',reservation_id='r-iqtdg5qf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1245661612',owner_user_name='tempest-ServerActionsTestOtherA-1245661612-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:55:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='257343af54bd42b591e8874ef4ecf8dc',uuid=c08a447c-e25d-4f88-b15f-0c3de12559aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "address": "fa:16:3e:3a:b1:b8", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1986549533-network", "vif_mac": "fa:16:3e:3a:b1:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15317ff8-61", "ovs_interfaceid": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Converting VIF {"id": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "address": "fa:16:3e:3a:b1:b8", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1986549533-network", "vif_mac": "fa:16:3e:3a:b1:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15317ff8-61", "ovs_interfaceid": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:b1:b8,bridge_name='br-int',has_traffic_filtering=True,id=15317ff8-610b-4e0a-b0a8-ef37bb219ba8,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15317ff8-61') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG os_vif [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:b1:b8,bridge_name='br-int',has_traffic_filtering=True,id=15317ff8-610b-4e0a-b0a8-ef37bb219ba8,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15317ff8-61') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15317ff8-61, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:53 user nova-compute[73104]: INFO os_vif [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:b1:b8,bridge_name='br-int',has_traffic_filtering=True,id=15317ff8-610b-4e0a-b0a8-ef37bb219ba8,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15317ff8-61')
Aug 26 08:55:53 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pPYHBKjQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:55:53 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:55:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b1c7ea-1b18-4bf2-95b3-e69819e6d59e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f86254b-cf8f-4b59-8542-59065c7704ff]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:55:53 user nova-compute[73104]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:55:53 user nova-compute[73104]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:55:53 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:55:53 user nova-compute[73104]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:55:53 user nova-compute[73104]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:55:53 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b4680310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185'): ({'sdc'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Removing single pathed devices sdc {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ed6390-8833-48e1-a7e0-89065b802bcc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee4283b-3f99-40cc-baf7-545e856ab9d2]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Flushing IO for device /dev/sdc {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31b8711-6551-48a3-9a9a-181bfd5d3511]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.064s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0d6f34-e730-407e-9cdf-7f31acb6c323]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] SCSI volumes sdc have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_cf9b301f', '/dev/disk/by-id/scsi-1SCST_BIOcf9b301f-26091c0a0d94a8a0', '/dev/disk/by-id/scsi-23236303931633061') {{(pid=84263) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 08:55:53 user nova-compute[73104]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_cf9b301f
Aug 26 08:55:53 user nova-compute[73104]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOcf9b301f-26091c0a0d94a8a0
Aug 26 08:55:53 user nova-compute[73104]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23236303931633061
Aug 26 08:55:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf3ff3b-ea07-4cfb-9a10-d8c880f059e9]: (4, None) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e86953c-a860-4007-98d0-664d8d8b442a]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2f73be-741a-45fe-8138-ad4302e89465]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185, portal: 172.16.0.220,3260]
Aug 26 08:55:53 user nova-compute[73104]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185, portal: 172.16.0.220,3260] successful.
Aug 26 08:55:53 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[822ab7a7-465e-4d30-812e-b19b71a9564d]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] <== disconnect_volume: return (365ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:55:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:54 user nova-compute[73104]: DEBUG nova.network.neutron [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Port 15317ff8-610b-4e0a-b0a8-ef37bb219ba8 binding to destination host user is already ACTIVE {{(pid=73104) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 26 08:55:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-a11fe54a-b5fc-44ea-8bcf-225d2d11106e req-08e29c9e-21c5-445f-9856-95144bb97d1c service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Received event network-vif-plugged-15317ff8-610b-4e0a-b0a8-ef37bb219ba8 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:55:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a11fe54a-b5fc-44ea-8bcf-225d2d11106e req-08e29c9e-21c5-445f-9856-95144bb97d1c service nova] Acquiring lock "c08a447c-e25d-4f88-b15f-0c3de12559aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:55:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a11fe54a-b5fc-44ea-8bcf-225d2d11106e req-08e29c9e-21c5-445f-9856-95144bb97d1c service nova] Lock "c08a447c-e25d-4f88-b15f-0c3de12559aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:55:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a11fe54a-b5fc-44ea-8bcf-225d2d11106e req-08e29c9e-21c5-445f-9856-95144bb97d1c service nova] Lock "c08a447c-e25d-4f88-b15f-0c3de12559aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:55:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-a11fe54a-b5fc-44ea-8bcf-225d2d11106e req-08e29c9e-21c5-445f-9856-95144bb97d1c service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] No waiting events found dispatching network-vif-plugged-15317ff8-610b-4e0a-b0a8-ef37bb219ba8 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:55:54 user nova-compute[73104]: WARNING nova.compute.manager [req-a11fe54a-b5fc-44ea-8bcf-225d2d11106e req-08e29c9e-21c5-445f-9856-95144bb97d1c service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Received unexpected event network-vif-plugged-15317ff8-610b-4e0a-b0a8-ef37bb219ba8 for instance with vm_state active and task_state resize_migrating.
Aug 26 08:55:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-a11fe54a-b5fc-44ea-8bcf-225d2d11106e req-08e29c9e-21c5-445f-9856-95144bb97d1c service nova] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Received event network-changed-cfa211db-57c3-47a2-82e1-f9536415953c {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:55:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-a11fe54a-b5fc-44ea-8bcf-225d2d11106e req-08e29c9e-21c5-445f-9856-95144bb97d1c service nova] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Refreshing instance network info cache due to event network-changed-cfa211db-57c3-47a2-82e1-f9536415953c. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:55:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a11fe54a-b5fc-44ea-8bcf-225d2d11106e req-08e29c9e-21c5-445f-9856-95144bb97d1c service nova] Acquiring lock "refresh_cache-6550b41d-2414-4b3e-9a50-9bba88033aae" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:55:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a11fe54a-b5fc-44ea-8bcf-225d2d11106e req-08e29c9e-21c5-445f-9856-95144bb97d1c service nova] Acquired lock "refresh_cache-6550b41d-2414-4b3e-9a50-9bba88033aae" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:55:54 user nova-compute[73104]: DEBUG nova.network.neutron [req-a11fe54a-b5fc-44ea-8bcf-225d2d11106e req-08e29c9e-21c5-445f-9856-95144bb97d1c service nova] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Refreshing network info cache for port cfa211db-57c3-47a2-82e1-f9536415953c {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:55:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "c08a447c-e25d-4f88-b15f-0c3de12559aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:55:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "c08a447c-e25d-4f88-b15f-0c3de12559aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:55:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "c08a447c-e25d-4f88-b15f-0c3de12559aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:55:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "refresh_cache-c08a447c-e25d-4f88-b15f-0c3de12559aa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:55:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquired lock "refresh_cache-c08a447c-e25d-4f88-b15f-0c3de12559aa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:55:55 user nova-compute[73104]: DEBUG nova.network.neutron [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:55:55 user nova-compute[73104]: DEBUG nova.network.neutron [req-a11fe54a-b5fc-44ea-8bcf-225d2d11106e req-08e29c9e-21c5-445f-9856-95144bb97d1c service nova] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Updated VIF entry in instance network info cache for port cfa211db-57c3-47a2-82e1-f9536415953c. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:55:55 user nova-compute[73104]: DEBUG nova.network.neutron [req-a11fe54a-b5fc-44ea-8bcf-225d2d11106e req-08e29c9e-21c5-445f-9856-95144bb97d1c service nova] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Updating instance_info_cache with network_info: [{"id": "cfa211db-57c3-47a2-82e1-f9536415953c", "address": "fa:16:3e:7f:fb:55", "network": {"id": "2bbbc03e-d3e2-41b9-9b25-265081247b1b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-839419385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca97939d90e46678626053110e9dba1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfa211db-57", "ovs_interfaceid": "cfa211db-57c3-47a2-82e1-f9536415953c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:55:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a11fe54a-b5fc-44ea-8bcf-225d2d11106e req-08e29c9e-21c5-445f-9856-95144bb97d1c service nova] Releasing lock "refresh_cache-6550b41d-2414-4b3e-9a50-9bba88033aae" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:55:55 user nova-compute[73104]: DEBUG nova.network.neutron [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Updating instance_info_cache with network_info: [{"id": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "address": "fa:16:3e:3a:b1:b8", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15317ff8-61", "ovs_interfaceid": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:55:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Releasing lock "refresh_cache-c08a447c-e25d-4f88-b15f-0c3de12559aa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:55:55 user nova-compute[73104]: DEBUG os_brick.utils [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:55:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:55 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d152fe77-4253-43de-98ae-6afdbeedf0ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:55 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65354fc-7fc9-429e-b257-553ed9f2e7a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:55 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f12627-3830-4bdb-b198-0c54d57e19df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:55 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0632d957-3f0c-4524-9ee7-40551fb24e50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:55:56 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:55:56 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0cc43c-df12-4bca-814b-c19041aace0b]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG os_brick.utils [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG nova.compute.manager [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:55:56 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Creating image(s)
Aug 26 08:55:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Did not create local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Ensure instance console log exists: /opt/stack/data/nova/instances/0e3fb03a-d317-4eed-ad52-d066242a13e0/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Start _get_guest_xml network_info=[{"id": "fd9b2f61-e1a4-47ba-8890-72715a8e241e", "address": "fa:16:3e:ed:2c:7f", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd9b2f61-e1", "ovs_interfaceid": "fd9b2f61-e1a4-47ba-8890-72715a8e241e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '05f96459-99ff-4415-9614-53964cd1ca73', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uRXgQlJf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0e3fb03a-d317-4eed-ad52-d066242a13e0', 'attached_at': '', 'detached_at': '', 'volume_id': '65bfdc23-25e2-4b96-923f-c523f0e1ddf7', 'serial': '65bfdc23-25e2-4b96-923f-c523f0e1ddf7'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:55:56 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:55:56 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:55:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uRXgQlJf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:55:56 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:55:56 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:55:56 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:55:56 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:55:56 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:55:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f547b24-dde9-4e86-a0f0-4f62065ee02e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:55:56 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:55:56 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c48473-3626-4586-b825-d677bf53a272]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7] added
Aug 26 08:55:57 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c72e630-ee76-49ab-81fd-0eccdb5c1c4d]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a867c865-b7c9-4052-9d95-260e486ee105]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uRXgQlJf {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uRXgQlJf" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f42281a-521e-4e17-b687-900c2d1fd5ab]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uRXgQlJf'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a81c33-d6c4-4dee-88d6-34e5bab45d04]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0621d4b3-0aa2-45dc-bfa7-e2717634fd0c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:55:57 user nova-compute[73104]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:55:57 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:55:57 user nova-compute[73104]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:55:57 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[804e472c-65de-426d-93c3-d570443a2e29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7, portal: 172.16.0.220,3260]
Aug 26 08:55:57 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7, portal: 172.16.0.220,3260] successful.
Aug 26 08:55:57 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b669ee58-cc8a-4b76-bb8b-8501db53bb32]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d17d49d-864c-4b1a-99bc-009cdcf2c75a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:55:57 user nova-compute[73104]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:55:57 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 08:55:57 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:55:57 user nova-compute[73104]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:55:57 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 08:55:57 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f89eaba-1d13-4ba5-b854-4738f2c54563]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:55:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uRXgQlJf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:55:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:55:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '26435663064313430', 'path': '/dev/sdc'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:55:58 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435663064313430', 'path': '/dev/sdc'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:55:58 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:55:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1054489120',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1054489120',id=35,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a37356203d547c2abf0aa634c2ad548',ramdisk_id='',reservation_id='r-xgt8vddh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1111216102',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:55:33Z,user_data=None,user_id='bcd11beb7046440f814cbf4a13ab0272',uuid=0e3fb03a-d317-4eed-ad52-d066242a13e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd9b2f61-e1a4-47ba-8890-72715a8e241e", "address": "fa:16:3e:ed:2c:7f", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd9b2f61-e1", "ovs_interfaceid": "fd9b2f61-e1a4-47ba-8890-72715a8e241e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:55:58 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Converting VIF {"id": "fd9b2f61-e1a4-47ba-8890-72715a8e241e", "address": "fa:16:3e:ed:2c:7f", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd9b2f61-e1", "ovs_interfaceid": "fd9b2f61-e1a4-47ba-8890-72715a8e241e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:55:58 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:2c:7f,bridge_name='br-int',has_traffic_filtering=True,id=fd9b2f61-e1a4-47ba-8890-72715a8e241e,network=Network(ce0a529c-2119-4b2a-a08f-567e3671c3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd9b2f61-e1') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:55:58 user nova-compute[73104]: DEBUG nova.objects.instance [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e3fb03a-d317-4eed-ad52-d066242a13e0 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:55:58 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:55:58 user nova-compute[73104]:   <uuid>0e3fb03a-d317-4eed-ad52-d066242a13e0</uuid>
Aug 26 08:55:58 user nova-compute[73104]:   <name>instance-00000023</name>
Aug 26 08:55:58 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:55:58 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:55:58 user nova-compute[73104]:   <metadata>
Aug 26 08:55:58 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:55:58 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:55:58 user nova-compute[73104]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1054489120</nova:name>
Aug 26 08:55:58 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:55:56</nova:creationTime>
Aug 26 08:55:58 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:55:58 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:55:58 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:55:58 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:55:58 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:55:58 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:55:58 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:55:58 user nova-compute[73104]:       <nova:owner>
Aug 26 08:55:58 user nova-compute[73104]:         <nova:user uuid="bcd11beb7046440f814cbf4a13ab0272">tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member</nova:user>
Aug 26 08:55:58 user nova-compute[73104]:         <nova:project uuid="8a37356203d547c2abf0aa634c2ad548">tempest-ServerBootFromVolumeStableRescueTest-1111216102</nova:project>
Aug 26 08:55:58 user nova-compute[73104]:       </nova:owner>
Aug 26 08:55:58 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:55:58 user nova-compute[73104]:       <nova:ports>
Aug 26 08:55:58 user nova-compute[73104]:         <nova:port uuid="fd9b2f61-e1a4-47ba-8890-72715a8e241e">
Aug 26 08:55:58 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 08:55:58 user nova-compute[73104]:         </nova:port>
Aug 26 08:55:58 user nova-compute[73104]:       </nova:ports>
Aug 26 08:55:58 user nova-compute[73104]:     </nova:instance>
Aug 26 08:55:58 user nova-compute[73104]:   </metadata>
Aug 26 08:55:58 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:55:58 user nova-compute[73104]:     <system>
Aug 26 08:55:58 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:55:58 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:55:58 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:55:58 user nova-compute[73104]:       <entry name="serial">0e3fb03a-d317-4eed-ad52-d066242a13e0</entry>
Aug 26 08:55:58 user nova-compute[73104]:       <entry name="uuid">0e3fb03a-d317-4eed-ad52-d066242a13e0</entry>
Aug 26 08:55:58 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:55:58 user nova-compute[73104]:     </system>
Aug 26 08:55:58 user nova-compute[73104]:   </sysinfo>
Aug 26 08:55:58 user nova-compute[73104]:   <os>
Aug 26 08:55:58 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:55:58 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:55:58 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:55:58 user nova-compute[73104]:   </os>
Aug 26 08:55:58 user nova-compute[73104]:   <features>
Aug 26 08:55:58 user nova-compute[73104]:     <acpi/>
Aug 26 08:55:58 user nova-compute[73104]:     <apic/>
Aug 26 08:55:58 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:55:58 user nova-compute[73104]:   </features>
Aug 26 08:55:58 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:55:58 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:55:58 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:55:58 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:55:58 user nova-compute[73104]:   </clock>
Aug 26 08:55:58 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:55:58 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:55:58 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:55:58 user nova-compute[73104]:   </cpu>
Aug 26 08:55:58 user nova-compute[73104]:   <devices>
Aug 26 08:55:58 user nova-compute[73104]:     <disk type="block" device="disk">
Aug 26 08:55:58 user nova-compute[73104]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:55:58 user nova-compute[73104]:       <source dev="/dev/sdc"/>
Aug 26 08:55:58 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:55:58 user nova-compute[73104]:       <serial>65bfdc23-25e2-4b96-923f-c523f0e1ddf7</serial>
Aug 26 08:55:58 user nova-compute[73104]:     </disk>
Aug 26 08:55:58 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:55:58 user nova-compute[73104]:       <mac address="fa:16:3e:ed:2c:7f"/>
Aug 26 08:55:58 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:55:58 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:55:58 user nova-compute[73104]:       <target dev="tapfd9b2f61-e1"/>
Aug 26 08:55:58 user nova-compute[73104]:     </interface>
Aug 26 08:55:58 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:55:58 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/0e3fb03a-d317-4eed-ad52-d066242a13e0/console.log" append="off"/>
Aug 26 08:55:58 user nova-compute[73104]:     </serial>
Aug 26 08:55:58 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:55:58 user nova-compute[73104]:     <video>
Aug 26 08:55:58 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:55:58 user nova-compute[73104]:     </video>
Aug 26 08:55:58 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:55:58 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:55:58 user nova-compute[73104]:     </rng>
Aug 26 08:55:58 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:55:58 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:55:58 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:55:58 user nova-compute[73104]:     </memballoon>
Aug 26 08:55:58 user nova-compute[73104]:   </devices>
Aug 26 08:55:58 user nova-compute[73104]: </domain>
Aug 26 08:55:58 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:55:58 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:55:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1054489120',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1054489120',id=35,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a37356203d547c2abf0aa634c2ad548',ramdisk_id='',reservation_id='r-xgt8vddh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1111216102',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:55:33Z,user_data=None,user_id='bcd11beb7046440f814cbf4a13ab0272',uuid=0e3fb03a-d317-4eed-ad52-d066242a13e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd9b2f61-e1a4-47ba-8890-72715a8e241e", "address": "fa:16:3e:ed:2c:7f", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd9b2f61-e1", "ovs_interfaceid": "fd9b2f61-e1a4-47ba-8890-72715a8e241e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:55:58 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Converting VIF {"id": "fd9b2f61-e1a4-47ba-8890-72715a8e241e", "address": "fa:16:3e:ed:2c:7f", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd9b2f61-e1", "ovs_interfaceid": "fd9b2f61-e1a4-47ba-8890-72715a8e241e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:55:58 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:2c:7f,bridge_name='br-int',has_traffic_filtering=True,id=fd9b2f61-e1a4-47ba-8890-72715a8e241e,network=Network(ce0a529c-2119-4b2a-a08f-567e3671c3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd9b2f61-e1') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:55:58 user nova-compute[73104]: DEBUG os_vif [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:2c:7f,bridge_name='br-int',has_traffic_filtering=True,id=fd9b2f61-e1a4-47ba-8890-72715a8e241e,network=Network(ce0a529c-2119-4b2a-a08f-567e3671c3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd9b2f61-e1') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:55:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:55:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:55:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd9b2f61-e1, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:55:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd9b2f61-e1, col_values=(('external_ids', {'iface-id': 'fd9b2f61-e1a4-47ba-8890-72715a8e241e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:2c:7f', 'vm-uuid': '0e3fb03a-d317-4eed-ad52-d066242a13e0'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:55:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:55:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:58 user nova-compute[73104]: INFO os_vif [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:2c:7f,bridge_name='br-int',has_traffic_filtering=True,id=fd9b2f61-e1a4-47ba-8890-72715a8e241e,network=Network(ce0a529c-2119-4b2a-a08f-567e3671c3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd9b2f61-e1')
Aug 26 08:55:58 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:55:58 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] No VIF found with MAC fa:16:3e:ed:2c:7f, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:55:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Acquiring lock "6550b41d-2414-4b3e-9a50-9bba88033aae" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:55:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Lock "6550b41d-2414-4b3e-9a50-9bba88033aae" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:55:59 user nova-compute[73104]: DEBUG nova.objects.instance [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Lazy-loading 'flavor' on Instance uuid 6550b41d-2414-4b3e-9a50-9bba88033aae {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:55:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Lock "6550b41d-2414-4b3e-9a50-9bba88033aae" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:55:59 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:55:59 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:55:59 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:55:59 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 08:55:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Acquiring lock "6550b41d-2414-4b3e-9a50-9bba88033aae" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:55:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Lock "6550b41d-2414-4b3e-9a50-9bba88033aae" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:55:59 user nova-compute[73104]: INFO nova.compute.manager [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Attaching volume 43268837-59fe-4c94-afa5-f35112afbca2 to /dev/vdb
Aug 26 08:55:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:59 user nova-compute[73104]: DEBUG os_brick.utils [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:55:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:59 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[02167c72-c421-46cf-aaca-f8b0b21ad2f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:59 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4974123c-ab3b-4d4e-9a72-949496519cce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:55:59 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cfc10b-d57e-4939-84a1-a2270f76d226]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:59 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[da81337a-d47d-42a5-ab95-da812d2a5a9e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:55:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:55:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:55:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:55:59 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:55:59 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25ea9b7-e3f0-4317-b78f-3515a440df3e]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:55:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:55:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:55:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:55:59 user nova-compute[73104]: DEBUG os_brick.utils [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:55:59 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Updating existing volume attachment record: 54a94a0b-face-4d12-985b-47f950400ccc {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 08:55:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:55:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:00 user nova-compute[73104]: DEBUG nova.compute.manager [req-30057f7a-2467-4bdd-8119-eeaf2b0130b9 req-5b43162d-4136-400f-bc78-850396ca9294 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Received event network-vif-plugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:56:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-30057f7a-2467-4bdd-8119-eeaf2b0130b9 req-5b43162d-4136-400f-bc78-850396ca9294 service nova] Acquiring lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:56:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-30057f7a-2467-4bdd-8119-eeaf2b0130b9 req-5b43162d-4136-400f-bc78-850396ca9294 service nova] Lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:56:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-30057f7a-2467-4bdd-8119-eeaf2b0130b9 req-5b43162d-4136-400f-bc78-850396ca9294 service nova] Lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:56:00 user nova-compute[73104]: DEBUG nova.compute.manager [req-30057f7a-2467-4bdd-8119-eeaf2b0130b9 req-5b43162d-4136-400f-bc78-850396ca9294 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] No waiting events found dispatching network-vif-plugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:56:00 user nova-compute[73104]: WARNING nova.compute.manager [req-30057f7a-2467-4bdd-8119-eeaf2b0130b9 req-5b43162d-4136-400f-bc78-850396ca9294 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Received unexpected event network-vif-plugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e for instance with vm_state building and task_state spawning.
Aug 26 08:56:02 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:56:02 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:56:02 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:56:02 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:56:02 user nova-compute[73104]: DEBUG nova.compute.manager [req-15883e00-0b15-4473-a642-070ac8ad7447 req-d48d2ed4-1de9-426c-a31b-d5dc98e45fd5 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Received event network-vif-plugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:56:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-15883e00-0b15-4473-a642-070ac8ad7447 req-d48d2ed4-1de9-426c-a31b-d5dc98e45fd5 service nova] Acquiring lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:56:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-15883e00-0b15-4473-a642-070ac8ad7447 req-d48d2ed4-1de9-426c-a31b-d5dc98e45fd5 service nova] Lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:56:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-15883e00-0b15-4473-a642-070ac8ad7447 req-d48d2ed4-1de9-426c-a31b-d5dc98e45fd5 service nova] Lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:56:02 user nova-compute[73104]: DEBUG nova.compute.manager [req-15883e00-0b15-4473-a642-070ac8ad7447 req-d48d2ed4-1de9-426c-a31b-d5dc98e45fd5 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] No waiting events found dispatching network-vif-plugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:56:02 user nova-compute[73104]: WARNING nova.compute.manager [req-15883e00-0b15-4473-a642-070ac8ad7447 req-d48d2ed4-1de9-426c-a31b-d5dc98e45fd5 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Received unexpected event network-vif-plugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e for instance with vm_state building and task_state spawning.
Aug 26 08:56:02 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040162.3988092, 0e3fb03a-d317-4eed-ad52-d066242a13e0 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:56:02 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] VM Resumed (Lifecycle Event)
Aug 26 08:56:02 user nova-compute[73104]: DEBUG nova.compute.manager [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:56:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:56:02 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Instance spawned successfully.
Aug 26 08:56:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:56:02 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:56:02 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:56:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:56:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:56:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:56:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:56:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:56:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:56:02 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:56:02 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040162.3995116, 0e3fb03a-d317-4eed-ad52-d066242a13e0 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:56:02 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] VM Started (Lifecycle Event)
Aug 26 08:56:02 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:56:02 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:56:02 user nova-compute[73104]: INFO nova.compute.manager [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Took 5.65 seconds to spawn the instance on the hypervisor.
Aug 26 08:56:02 user nova-compute[73104]: DEBUG nova.compute.manager [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:56:02 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:56:02 user nova-compute[73104]: INFO nova.compute.manager [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Took 30.03 seconds to build instance.
Aug 26 08:56:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-dd50a1d1-e45a-4414-ae96-0f9807e1339e tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "0e3fb03a-d317-4eed-ad52-d066242a13e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.125s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:56:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:56:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:56:02 user nova-compute[73104]: DEBUG nova.compute.manager [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:56:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:56:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:56:02 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:56:02 user nova-compute[73104]: INFO nova.compute.claims [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Claim successful on node user
Aug 26 08:56:03 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:56:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:56:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:03 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:56:03 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:56:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.737s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:56:03 user nova-compute[73104]: DEBUG nova.compute.manager [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:56:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.201s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:56:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:56:03 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 08:56:03 user nova-compute[73104]: DEBUG nova.compute.manager [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:56:03 user nova-compute[73104]: DEBUG nova.network.neutron [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:56:03 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:56:03 user nova-compute[73104]: DEBUG nova.compute.manager [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:56:03 user nova-compute[73104]: DEBUG nova.policy [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6fd47a4b6ae846a79a378d6ed543fd1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718e3cb41d5342069cd73b96bade97e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:56:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b45635b-062b-4149-8789-9f5191132cbd/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:03 user nova-compute[73104]: DEBUG nova.compute.manager [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:56:03 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:56:03 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Creating image(s)
Aug 26 08:56:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9cadc09-e4ec-4d5c-a22d-912e92c09cff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:56:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "/opt/stack/data/nova/instances/f9cadc09-e4ec-4d5c-a22d-912e92c09cff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:56:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "/opt/stack/data/nova/instances/f9cadc09-e4ec-4d5c-a22d-912e92c09cff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:56:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "a2744857c1476c7db99e5b5528f47ee510e5f09e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:56:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "a2744857c1476c7db99e5b5528f47ee510e5f09e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:56:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2744857c1476c7db99e5b5528f47ee510e5f09e.part --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b45635b-062b-4149-8789-9f5191132cbd/disk --force-share --output=json" returned: 0 in 0.584s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b45635b-062b-4149-8789-9f5191132cbd/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b45635b-062b-4149-8789-9f5191132cbd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2744857c1476c7db99e5b5528f47ee510e5f09e.part --force-share --output=json" returned: 0 in 0.282s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:04 user nova-compute[73104]: DEBUG nova.virt.images [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] dd37b38e-c03a-412e-96fc-c296d19c2399 was qcow2, converting to raw {{(pid=73104) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 08:56:04 user nova-compute[73104]: DEBUG nova.privsep.utils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73104) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 08:56:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a2744857c1476c7db99e5b5528f47ee510e5f09e.part /opt/stack/data/nova/instances/_base/a2744857c1476c7db99e5b5528f47ee510e5f09e.converted {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:56:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:05 user nova-compute[73104]: DEBUG nova.network.neutron [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Successfully created port: 4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:56:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a2744857c1476c7db99e5b5528f47ee510e5f09e.part /opt/stack/data/nova/instances/_base/a2744857c1476c7db99e5b5528f47ee510e5f09e.converted" returned: 0 in 0.540s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2744857c1476c7db99e5b5528f47ee510e5f09e.converted --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2744857c1476c7db99e5b5528f47ee510e5f09e.converted --force-share --output=json" returned: 0 in 0.237s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "a2744857c1476c7db99e5b5528f47ee510e5f09e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.566s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:56:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2744857c1476c7db99e5b5528f47ee510e5f09e --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:56:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6550b41d-2414-4b3e-9a50-9bba88033aae/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2744857c1476c7db99e5b5528f47ee510e5f09e --force-share --output=json" returned: 0 in 0.237s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "a2744857c1476c7db99e5b5528f47ee510e5f09e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:56:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "a2744857c1476c7db99e5b5528f47ee510e5f09e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:56:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2744857c1476c7db99e5b5528f47ee510e5f09e --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6550b41d-2414-4b3e-9a50-9bba88033aae/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6550b41d-2414-4b3e-9a50-9bba88033aae/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2744857c1476c7db99e5b5528f47ee510e5f09e --force-share --output=json" returned: 0 in 0.202s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a2744857c1476c7db99e5b5528f47ee510e5f09e,backing_fmt=raw /opt/stack/data/nova/instances/f9cadc09-e4ec-4d5c-a22d-912e92c09cff/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a2744857c1476c7db99e5b5528f47ee510e5f09e,backing_fmt=raw /opt/stack/data/nova/instances/f9cadc09-e4ec-4d5c-a22d-912e92c09cff/disk 1073741824" returned: 0 in 0.053s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "a2744857c1476c7db99e5b5528f47ee510e5f09e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:56:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2744857c1476c7db99e5b5528f47ee510e5f09e --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6550b41d-2414-4b3e-9a50-9bba88033aae/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.network.neutron [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Successfully updated port: 4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.compute.manager [req-4ca2072d-4878-447b-b9ac-06d034900a79 req-56d71551-ad21-4762-9a99-96277e7de7dd service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Received event network-changed-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.compute.manager [req-4ca2072d-4878-447b-b9ac-06d034900a79 req-56d71551-ad21-4762-9a99-96277e7de7dd service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Refreshing instance network info cache due to event network-changed-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4ca2072d-4878-447b-b9ac-06d034900a79 req-56d71551-ad21-4762-9a99-96277e7de7dd service nova] Acquiring lock "refresh_cache-f9cadc09-e4ec-4d5c-a22d-912e92c09cff" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4ca2072d-4878-447b-b9ac-06d034900a79 req-56d71551-ad21-4762-9a99-96277e7de7dd service nova] Acquired lock "refresh_cache-f9cadc09-e4ec-4d5c-a22d-912e92c09cff" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.network.neutron [req-4ca2072d-4878-447b-b9ac-06d034900a79 req-56d71551-ad21-4762-9a99-96277e7de7dd service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Refreshing network info cache for port 4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "refresh_cache-f9cadc09-e4ec-4d5c-a22d-912e92c09cff" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.network.neutron [req-4ca2072d-4878-447b-b9ac-06d034900a79 req-56d71551-ad21-4762-9a99-96277e7de7dd service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2744857c1476c7db99e5b5528f47ee510e5f09e --force-share --output=json" returned: 0 in 0.203s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9cadc09-e4ec-4d5c-a22d-912e92c09cff/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9cadc09-e4ec-4d5c-a22d-912e92c09cff/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9cadc09-e4ec-4d5c-a22d-912e92c09cff/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Cannot resize image /opt/stack/data/nova/instances/f9cadc09-e4ec-4d5c-a22d-912e92c09cff/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Ensure instance console log exists: /opt/stack/data/nova/instances/f9cadc09-e4ec-4d5c-a22d-912e92c09cff/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.network.neutron [req-4ca2072d-4878-447b-b9ac-06d034900a79 req-56d71551-ad21-4762-9a99-96277e7de7dd service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4ca2072d-4878-447b-b9ac-06d034900a79 req-56d71551-ad21-4762-9a99-96277e7de7dd service nova] Releasing lock "refresh_cache-f9cadc09-e4ec-4d5c-a22d-912e92c09cff" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquired lock "refresh_cache-f9cadc09-e4ec-4d5c-a22d-912e92c09cff" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.network.neutron [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.network.neutron [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.network.neutron [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Updating instance_info_cache with network_info: [{"id": "4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6", "address": "fa:16:3e:50:6f:2d", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7f3393-fe", "ovs_interfaceid": "4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Releasing lock "refresh_cache-f9cadc09-e4ec-4d5c-a22d-912e92c09cff" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.compute.manager [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Instance network_info: |[{"id": "4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6", "address": "fa:16:3e:50:6f:2d", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7f3393-fe", "ovs_interfaceid": "4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Start _get_guest_xml network_info=[{"id": "4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6", "address": "fa:16:3e:50:6f:2d", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7f3393-fe", "ovs_interfaceid": "4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:55:59Z,direct_url=<?>,disk_format='qcow2',id=dd37b38e-c03a-412e-96fc-c296d19c2399,min_disk=0,min_ram=0,name='tempest-scenario-img--1822493877',owner='718e3cb41d5342069cd73b96bade97e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:56:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'dd37b38e-c03a-412e-96fc-c296d19c2399'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:56:06 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:56:06 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:55:59Z,direct_url=<?>,disk_format='qcow2',id=dd37b38e-c03a-412e-96fc-c296d19c2399,min_disk=0,min_ram=0,name='tempest-scenario-img--1822493877',owner='718e3cb41d5342069cd73b96bade97e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:56:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:56:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-649658045',display_name='tempest-TestMinimumBasicScenario-server-649658045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-649658045',id=36,image_ref='dd37b38e-c03a-412e-96fc-c296d19c2399',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIR6WrKTQc87JvDvGA6RP7PEin63Ysd2MRaez9o8vAjF3n9YEN6qsw7K36Gf596EaWwz/c2ujq8m12/Zv3hB9OEZbdgdidX8h9j8mwXl6ETw1+aJV7H3lKsipmUQp9MxSg==',key_name='tempest-TestMinimumBasicScenario-462156163',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='718e3cb41d5342069cd73b96bade97e7',ramdisk_id='',reservation_id='r-vtsndtep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd37b38e-c03a-412e-96fc-c296d19c2399',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1112860810',owner_user_name='tempest-TestMinimumBasicScenario-1112860810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:56:04Z,user_data=None,user_id='6fd47a4b6ae846a79a378d6ed543fd1c',uuid=f9cadc09-e4ec-4d5c-a22d-912e92c09cff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6", "address": "fa:16:3e:50:6f:2d", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7f3393-fe", "ovs_interfaceid": "4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Converting VIF {"id": "4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6", "address": "fa:16:3e:50:6f:2d", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7f3393-fe", "ovs_interfaceid": "4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:6f:2d,bridge_name='br-int',has_traffic_filtering=True,id=4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6,network=Network(85684c43-d34e-47e3-a067-9c4fb1520baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b7f3393-fe') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:56:06 user nova-compute[73104]: DEBUG nova.objects.instance [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lazy-loading 'pci_devices' on Instance uuid f9cadc09-e4ec-4d5c-a22d-912e92c09cff {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:56:07 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:56:07 user nova-compute[73104]:   <uuid>f9cadc09-e4ec-4d5c-a22d-912e92c09cff</uuid>
Aug 26 08:56:07 user nova-compute[73104]:   <name>instance-00000024</name>
Aug 26 08:56:07 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:56:07 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:56:07 user nova-compute[73104]:   <metadata>
Aug 26 08:56:07 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:56:07 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:56:07 user nova-compute[73104]:       <nova:name>tempest-TestMinimumBasicScenario-server-649658045</nova:name>
Aug 26 08:56:07 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:56:06</nova:creationTime>
Aug 26 08:56:07 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:56:07 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:56:07 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:56:07 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:56:07 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:56:07 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:56:07 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:56:07 user nova-compute[73104]:       <nova:owner>
Aug 26 08:56:07 user nova-compute[73104]:         <nova:user uuid="6fd47a4b6ae846a79a378d6ed543fd1c">tempest-TestMinimumBasicScenario-1112860810-project-member</nova:user>
Aug 26 08:56:07 user nova-compute[73104]:         <nova:project uuid="718e3cb41d5342069cd73b96bade97e7">tempest-TestMinimumBasicScenario-1112860810</nova:project>
Aug 26 08:56:07 user nova-compute[73104]:       </nova:owner>
Aug 26 08:56:07 user nova-compute[73104]:       <nova:root type="image" uuid="dd37b38e-c03a-412e-96fc-c296d19c2399"/>
Aug 26 08:56:07 user nova-compute[73104]:       <nova:ports>
Aug 26 08:56:07 user nova-compute[73104]:         <nova:port uuid="4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6">
Aug 26 08:56:07 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 08:56:07 user nova-compute[73104]:         </nova:port>
Aug 26 08:56:07 user nova-compute[73104]:       </nova:ports>
Aug 26 08:56:07 user nova-compute[73104]:     </nova:instance>
Aug 26 08:56:07 user nova-compute[73104]:   </metadata>
Aug 26 08:56:07 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:56:07 user nova-compute[73104]:     <system>
Aug 26 08:56:07 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:56:07 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:56:07 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:56:07 user nova-compute[73104]:       <entry name="serial">f9cadc09-e4ec-4d5c-a22d-912e92c09cff</entry>
Aug 26 08:56:07 user nova-compute[73104]:       <entry name="uuid">f9cadc09-e4ec-4d5c-a22d-912e92c09cff</entry>
Aug 26 08:56:07 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:56:07 user nova-compute[73104]:     </system>
Aug 26 08:56:07 user nova-compute[73104]:   </sysinfo>
Aug 26 08:56:07 user nova-compute[73104]:   <os>
Aug 26 08:56:07 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:56:07 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:56:07 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:56:07 user nova-compute[73104]:   </os>
Aug 26 08:56:07 user nova-compute[73104]:   <features>
Aug 26 08:56:07 user nova-compute[73104]:     <acpi/>
Aug 26 08:56:07 user nova-compute[73104]:     <apic/>
Aug 26 08:56:07 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:56:07 user nova-compute[73104]:   </features>
Aug 26 08:56:07 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:56:07 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:56:07 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:56:07 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:56:07 user nova-compute[73104]:   </clock>
Aug 26 08:56:07 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:56:07 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:56:07 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:56:07 user nova-compute[73104]:   </cpu>
Aug 26 08:56:07 user nova-compute[73104]:   <devices>
Aug 26 08:56:07 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:56:07 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:56:07 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/f9cadc09-e4ec-4d5c-a22d-912e92c09cff/disk"/>
Aug 26 08:56:07 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:56:07 user nova-compute[73104]:     </disk>
Aug 26 08:56:07 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:56:07 user nova-compute[73104]:       <mac address="fa:16:3e:50:6f:2d"/>
Aug 26 08:56:07 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:56:07 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:56:07 user nova-compute[73104]:       <target dev="tap4b7f3393-fe"/>
Aug 26 08:56:07 user nova-compute[73104]:     </interface>
Aug 26 08:56:07 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:56:07 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/f9cadc09-e4ec-4d5c-a22d-912e92c09cff/console.log" append="off"/>
Aug 26 08:56:07 user nova-compute[73104]:     </serial>
Aug 26 08:56:07 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:56:07 user nova-compute[73104]:     <video>
Aug 26 08:56:07 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:56:07 user nova-compute[73104]:     </video>
Aug 26 08:56:07 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:56:07 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:56:07 user nova-compute[73104]:     </rng>
Aug 26 08:56:07 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:56:07 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:56:07 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:56:07 user nova-compute[73104]:     </memballoon>
Aug 26 08:56:07 user nova-compute[73104]:   </devices>
Aug 26 08:56:07 user nova-compute[73104]: </domain>
Aug 26 08:56:07 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:56:07 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:56:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-649658045',display_name='tempest-TestMinimumBasicScenario-server-649658045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-649658045',id=36,image_ref='dd37b38e-c03a-412e-96fc-c296d19c2399',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIR6WrKTQc87JvDvGA6RP7PEin63Ysd2MRaez9o8vAjF3n9YEN6qsw7K36Gf596EaWwz/c2ujq8m12/Zv3hB9OEZbdgdidX8h9j8mwXl6ETw1+aJV7H3lKsipmUQp9MxSg==',key_name='tempest-TestMinimumBasicScenario-462156163',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='718e3cb41d5342069cd73b96bade97e7',ramdisk_id='',reservation_id='r-vtsndtep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd37b38e-c03a-412e-96fc-c296d19c2399',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1112860810',owner_user_name='tempest-TestMinimumBasicScenario-1112860810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:56:04Z,user_data=None,user_id='6fd47a4b6ae846a79a378d6ed543fd1c',uuid=f9cadc09-e4ec-4d5c-a22d-912e92c09cff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6", "address": "fa:16:3e:50:6f:2d", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7f3393-fe", "ovs_interfaceid": "4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:56:07 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Converting VIF {"id": "4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6", "address": "fa:16:3e:50:6f:2d", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7f3393-fe", "ovs_interfaceid": "4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:56:07 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:6f:2d,bridge_name='br-int',has_traffic_filtering=True,id=4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6,network=Network(85684c43-d34e-47e3-a067-9c4fb1520baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b7f3393-fe') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:56:07 user nova-compute[73104]: DEBUG os_vif [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:6f:2d,bridge_name='br-int',has_traffic_filtering=True,id=4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6,network=Network(85684c43-d34e-47e3-a067-9c4fb1520baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b7f3393-fe') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:56:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:56:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:56:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b7f3393-fe, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:56:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4b7f3393-fe, col_values=(('external_ids', {'iface-id': '4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:6f:2d', 'vm-uuid': 'f9cadc09-e4ec-4d5c-a22d-912e92c09cff'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:56:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:56:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:07 user nova-compute[73104]: INFO os_vif [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:6f:2d,bridge_name='br-int',has_traffic_filtering=True,id=4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6,network=Network(85684c43-d34e-47e3-a067-9c4fb1520baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b7f3393-fe')
Aug 26 08:56:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:07 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:56:07 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] No VIF found with MAC fa:16:3e:50:6f:2d, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:56:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5d379-7e2a-415b-a0a5-530afec0b1ea/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5d379-7e2a-415b-a0a5-530afec0b1ea/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5d379-7e2a-415b-a0a5-530afec0b1ea/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5d379-7e2a-415b-a0a5-530afec0b1ea/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:08 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693040153.191887, c08a447c-e25d-4f88-b15f-0c3de12559aa => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:56:08 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] VM Stopped (Lifecycle Event)
Aug 26 08:56:08 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:56:08 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:56:08 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=7490MB free_disk=23.900917053222656GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 08:56:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:56:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:56:08 user nova-compute[73104]: DEBUG nova.compute.manager [None req-5fdc1451-dcb0-4a87-aaa5-4926d370322d None None] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:56:08 user nova-compute[73104]: DEBUG nova.compute.manager [None req-5fdc1451-dcb0-4a87-aaa5-4926d370322d None None] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:56:08 user nova-compute[73104]: INFO nova.compute.manager [None req-5fdc1451-dcb0-4a87-aaa5-4926d370322d None None] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 08:56:08 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Applying migration context for instance c08a447c-e25d-4f88-b15f-0c3de12559aa as it has an incoming, in-progress migration ab4b68e2-bb57-4dbe-ae35-63217e962a8b. Migration status is post-migrating {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 08:56:08 user nova-compute[73104]: INFO nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Updating resource usage from migration ab4b68e2-bb57-4dbe-ae35-63217e962a8b
Aug 26 08:56:08 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance b5e1f82c-5675-4c37-8ba2-44e6a341a576 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:56:08 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 3cf85d2f-de0d-4e9b-a534-98c799ae8db9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:56:08 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance bef1e493-6b2c-4688-98c2-647261feb571 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:56:08 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 33048996-d559-4b3c-9de9-39bb176c3ec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:56:08 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 945acd46-42e2-4c45-b8e5-9ea94703bc66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:56:08 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance bf35aa10-80b1-4518-88b3-63c6a11e626b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:56:08 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 6550b41d-2414-4b3e-9a50-9bba88033aae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:56:08 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 1b45635b-062b-4149-8789-9f5191132cbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:56:08 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 67c5d379-7e2a-415b-a0a5-530afec0b1ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:56:08 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 0e3fb03a-d317-4eed-ad52-d066242a13e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:56:08 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Migration ab4b68e2-bb57-4dbe-ae35-63217e962a8b is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 08:56:08 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance c08a447c-e25d-4f88-b15f-0c3de12559aa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:56:08 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance f9cadc09-e4ec-4d5c-a22d-912e92c09cff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:56:08 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 08:56:08 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 08:56:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG nova.compute.manager [req-ac9874c1-b4a3-46a5-ba92-33024bd96fbe req-98f0542a-fd49-41fd-8130-e24f83cf5850 service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Received event network-vif-plugged-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ac9874c1-b4a3-46a5-ba92-33024bd96fbe req-98f0542a-fd49-41fd-8130-e24f83cf5850 service nova] Acquiring lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ac9874c1-b4a3-46a5-ba92-33024bd96fbe req-98f0542a-fd49-41fd-8130-e24f83cf5850 service nova] Lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ac9874c1-b4a3-46a5-ba92-33024bd96fbe req-98f0542a-fd49-41fd-8130-e24f83cf5850 service nova] Lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG nova.compute.manager [req-ac9874c1-b4a3-46a5-ba92-33024bd96fbe req-98f0542a-fd49-41fd-8130-e24f83cf5850 service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] No waiting events found dispatching network-vif-plugged-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:56:09 user nova-compute[73104]: WARNING nova.compute.manager [req-ac9874c1-b4a3-46a5-ba92-33024bd96fbe req-98f0542a-fd49-41fd-8130-e24f83cf5850 service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Received unexpected event network-vif-plugged-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 for instance with vm_state building and task_state spawning.
Aug 26 08:56:09 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.978s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Starting finish_migration {{(pid=73104) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Instance directory exists: not creating {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 08:56:09 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Creating image(s)
Aug 26 08:56:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Did not create local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Ensure instance console log exists: /opt/stack/data/nova/instances/c08a447c-e25d-4f88-b15f-0c3de12559aa/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Start _get_guest_xml network_info=[{"id": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "address": "fa:16:3e:3a:b1:b8", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1986549533-network", "vif_mac": "fa:16:3e:3a:b1:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15317ff8-61", "ovs_interfaceid": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '7c86d651-e801-4a93-9be4-dea4b923b394', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pPYHBKjQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c08a447c-e25d-4f88-b15f-0c3de12559aa', 'attached_at': '2023-08-26T08:56:09.000000', 'detached_at': '', 'volume_id': 'bad36aef-53e3-49c3-9dd8-e4b9c2d65185', 'serial': 'bad36aef-53e3-49c3-9dd8-e4b9c2d65185'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:56:09 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:56:09 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:56:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pPYHBKjQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:56:09 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:56:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:56:09 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:56:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:56:09 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:56:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4455775a-1aab-46c6-89fe-88c2106181ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:56:09 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d0ea80-931b-45d6-91c2-17d5a70d30fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185] added
Aug 26 08:56:09 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[895072b2-e51e-4fb8-aac1-5bed94b90f30]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.233s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[08849511-71eb-463e-858d-1d8f941bf2cb]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pPYHBKjQ {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pPYHBKjQ" returned: 0 in 0.076s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[91978799-58ca-4e12-8195-87fd70bb1109]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pPYHBKjQ'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2cdb29-af98-477d-a0f5-68aab07df236]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:56:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:10 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[91269750-8617-407c-af3c-1283def46992]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:56:10 user nova-compute[73104]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:56:10 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 08:56:10 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:56:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:56:10 user nova-compute[73104]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:56:10 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 08:56:10 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:56:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --login" returned: 0 in 1.078s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a65bcf-d70a-4275-9429-32aaf89bc9f3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185, portal: 172.16.0.220,3260]
Aug 26 08:56:11 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185, portal: 172.16.0.220,3260] successful.
Aug 26 08:56:11 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9d884d-18e3-460d-b390-d24edfc44d76]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG nova.compute.manager [req-ded30291-dd44-4e0d-ae2f-d8a314607678 req-227917a3-464f-412f-bdf6-6e2ff588fe5f service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Received event network-vif-plugged-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ded30291-dd44-4e0d-ae2f-d8a314607678 req-227917a3-464f-412f-bdf6-6e2ff588fe5f service nova] Acquiring lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ded30291-dd44-4e0d-ae2f-d8a314607678 req-227917a3-464f-412f-bdf6-6e2ff588fe5f service nova] Lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ded30291-dd44-4e0d-ae2f-d8a314607678 req-227917a3-464f-412f-bdf6-6e2ff588fe5f service nova] Lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG nova.compute.manager [req-ded30291-dd44-4e0d-ae2f-d8a314607678 req-227917a3-464f-412f-bdf6-6e2ff588fe5f service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] No waiting events found dispatching network-vif-plugged-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:56:11 user nova-compute[73104]: WARNING nova.compute.manager [req-ded30291-dd44-4e0d-ae2f-d8a314607678 req-227917a3-464f-412f-bdf6-6e2ff588fe5f service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Received unexpected event network-vif-plugged-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 for instance with vm_state building and task_state spawning.
Aug 26 08:56:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3e7a4a-5170-4734-b6b8-8f08a9526988]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:56:11 user nova-compute[73104]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:56:11 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 08:56:11 user nova-compute[73104]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:56:11 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:56:11 user nova-compute[73104]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:56:11 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 08:56:11 user nova-compute[73104]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:56:11 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.643s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e589e65e-db23-4a36-8b2d-c39f5ee0587e]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pPYHBKjQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040171.5412982, f9cadc09-e4ec-4d5c-a22d-912e92c09cff => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:56:11 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] VM Resumed (Lifecycle Event)
Aug 26 08:56:11 user nova-compute[73104]: DEBUG nova.compute.manager [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:56:11 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Instance spawned successfully.
Aug 26 08:56:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:56:11 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:56:11 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040171.5442965, f9cadc09-e4ec-4d5c-a22d-912e92c09cff => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:56:11 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] VM Started (Lifecycle Event)
Aug 26 08:56:11 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:56:11 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:56:11 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:56:11 user nova-compute[73104]: INFO nova.compute.manager [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Took 7.80 seconds to spawn the instance on the hypervisor.
Aug 26 08:56:11 user nova-compute[73104]: DEBUG nova.compute.manager [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:56:11 user nova-compute[73104]: INFO nova.compute.manager [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Took 8.94 seconds to build instance.
Aug 26 08:56:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0237c4eb-69c4-4b8e-a601-2d3f35b967f6 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.085s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.685s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] <== connect_volume: return (2687ms) {'type': 'block', 'scsi_wwn': '23236303931633061', 'path': '/dev/sde'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236303931633061', 'path': '/dev/sde'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:53:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-437929114',display_name='tempest-ServerActionsTestOtherA-server-437929114',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-437929114',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDd7CVbfrgJk+LANTVyASPXlTQ9/WFcC61mCbmrDUGOXT5afWNcplXvZ22xaA7blYJtw8QDJAtG8f1dybdt3ItZCTVqOwov6sASWzyNlxMeQebqYtQoQd/bQsWZ9J2R2Q==',key_name='tempest-keypair-923484929',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:54:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='efb864c0a34541dca00c6dbbcea17319',ramdisk_id='',reservation_id='r-iqtdg5qf',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1245661612',owner_user_name='tempest-ServerActionsTestOtherA-1245661612-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:55:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='257343af54bd42b591e8874ef4ecf8dc',uuid=c08a447c-e25d-4f88-b15f-0c3de12559aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "address": "fa:16:3e:3a:b1:b8", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1986549533-network", "vif_mac": "fa:16:3e:3a:b1:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15317ff8-61", "ovs_interfaceid": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Converting VIF {"id": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "address": "fa:16:3e:3a:b1:b8", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1986549533-network", "vif_mac": "fa:16:3e:3a:b1:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15317ff8-61", "ovs_interfaceid": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:b1:b8,bridge_name='br-int',has_traffic_filtering=True,id=15317ff8-610b-4e0a-b0a8-ef37bb219ba8,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15317ff8-61') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:56:12 user nova-compute[73104]:   <uuid>c08a447c-e25d-4f88-b15f-0c3de12559aa</uuid>
Aug 26 08:56:12 user nova-compute[73104]:   <name>instance-0000001f</name>
Aug 26 08:56:12 user nova-compute[73104]:   <memory>2097152</memory>
Aug 26 08:56:12 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:56:12 user nova-compute[73104]:   <metadata>
Aug 26 08:56:12 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:56:12 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:56:12 user nova-compute[73104]:       <nova:name>tempest-ServerActionsTestOtherA-server-437929114</nova:name>
Aug 26 08:56:12 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:56:09</nova:creationTime>
Aug 26 08:56:12 user nova-compute[73104]:       <nova:flavor name="m1.small">
Aug 26 08:56:12 user nova-compute[73104]:         <nova:memory>2048</nova:memory>
Aug 26 08:56:12 user nova-compute[73104]:         <nova:disk>20</nova:disk>
Aug 26 08:56:12 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:56:12 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:56:12 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:56:12 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:56:12 user nova-compute[73104]:       <nova:owner>
Aug 26 08:56:12 user nova-compute[73104]:         <nova:user uuid="257343af54bd42b591e8874ef4ecf8dc">tempest-ServerActionsTestOtherA-1245661612-project-member</nova:user>
Aug 26 08:56:12 user nova-compute[73104]:         <nova:project uuid="efb864c0a34541dca00c6dbbcea17319">tempest-ServerActionsTestOtherA-1245661612</nova:project>
Aug 26 08:56:12 user nova-compute[73104]:       </nova:owner>
Aug 26 08:56:12 user nova-compute[73104]:       <nova:ports>
Aug 26 08:56:12 user nova-compute[73104]:         <nova:port uuid="15317ff8-610b-4e0a-b0a8-ef37bb219ba8">
Aug 26 08:56:12 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 08:56:12 user nova-compute[73104]:         </nova:port>
Aug 26 08:56:12 user nova-compute[73104]:       </nova:ports>
Aug 26 08:56:12 user nova-compute[73104]:     </nova:instance>
Aug 26 08:56:12 user nova-compute[73104]:   </metadata>
Aug 26 08:56:12 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:56:12 user nova-compute[73104]:     <system>
Aug 26 08:56:12 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:56:12 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:56:12 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:56:12 user nova-compute[73104]:       <entry name="serial">c08a447c-e25d-4f88-b15f-0c3de12559aa</entry>
Aug 26 08:56:12 user nova-compute[73104]:       <entry name="uuid">c08a447c-e25d-4f88-b15f-0c3de12559aa</entry>
Aug 26 08:56:12 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:56:12 user nova-compute[73104]:     </system>
Aug 26 08:56:12 user nova-compute[73104]:   </sysinfo>
Aug 26 08:56:12 user nova-compute[73104]:   <os>
Aug 26 08:56:12 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:56:12 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:56:12 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:56:12 user nova-compute[73104]:   </os>
Aug 26 08:56:12 user nova-compute[73104]:   <features>
Aug 26 08:56:12 user nova-compute[73104]:     <acpi/>
Aug 26 08:56:12 user nova-compute[73104]:     <apic/>
Aug 26 08:56:12 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:56:12 user nova-compute[73104]:   </features>
Aug 26 08:56:12 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:56:12 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:56:12 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:56:12 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:56:12 user nova-compute[73104]:   </clock>
Aug 26 08:56:12 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:56:12 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:56:12 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:56:12 user nova-compute[73104]:   </cpu>
Aug 26 08:56:12 user nova-compute[73104]:   <devices>
Aug 26 08:56:12 user nova-compute[73104]:     <disk type="block" device="disk">
Aug 26 08:56:12 user nova-compute[73104]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:56:12 user nova-compute[73104]:       <source dev="/dev/sde"/>
Aug 26 08:56:12 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:56:12 user nova-compute[73104]:       <serial>bad36aef-53e3-49c3-9dd8-e4b9c2d65185</serial>
Aug 26 08:56:12 user nova-compute[73104]:     </disk>
Aug 26 08:56:12 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:56:12 user nova-compute[73104]:       <mac address="fa:16:3e:3a:b1:b8"/>
Aug 26 08:56:12 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:56:12 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:56:12 user nova-compute[73104]:       <target dev="tap15317ff8-61"/>
Aug 26 08:56:12 user nova-compute[73104]:     </interface>
Aug 26 08:56:12 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:56:12 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/c08a447c-e25d-4f88-b15f-0c3de12559aa/console.log" append="off"/>
Aug 26 08:56:12 user nova-compute[73104]:     </serial>
Aug 26 08:56:12 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:56:12 user nova-compute[73104]:     <video>
Aug 26 08:56:12 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:56:12 user nova-compute[73104]:     </video>
Aug 26 08:56:12 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:56:12 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:56:12 user nova-compute[73104]:     </rng>
Aug 26 08:56:12 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:56:12 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:56:12 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:56:12 user nova-compute[73104]:     </memballoon>
Aug 26 08:56:12 user nova-compute[73104]:   </devices>
Aug 26 08:56:12 user nova-compute[73104]: </domain>
Aug 26 08:56:12 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:53:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-437929114',display_name='tempest-ServerActionsTestOtherA-server-437929114',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-437929114',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDd7CVbfrgJk+LANTVyASPXlTQ9/WFcC61mCbmrDUGOXT5afWNcplXvZ22xaA7blYJtw8QDJAtG8f1dybdt3ItZCTVqOwov6sASWzyNlxMeQebqYtQoQd/bQsWZ9J2R2Q==',key_name='tempest-keypair-923484929',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:54:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='efb864c0a34541dca00c6dbbcea17319',ramdisk_id='',reservation_id='r-iqtdg5qf',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1245661612',owner_user_name='tempest-ServerActionsTestOtherA-1245661612-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:55:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='257343af54bd42b591e8874ef4ecf8dc',uuid=c08a447c-e25d-4f88-b15f-0c3de12559aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "address": "fa:16:3e:3a:b1:b8", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1986549533-network", "vif_mac": "fa:16:3e:3a:b1:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15317ff8-61", "ovs_interfaceid": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Converting VIF {"id": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "address": "fa:16:3e:3a:b1:b8", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1986549533-network", "vif_mac": "fa:16:3e:3a:b1:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15317ff8-61", "ovs_interfaceid": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:b1:b8,bridge_name='br-int',has_traffic_filtering=True,id=15317ff8-610b-4e0a-b0a8-ef37bb219ba8,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15317ff8-61') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG os_vif [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:b1:b8,bridge_name='br-int',has_traffic_filtering=True,id=15317ff8-610b-4e0a-b0a8-ef37bb219ba8,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15317ff8-61') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15317ff8-61, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap15317ff8-61, col_values=(('external_ids', {'iface-id': '15317ff8-610b-4e0a-b0a8-ef37bb219ba8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:b1:b8', 'vm-uuid': 'c08a447c-e25d-4f88-b15f-0c3de12559aa'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:12 user nova-compute[73104]: INFO os_vif [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:b1:b8,bridge_name='br-int',has_traffic_filtering=True,id=15317ff8-610b-4e0a-b0a8-ef37bb219ba8,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15317ff8-61')
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] No VIF found with MAC fa:16:3e:3a:b1:b8, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-3cf85d2f-de0d-4e9b-a534-98c799ae8db9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-3cf85d2f-de0d-4e9b-a534-98c799ae8db9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oIDFWPhy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:56:12 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:56:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:56:12 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:56:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:56:12 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bf6601-093f-43cf-89d8-54659d4d7f93]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:56:12 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fee3f3-5332-43d6-bd50-e34cf9ce1f3e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2] added
Aug 26 08:56:12 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ef42b4-6f4c-4abd-8a99-80aa7592d4b7]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d61a800-f832-411c-8925-8505567de008]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oIDFWPhy {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oIDFWPhy" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[319da2b3-af61-4a00-bf2f-27101742c652]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oIDFWPhy'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c7b907-288c-48ea-a198-341cc0dd5bb6]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ed04bd-2247-4eaf-8bf3-b3871292cc96]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:56:12 user nova-compute[73104]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:56:12 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 08:56:12 user nova-compute[73104]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:56:12 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:56:12 user nova-compute[73104]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:56:12 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 08:56:12 user nova-compute[73104]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:56:12 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[76abc60a-e27c-4cae-9ada-7b3ffefb7cb7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2, portal: 172.16.0.220,3260]
Aug 26 08:56:12 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2, portal: 172.16.0.220,3260] successful.
Aug 26 08:56:12 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae3daf2-fc7e-4667-b02a-76178a8c8468]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b492b5c0-aa41-4cfa-8521-365eb8714425]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:56:12 user nova-compute[73104]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:56:12 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 08:56:12 user nova-compute[73104]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:56:12 user nova-compute[73104]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2 (non-flash)
Aug 26 08:56:12 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:56:12 user nova-compute[73104]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:56:12 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 08:56:12 user nova-compute[73104]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:56:12 user nova-compute[73104]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2 (non-flash)
Aug 26 08:56:12 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] HCTL ('37', '-', '-', 0) found on session 40 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3ee160-8642-4741-9116-1bb08bda2616]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Searching for a device in session 40 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:56:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oIDFWPhy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:56:13 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Updating instance_info_cache with network_info: [{"id": "1ff011d7-db1c-4bac-a2d3-ecf253085265", "address": "fa:16:3e:72:e3:65", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff011d7-db", "ovs_interfaceid": "1ff011d7-db1c-4bac-a2d3-ecf253085265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:56:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-3cf85d2f-de0d-4e9b-a534-98c799ae8db9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:56:13 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 08:56:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:56:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23633306466393361', 'path': '/dev/sdf'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:56:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633306466393361', 'path': '/dev/sdf'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:56:13 user nova-compute[73104]: DEBUG nova.objects.instance [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Lazy-loading 'flavor' on Instance uuid 6550b41d-2414-4b3e-9a50-9bba88033aae {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:56:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 08:56:13 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:56:13 user nova-compute[73104]:   <source dev="/dev/sdf"/>
Aug 26 08:56:13 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:56:13 user nova-compute[73104]:   <serial>43268837-59fe-4c94-afa5-f35112afbca2</serial>
Aug 26 08:56:13 user nova-compute[73104]: </disk>
Aug 26 08:56:13 user nova-compute[73104]:  {{(pid=73104) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 08:56:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:13 user nova-compute[73104]: DEBUG nova.compute.manager [req-fcc75d22-d5ca-4ce7-8eac-f54a622c6ad0 req-511fd33f-c78d-4c74-923f-66a0152502f0 service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Received event network-vif-plugged-15317ff8-610b-4e0a-b0a8-ef37bb219ba8 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:56:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-fcc75d22-d5ca-4ce7-8eac-f54a622c6ad0 req-511fd33f-c78d-4c74-923f-66a0152502f0 service nova] Acquiring lock "c08a447c-e25d-4f88-b15f-0c3de12559aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:56:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-fcc75d22-d5ca-4ce7-8eac-f54a622c6ad0 req-511fd33f-c78d-4c74-923f-66a0152502f0 service nova] Lock "c08a447c-e25d-4f88-b15f-0c3de12559aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:56:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-fcc75d22-d5ca-4ce7-8eac-f54a622c6ad0 req-511fd33f-c78d-4c74-923f-66a0152502f0 service nova] Lock "c08a447c-e25d-4f88-b15f-0c3de12559aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:56:13 user nova-compute[73104]: DEBUG nova.compute.manager [req-fcc75d22-d5ca-4ce7-8eac-f54a622c6ad0 req-511fd33f-c78d-4c74-923f-66a0152502f0 service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] No waiting events found dispatching network-vif-plugged-15317ff8-610b-4e0a-b0a8-ef37bb219ba8 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:56:13 user nova-compute[73104]: WARNING nova.compute.manager [req-fcc75d22-d5ca-4ce7-8eac-f54a622c6ad0 req-511fd33f-c78d-4c74-923f-66a0152502f0 service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Received unexpected event network-vif-plugged-15317ff8-610b-4e0a-b0a8-ef37bb219ba8 for instance with vm_state active and task_state resize_finish.
Aug 26 08:56:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:56:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:56:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] No VIF found with MAC fa:16:3e:7f:fb:55, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:56:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0575c9fd-e29a-43bb-8a57-db4adcfe5d27 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Lock "6550b41d-2414-4b3e-9a50-9bba88033aae" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.399s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:56:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-b182d92b-c0c8-4260-abcc-dc211e1c284d req-a09cc2d0-4ad3-4bae-981e-3f34af6cf5cf service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Received event network-vif-plugged-15317ff8-610b-4e0a-b0a8-ef37bb219ba8 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:56:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b182d92b-c0c8-4260-abcc-dc211e1c284d req-a09cc2d0-4ad3-4bae-981e-3f34af6cf5cf service nova] Acquiring lock "c08a447c-e25d-4f88-b15f-0c3de12559aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:56:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b182d92b-c0c8-4260-abcc-dc211e1c284d req-a09cc2d0-4ad3-4bae-981e-3f34af6cf5cf service nova] Lock "c08a447c-e25d-4f88-b15f-0c3de12559aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:56:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b182d92b-c0c8-4260-abcc-dc211e1c284d req-a09cc2d0-4ad3-4bae-981e-3f34af6cf5cf service nova] Lock "c08a447c-e25d-4f88-b15f-0c3de12559aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:56:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-b182d92b-c0c8-4260-abcc-dc211e1c284d req-a09cc2d0-4ad3-4bae-981e-3f34af6cf5cf service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] No waiting events found dispatching network-vif-plugged-15317ff8-610b-4e0a-b0a8-ef37bb219ba8 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:56:16 user nova-compute[73104]: WARNING nova.compute.manager [req-b182d92b-c0c8-4260-abcc-dc211e1c284d req-a09cc2d0-4ad3-4bae-981e-3f34af6cf5cf service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Received unexpected event network-vif-plugged-15317ff8-610b-4e0a-b0a8-ef37bb219ba8 for instance with vm_state active and task_state resize_finish.
Aug 26 08:56:16 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040176.946199, c08a447c-e25d-4f88-b15f-0c3de12559aa => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:56:16 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] VM Resumed (Lifecycle Event)
Aug 26 08:56:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:56:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:56:16 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Instance running successfully.
Aug 26 08:56:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Failed to set time: agent not configured {{(pid=73104) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 26 08:56:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ad3c7dd3-3ecb-43c6-8d8c-0abdf29697d7 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] finish_migration finished successfully. {{(pid=73104) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 26 08:56:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:56:17 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 08:56:17 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040176.9499676, c08a447c-e25d-4f88-b15f-0c3de12559aa => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:56:17 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] VM Started (Lifecycle Event)
Aug 26 08:56:17 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:56:17 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:56:17 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 08:56:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-faaa4594-a69a-4107-a4e7-923487e03d25 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Acquiring lock "6550b41d-2414-4b3e-9a50-9bba88033aae" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:56:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-faaa4594-a69a-4107-a4e7-923487e03d25 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Lock "6550b41d-2414-4b3e-9a50-9bba88033aae" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:56:17 user nova-compute[73104]: INFO nova.compute.manager [None req-faaa4594-a69a-4107-a4e7-923487e03d25 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Detaching volume 43268837-59fe-4c94-afa5-f35112afbca2
Aug 26 08:56:17 user nova-compute[73104]: INFO nova.virt.block_device [None req-faaa4594-a69a-4107-a4e7-923487e03d25 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Attempting to driver detach volume 43268837-59fe-4c94-afa5-f35112afbca2 from mountpoint /dev/vdb
Aug 26 08:56:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-faaa4594-a69a-4107-a4e7-923487e03d25 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Attempting to detach device vdb from instance 6550b41d-2414-4b3e-9a50-9bba88033aae from the persistent domain config. {{(pid=73104) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 08:56:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-faaa4594-a69a-4107-a4e7-923487e03d25 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:56:17 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:56:17 user nova-compute[73104]:   <source dev="/dev/sdf"/>
Aug 26 08:56:17 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:56:17 user nova-compute[73104]:   <serial>43268837-59fe-4c94-afa5-f35112afbca2</serial>
Aug 26 08:56:17 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 08:56:17 user nova-compute[73104]: </disk>
Aug 26 08:56:17 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:56:17 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-faaa4594-a69a-4107-a4e7-923487e03d25 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Successfully detached device vdb from instance 6550b41d-2414-4b3e-9a50-9bba88033aae from the persistent domain config.
Aug 26 08:56:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-faaa4594-a69a-4107-a4e7-923487e03d25 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6550b41d-2414-4b3e-9a50-9bba88033aae from the live domain config. {{(pid=73104) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 08:56:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-faaa4594-a69a-4107-a4e7-923487e03d25 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:56:17 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:56:17 user nova-compute[73104]:   <source dev="/dev/sdf"/>
Aug 26 08:56:17 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:56:17 user nova-compute[73104]:   <serial>43268837-59fe-4c94-afa5-f35112afbca2</serial>
Aug 26 08:56:17 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 08:56:17 user nova-compute[73104]: </disk>
Aug 26 08:56:17 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Received event <DeviceRemovedEvent: 1693040178.2102578, 6550b41d-2414-4b3e-9a50-9bba88033aae => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73104) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-faaa4594-a69a-4107-a4e7-923487e03d25 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6550b41d-2414-4b3e-9a50-9bba88033aae {{(pid=73104) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 08:56:18 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-faaa4594-a69a-4107-a4e7-923487e03d25 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Successfully detached device vdb from instance 6550b41d-2414-4b3e-9a50-9bba88033aae from the live domain config.
Aug 26 08:56:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faaa4594-a69a-4107-a4e7-923487e03d25 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-faaa4594-a69a-4107-a4e7-923487e03d25 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oIDFWPhy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:56:18 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-faaa4594-a69a-4107-a4e7-923487e03d25 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:56:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-faaa4594-a69a-4107-a4e7-923487e03d25 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-faaa4594-a69a-4107-a4e7-923487e03d25 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-faaa4594-a69a-4107-a4e7-923487e03d25 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a682b5e-000b-4d6e-b284-af4399128eec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[03aecc8d-2266-4596-ab80-af8cfef3012e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-faaa4594-a69a-4107-a4e7-923487e03d25 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:56:18 user nova-compute[73104]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:56:18 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 08:56:18 user nova-compute[73104]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:56:18 user nova-compute[73104]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2 (non-flash)
Aug 26 08:56:18 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-faaa4594-a69a-4107-a4e7-923487e03d25 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:56:18 user nova-compute[73104]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:56:18 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 08:56:18 user nova-compute[73104]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:56:18 user nova-compute[73104]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2 (non-flash)
Aug 26 08:56:18 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-faaa4594-a69a-4107-a4e7-923487e03d25 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0c41a1c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2'): ({'sdf'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-faaa4594-a69a-4107-a4e7-923487e03d25 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Removing single pathed devices sdf {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6d995a-45cd-40a7-9fca-c0315578132e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[988918f4-5780-4006-ab3c-ced8640bb8c9]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-faaa4594-a69a-4107-a4e7-923487e03d25 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Flushing IO for device /dev/sdf {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a752362a-0b05-42ef-b4a7-30061d366e91]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-faaa4594-a69a-4107-a4e7-923487e03d25 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.053s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4938f042-def8-4e70-97ba-6feb5b4a870b]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-faaa4594-a69a-4107-a4e7-923487e03d25 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-faaa4594-a69a-4107-a4e7-923487e03d25 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] SCSI volumes sdf have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-faaa4594-a69a-4107-a4e7-923487e03d25 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b54c68f-7ba2-4f3d-a0f0-5caa73f4ccb2]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-faaa4594-a69a-4107-a4e7-923487e03d25 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5beb566-c323-4b0a-822f-edb5e2429d66]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-faaa4594-a69a-4107-a4e7-923487e03d25 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2, portal: 172.16.0.220,3260]
Aug 26 08:56:18 user nova-compute[73104]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2, portal: 172.16.0.220,3260] successful.
Aug 26 08:56:18 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43268837-59fe-4c94-afa5-f35112afbca2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd2593c-5676-472f-ba74-ac0a624f8fc8]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-faaa4594-a69a-4107-a4e7-923487e03d25 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-faaa4594-a69a-4107-a4e7-923487e03d25 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-faaa4594-a69a-4107-a4e7-923487e03d25 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] <== disconnect_volume: return (338ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:56:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faaa4594-a69a-4107-a4e7-923487e03d25 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:56:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:19 user nova-compute[73104]: DEBUG nova.objects.instance [None req-faaa4594-a69a-4107-a4e7-923487e03d25 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Lazy-loading 'flavor' on Instance uuid 6550b41d-2414-4b3e-9a50-9bba88033aae {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:56:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-faaa4594-a69a-4107-a4e7-923487e03d25 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Lock "6550b41d-2414-4b3e-9a50-9bba88033aae" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.130s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:56:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:56:58 user nova-compute[73104]: DEBUG nova.compute.manager [req-b6f44e28-439e-41fd-8d4e-b3265e53d34e req-0dbf05c4-6fc0-4bd5-ae4e-04a26ffb8003 service nova] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Received event network-changed-3c47a327-42ad-484a-8cf8-33e131233bcd {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:56:58 user nova-compute[73104]: DEBUG nova.compute.manager [req-b6f44e28-439e-41fd-8d4e-b3265e53d34e req-0dbf05c4-6fc0-4bd5-ae4e-04a26ffb8003 service nova] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Refreshing instance network info cache due to event network-changed-3c47a327-42ad-484a-8cf8-33e131233bcd. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:56:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b6f44e28-439e-41fd-8d4e-b3265e53d34e req-0dbf05c4-6fc0-4bd5-ae4e-04a26ffb8003 service nova] Acquiring lock "refresh_cache-1b45635b-062b-4149-8789-9f5191132cbd" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:56:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b6f44e28-439e-41fd-8d4e-b3265e53d34e req-0dbf05c4-6fc0-4bd5-ae4e-04a26ffb8003 service nova] Acquired lock "refresh_cache-1b45635b-062b-4149-8789-9f5191132cbd" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:56:58 user nova-compute[73104]: DEBUG nova.network.neutron [req-b6f44e28-439e-41fd-8d4e-b3265e53d34e req-0dbf05c4-6fc0-4bd5-ae4e-04a26ffb8003 service nova] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Refreshing network info cache for port 3c47a327-42ad-484a-8cf8-33e131233bcd {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:56:58 user nova-compute[73104]: DEBUG nova.network.neutron [req-b6f44e28-439e-41fd-8d4e-b3265e53d34e req-0dbf05c4-6fc0-4bd5-ae4e-04a26ffb8003 service nova] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Updated VIF entry in instance network info cache for port 3c47a327-42ad-484a-8cf8-33e131233bcd. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:56:58 user nova-compute[73104]: DEBUG nova.network.neutron [req-b6f44e28-439e-41fd-8d4e-b3265e53d34e req-0dbf05c4-6fc0-4bd5-ae4e-04a26ffb8003 service nova] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Updating instance_info_cache with network_info: [{"id": "3c47a327-42ad-484a-8cf8-33e131233bcd", "address": "fa:16:3e:0a:fc:e5", "network": {"id": "bb0ed7b6-f1d2-41e5-b975-926555200ac9", "bridge": "br-int", "label": "tempest-TestStampPattern-89239905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f8b4744aa5450ca396714b74a01049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c47a327-42", "ovs_interfaceid": "3c47a327-42ad-484a-8cf8-33e131233bcd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:56:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b6f44e28-439e-41fd-8d4e-b3265e53d34e req-0dbf05c4-6fc0-4bd5-ae4e-04a26ffb8003 service nova] Releasing lock "refresh_cache-1b45635b-062b-4149-8789-9f5191132cbd" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:56:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Acquiring lock "1b45635b-062b-4149-8789-9f5191132cbd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:56:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "1b45635b-062b-4149-8789-9f5191132cbd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:56:58 user nova-compute[73104]: DEBUG nova.objects.instance [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lazy-loading 'flavor' on Instance uuid 1b45635b-062b-4149-8789-9f5191132cbd {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:56:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "1b45635b-062b-4149-8789-9f5191132cbd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:56:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Acquiring lock "1b45635b-062b-4149-8789-9f5191132cbd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:56:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "1b45635b-062b-4149-8789-9f5191132cbd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:56:58 user nova-compute[73104]: INFO nova.compute.manager [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Attaching volume f6b86f5d-000b-45c3-9fdb-7d3bcb794b56 to /dev/vdb
Aug 26 08:56:58 user nova-compute[73104]: DEBUG os_brick.utils [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:56:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:58 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f312dc3c-2671-437f-9914-51ef4be183c1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:58 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ca005b-f46b-453a-8c16-b03052fcc578]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:56:59 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[65285c35-fa7a-4183-94fd-52eae4cade1a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:59 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e6c0ed-ed4f-4e44-a0ea-44c19bff1490]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:56:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:56:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:56:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:56:59 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:56:59 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cd78e2-744f-4918-87dc-f07bcf48791b]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:56:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:56:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:56:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:56:59 user nova-compute[73104]: DEBUG os_brick.utils [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:56:59 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Updating existing volume attachment record: 462ceddc-ecb2-40b8-9654-2b1cf302dea2 {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 08:56:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:00 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:57:00 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:57:01 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:57:01 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 08:57:02 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:57:02 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:57:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:03 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:57:03 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:57:03 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:57:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:57:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:57:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:57:03 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 08:57:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b45635b-062b-4149-8789-9f5191132cbd/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b45635b-062b-4149-8789-9f5191132cbd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b45635b-062b-4149-8789-9f5191132cbd/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b45635b-062b-4149-8789-9f5191132cbd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:04 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:57:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:04 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:57:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6550b41d-2414-4b3e-9a50-9bba88033aae/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6550b41d-2414-4b3e-9a50-9bba88033aae/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6550b41d-2414-4b3e-9a50-9bba88033aae/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6550b41d-2414-4b3e-9a50-9bba88033aae/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:04 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:57:04 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:57:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5d379-7e2a-415b-a0a5-530afec0b1ea/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5d379-7e2a-415b-a0a5-530afec0b1ea/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5d379-7e2a-415b-a0a5-530afec0b1ea/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5d379-7e2a-415b-a0a5-530afec0b1ea/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9cadc09-e4ec-4d5c-a22d-912e92c09cff/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9cadc09-e4ec-4d5c-a22d-912e92c09cff/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9cadc09-e4ec-4d5c-a22d-912e92c09cff/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9cadc09-e4ec-4d5c-a22d-912e92c09cff/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:07 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:57:07 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:57:07 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=7132MB free_disk=23.828941345214844GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 08:57:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:57:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:57:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:07 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Applying migration context for instance c08a447c-e25d-4f88-b15f-0c3de12559aa as it has an incoming, in-progress migration ab4b68e2-bb57-4dbe-ae35-63217e962a8b. Migration status is finished {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 08:57:07 user nova-compute[73104]: INFO nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Updating resource usage from migration ab4b68e2-bb57-4dbe-ae35-63217e962a8b
Aug 26 08:57:07 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance b5e1f82c-5675-4c37-8ba2-44e6a341a576 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:57:07 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 3cf85d2f-de0d-4e9b-a534-98c799ae8db9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:57:07 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance bef1e493-6b2c-4688-98c2-647261feb571 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:57:07 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 33048996-d559-4b3c-9de9-39bb176c3ec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:57:07 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 945acd46-42e2-4c45-b8e5-9ea94703bc66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:57:07 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance bf35aa10-80b1-4518-88b3-63c6a11e626b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:57:07 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 6550b41d-2414-4b3e-9a50-9bba88033aae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:57:07 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 1b45635b-062b-4149-8789-9f5191132cbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:57:07 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 67c5d379-7e2a-415b-a0a5-530afec0b1ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:57:07 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 0e3fb03a-d317-4eed-ad52-d066242a13e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:57:07 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Migration ab4b68e2-bb57-4dbe-ae35-63217e962a8b is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 08:57:07 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance c08a447c-e25d-4f88-b15f-0c3de12559aa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:57:07 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance f9cadc09-e4ec-4d5c-a22d-912e92c09cff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:57:07 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 08:57:07 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 08:57:07 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:57:07 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:57:07 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 08:57:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.638s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:57:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oJzwPfDa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:57:10 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:57:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:57:10 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:57:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:57:10 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:57:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d97056-0bf9-4738-8fe3-f19c4cbfd52c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:57:10 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05a4314-816d-4251-8fb2-e3242a469533]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56] added
Aug 26 08:57:10 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb8f2fa-67b1-4cc9-8272-7cd40d6b4b70]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d5e614-d33d-4774-a264-c9c4bfa7382a]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oJzwPfDa {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oJzwPfDa" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4baefdc-5667-4c1f-92af-a925a3b4af31]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oJzwPfDa'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c414576f-2c7d-4b5b-a8ec-b3d5b3d40b5e]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdeaea52-8523-4451-ae60-b4232e68b06a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:57:10 user nova-compute[73104]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:57:10 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 08:57:10 user nova-compute[73104]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:57:10 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:57:10 user nova-compute[73104]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:57:10 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 08:57:10 user nova-compute[73104]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:57:10 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fa0b33-655e-4f26-91f2-db229d0d0e42]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56, portal: 172.16.0.220,3260]
Aug 26 08:57:10 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56, portal: 172.16.0.220,3260] successful.
Aug 26 08:57:10 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ab8edb-970e-45a3-be89-15b2c99ea852]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7593e1-6241-411b-a9b8-2dcbebc2b39e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:57:10 user nova-compute[73104]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:57:10 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 08:57:10 user nova-compute[73104]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:57:10 user nova-compute[73104]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56 (non-flash)
Aug 26 08:57:10 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:57:10 user nova-compute[73104]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:57:10 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 08:57:10 user nova-compute[73104]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:57:10 user nova-compute[73104]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56 (non-flash)
Aug 26 08:57:10 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] HCTL ('37', '-', '-', 0) found on session 41 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3dd39e-2378-4894-a97d-2081847e521c]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:10 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Searching for a device in session 41 and hctl ['37', '*', '*', 0] yield: None {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:57:11 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Searching for a device in session 41 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:57:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oJzwPfDa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:57:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:57:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23062636463393833', 'path': '/dev/sdf'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:57:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062636463393833', 'path': '/dev/sdf'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:57:11 user nova-compute[73104]: DEBUG nova.objects.instance [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lazy-loading 'flavor' on Instance uuid 1b45635b-062b-4149-8789-9f5191132cbd {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:57:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 08:57:11 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:57:11 user nova-compute[73104]:   <source dev="/dev/sdf"/>
Aug 26 08:57:11 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:57:11 user nova-compute[73104]:   <serial>f6b86f5d-000b-45c3-9fdb-7d3bcb794b56</serial>
Aug 26 08:57:11 user nova-compute[73104]: </disk>
Aug 26 08:57:11 user nova-compute[73104]:  {{(pid=73104) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 08:57:11 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:57:11 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:57:11 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 08:57:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:57:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:57:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] No VIF found with MAC fa:16:3e:0a:fc:e5, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:57:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-bef1e493-6b2c-4688-98c2-647261feb571" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:57:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-bef1e493-6b2c-4688-98c2-647261feb571" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:57:11 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 08:57:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ac017589-e05d-44b8-9886-63e012148ab3 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "1b45635b-062b-4149-8789-9f5191132cbd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.165s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:57:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:12 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Updating instance_info_cache with network_info: [{"id": "6ddebd25-cfe6-4b0e-8b2d-746fae9f8685", "address": "fa:16:3e:03:fd:b2", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddebd25-cf", "ovs_interfaceid": "6ddebd25-cfe6-4b0e-8b2d-746fae9f8685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:57:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-bef1e493-6b2c-4688-98c2-647261feb571" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:57:12 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 08:57:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-114e564c-0525-4239-a6b8-b8f8b236dfb1 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Acquiring lock "1b45635b-062b-4149-8789-9f5191132cbd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:57:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-114e564c-0525-4239-a6b8-b8f8b236dfb1 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "1b45635b-062b-4149-8789-9f5191132cbd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:57:13 user nova-compute[73104]: INFO nova.compute.manager [None req-114e564c-0525-4239-a6b8-b8f8b236dfb1 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Detaching volume f6b86f5d-000b-45c3-9fdb-7d3bcb794b56
Aug 26 08:57:14 user nova-compute[73104]: INFO nova.virt.block_device [None req-114e564c-0525-4239-a6b8-b8f8b236dfb1 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Attempting to driver detach volume f6b86f5d-000b-45c3-9fdb-7d3bcb794b56 from mountpoint /dev/vdb
Aug 26 08:57:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-114e564c-0525-4239-a6b8-b8f8b236dfb1 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Attempting to detach device vdb from instance 1b45635b-062b-4149-8789-9f5191132cbd from the persistent domain config. {{(pid=73104) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-114e564c-0525-4239-a6b8-b8f8b236dfb1 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:57:14 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:57:14 user nova-compute[73104]:   <source dev="/dev/sdf"/>
Aug 26 08:57:14 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:57:14 user nova-compute[73104]:   <serial>f6b86f5d-000b-45c3-9fdb-7d3bcb794b56</serial>
Aug 26 08:57:14 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 08:57:14 user nova-compute[73104]: </disk>
Aug 26 08:57:14 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:57:14 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-114e564c-0525-4239-a6b8-b8f8b236dfb1 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Successfully detached device vdb from instance 1b45635b-062b-4149-8789-9f5191132cbd from the persistent domain config.
Aug 26 08:57:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-114e564c-0525-4239-a6b8-b8f8b236dfb1 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1b45635b-062b-4149-8789-9f5191132cbd from the live domain config. {{(pid=73104) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-114e564c-0525-4239-a6b8-b8f8b236dfb1 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:57:14 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:57:14 user nova-compute[73104]:   <source dev="/dev/sdf"/>
Aug 26 08:57:14 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:57:14 user nova-compute[73104]:   <serial>f6b86f5d-000b-45c3-9fdb-7d3bcb794b56</serial>
Aug 26 08:57:14 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 08:57:14 user nova-compute[73104]: </disk>
Aug 26 08:57:14 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-48a3ddbe-b680-4bfe-9938-5380a0379c9d tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Acquiring lock "6550b41d-2414-4b3e-9a50-9bba88033aae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-48a3ddbe-b680-4bfe-9938-5380a0379c9d tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Lock "6550b41d-2414-4b3e-9a50-9bba88033aae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-48a3ddbe-b680-4bfe-9938-5380a0379c9d tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Acquiring lock "6550b41d-2414-4b3e-9a50-9bba88033aae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-48a3ddbe-b680-4bfe-9938-5380a0379c9d tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Lock "6550b41d-2414-4b3e-9a50-9bba88033aae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-48a3ddbe-b680-4bfe-9938-5380a0379c9d tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Lock "6550b41d-2414-4b3e-9a50-9bba88033aae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:57:14 user nova-compute[73104]: INFO nova.compute.manager [None req-48a3ddbe-b680-4bfe-9938-5380a0379c9d tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Terminating instance
Aug 26 08:57:14 user nova-compute[73104]: DEBUG nova.compute.manager [None req-48a3ddbe-b680-4bfe-9938-5380a0379c9d tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Received event <DeviceRemovedEvent: 1693040234.563199, 1b45635b-062b-4149-8789-9f5191132cbd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73104) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-114e564c-0525-4239-a6b8-b8f8b236dfb1 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1b45635b-062b-4149-8789-9f5191132cbd {{(pid=73104) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 08:57:14 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-114e564c-0525-4239-a6b8-b8f8b236dfb1 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Successfully detached device vdb from instance 1b45635b-062b-4149-8789-9f5191132cbd from the live domain config.
Aug 26 08:57:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-114e564c-0525-4239-a6b8-b8f8b236dfb1 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-114e564c-0525-4239-a6b8-b8f8b236dfb1 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oJzwPfDa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:57:14 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-114e564c-0525-4239-a6b8-b8f8b236dfb1 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:57:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-114e564c-0525-4239-a6b8-b8f8b236dfb1 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-114e564c-0525-4239-a6b8-b8f8b236dfb1 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-114e564c-0525-4239-a6b8-b8f8b236dfb1 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[750beb7c-a935-4dc6-b33e-5189fe5a748a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b545cc35-8711-4c96-99b2-700c4136e16e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-114e564c-0525-4239-a6b8-b8f8b236dfb1 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:57:14 user nova-compute[73104]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:57:14 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 08:57:14 user nova-compute[73104]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:57:14 user nova-compute[73104]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56 (non-flash)
Aug 26 08:57:14 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-114e564c-0525-4239-a6b8-b8f8b236dfb1 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:57:14 user nova-compute[73104]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:57:14 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 08:57:14 user nova-compute[73104]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:57:14 user nova-compute[73104]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56 (non-flash)
Aug 26 08:57:14 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-114e564c-0525-4239-a6b8-b8f8b236dfb1 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0cc2c6440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56'): ({'sdf'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-114e564c-0525-4239-a6b8-b8f8b236dfb1 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Removing single pathed devices sdf {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[032bc026-0ce9-486c-b68f-053e8ac13ffc]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d942f38b-bc68-45f8-97e1-ebc36a1e32a8]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-114e564c-0525-4239-a6b8-b8f8b236dfb1 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Flushing IO for device /dev/sdf {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.032s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b873bd4-d248-49f2-b5be-0a0f392a2eba]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-114e564c-0525-4239-a6b8-b8f8b236dfb1 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6540845d-c9b7-4565-a609-d4e93a04e180]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-114e564c-0525-4239-a6b8-b8f8b236dfb1 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-114e564c-0525-4239-a6b8-b8f8b236dfb1 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] SCSI volumes sdf have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-114e564c-0525-4239-a6b8-b8f8b236dfb1 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6eefeee-d7d2-48b3-89cc-435a4a843e30]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-114e564c-0525-4239-a6b8-b8f8b236dfb1 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56 -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[327d08c6-c316-4338-bfcc-770b3e4a1713]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-114e564c-0525-4239-a6b8-b8f8b236dfb1 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56, portal: 172.16.0.220,3260]
Aug 26 08:57:14 user nova-compute[73104]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56, portal: 172.16.0.220,3260] successful.
Aug 26 08:57:14 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6b86f5d-000b-45c3-9fdb-7d3bcb794b56 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[12083dfe-9417-4563-a2ae-62c41ee507e6]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-114e564c-0525-4239-a6b8-b8f8b236dfb1 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-114e564c-0525-4239-a6b8-b8f8b236dfb1 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-114e564c-0525-4239-a6b8-b8f8b236dfb1 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] <== disconnect_volume: return (366ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:57:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-114e564c-0525-4239-a6b8-b8f8b236dfb1 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:57:15 user nova-compute[73104]: DEBUG nova.compute.manager [req-93db540c-5e43-4752-969a-4d3bc25147ae req-d6558bdb-d558-4f83-99e7-213dbf5f5c75 service nova] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Received event network-vif-unplugged-cfa211db-57c3-47a2-82e1-f9536415953c {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:57:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-93db540c-5e43-4752-969a-4d3bc25147ae req-d6558bdb-d558-4f83-99e7-213dbf5f5c75 service nova] Acquiring lock "6550b41d-2414-4b3e-9a50-9bba88033aae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:57:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-93db540c-5e43-4752-969a-4d3bc25147ae req-d6558bdb-d558-4f83-99e7-213dbf5f5c75 service nova] Lock "6550b41d-2414-4b3e-9a50-9bba88033aae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:57:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-93db540c-5e43-4752-969a-4d3bc25147ae req-d6558bdb-d558-4f83-99e7-213dbf5f5c75 service nova] Lock "6550b41d-2414-4b3e-9a50-9bba88033aae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:57:15 user nova-compute[73104]: DEBUG nova.compute.manager [req-93db540c-5e43-4752-969a-4d3bc25147ae req-d6558bdb-d558-4f83-99e7-213dbf5f5c75 service nova] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] No waiting events found dispatching network-vif-unplugged-cfa211db-57c3-47a2-82e1-f9536415953c {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:57:15 user nova-compute[73104]: DEBUG nova.compute.manager [req-93db540c-5e43-4752-969a-4d3bc25147ae req-d6558bdb-d558-4f83-99e7-213dbf5f5c75 service nova] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Received event network-vif-unplugged-cfa211db-57c3-47a2-82e1-f9536415953c for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:57:15 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Instance destroyed successfully.
Aug 26 08:57:15 user nova-compute[73104]: DEBUG nova.objects.instance [None req-48a3ddbe-b680-4bfe-9938-5380a0379c9d tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Lazy-loading 'resources' on Instance uuid 6550b41d-2414-4b3e-9a50-9bba88033aae {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:57:15 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-48a3ddbe-b680-4bfe-9938-5380a0379c9d tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:54:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2064089476',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2064089476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2064089',id=32,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABvzYvcjGmyfKfdsoFitoPQFmpg7LweWNYDz8+UZUn69fL9aHleLx7wbc1dvQd/Ekavkt8ULLe3sHhy7mnptjN0kmm9Fg8+FrouUOOY5LrTWt81nuxu2Iff/RzVKgN4Vg==',key_name='tempest-keypair-714993415',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:54:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dca97939d90e46678626053110e9dba1',ramdisk_id='',reservation_id='r-7q9azygr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1954048769',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:54:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e132db6ecf3a4576b057867ed41c1f59',uuid=6550b41d-2414-4b3e-9a50-9bba88033aae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cfa211db-57c3-47a2-82e1-f9536415953c", "address": "fa:16:3e:7f:fb:55", "network": {"id": "2bbbc03e-d3e2-41b9-9b25-265081247b1b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-839419385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca97939d90e46678626053110e9dba1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfa211db-57", "ovs_interfaceid": "cfa211db-57c3-47a2-82e1-f9536415953c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:57:15 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-48a3ddbe-b680-4bfe-9938-5380a0379c9d tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Converting VIF {"id": "cfa211db-57c3-47a2-82e1-f9536415953c", "address": "fa:16:3e:7f:fb:55", "network": {"id": "2bbbc03e-d3e2-41b9-9b25-265081247b1b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-839419385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca97939d90e46678626053110e9dba1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfa211db-57", "ovs_interfaceid": "cfa211db-57c3-47a2-82e1-f9536415953c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:57:15 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-48a3ddbe-b680-4bfe-9938-5380a0379c9d tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:fb:55,bridge_name='br-int',has_traffic_filtering=True,id=cfa211db-57c3-47a2-82e1-f9536415953c,network=Network(2bbbc03e-d3e2-41b9-9b25-265081247b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfa211db-57') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:57:15 user nova-compute[73104]: DEBUG os_vif [None req-48a3ddbe-b680-4bfe-9938-5380a0379c9d tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:fb:55,bridge_name='br-int',has_traffic_filtering=True,id=cfa211db-57c3-47a2-82e1-f9536415953c,network=Network(2bbbc03e-d3e2-41b9-9b25-265081247b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfa211db-57') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:57:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcfa211db-57, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:57:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:57:15 user nova-compute[73104]: INFO os_vif [None req-48a3ddbe-b680-4bfe-9938-5380a0379c9d tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:fb:55,bridge_name='br-int',has_traffic_filtering=True,id=cfa211db-57c3-47a2-82e1-f9536415953c,network=Network(2bbbc03e-d3e2-41b9-9b25-265081247b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfa211db-57')
Aug 26 08:57:15 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-48a3ddbe-b680-4bfe-9938-5380a0379c9d tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Deleting instance files /opt/stack/data/nova/instances/6550b41d-2414-4b3e-9a50-9bba88033aae_del
Aug 26 08:57:15 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-48a3ddbe-b680-4bfe-9938-5380a0379c9d tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Deletion of /opt/stack/data/nova/instances/6550b41d-2414-4b3e-9a50-9bba88033aae_del complete
Aug 26 08:57:15 user nova-compute[73104]: INFO nova.compute.manager [None req-48a3ddbe-b680-4bfe-9938-5380a0379c9d tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 26 08:57:15 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-48a3ddbe-b680-4bfe-9938-5380a0379c9d tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 08:57:15 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 08:57:15 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 08:57:15 user nova-compute[73104]: DEBUG nova.objects.instance [None req-114e564c-0525-4239-a6b8-b8f8b236dfb1 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lazy-loading 'flavor' on Instance uuid 1b45635b-062b-4149-8789-9f5191132cbd {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:57:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-114e564c-0525-4239-a6b8-b8f8b236dfb1 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "1b45635b-062b-4149-8789-9f5191132cbd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.891s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:57:16 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:57:16 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Took 1.48 seconds to deallocate network for instance.
Aug 26 08:57:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-48a3ddbe-b680-4bfe-9938-5380a0379c9d tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:57:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-48a3ddbe-b680-4bfe-9938-5380a0379c9d tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:57:17 user nova-compute[73104]: DEBUG nova.compute.manager [req-df17a040-a9d8-4df2-b104-2a230a33e893 req-89fd1529-2d92-4a4a-b1bc-e20d8a4e1c8b service nova] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Received event network-vif-plugged-cfa211db-57c3-47a2-82e1-f9536415953c {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:57:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-df17a040-a9d8-4df2-b104-2a230a33e893 req-89fd1529-2d92-4a4a-b1bc-e20d8a4e1c8b service nova] Acquiring lock "6550b41d-2414-4b3e-9a50-9bba88033aae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:57:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-df17a040-a9d8-4df2-b104-2a230a33e893 req-89fd1529-2d92-4a4a-b1bc-e20d8a4e1c8b service nova] Lock "6550b41d-2414-4b3e-9a50-9bba88033aae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:57:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-df17a040-a9d8-4df2-b104-2a230a33e893 req-89fd1529-2d92-4a4a-b1bc-e20d8a4e1c8b service nova] Lock "6550b41d-2414-4b3e-9a50-9bba88033aae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:57:17 user nova-compute[73104]: DEBUG nova.compute.manager [req-df17a040-a9d8-4df2-b104-2a230a33e893 req-89fd1529-2d92-4a4a-b1bc-e20d8a4e1c8b service nova] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] No waiting events found dispatching network-vif-plugged-cfa211db-57c3-47a2-82e1-f9536415953c {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:57:17 user nova-compute[73104]: WARNING nova.compute.manager [req-df17a040-a9d8-4df2-b104-2a230a33e893 req-89fd1529-2d92-4a4a-b1bc-e20d8a4e1c8b service nova] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Received unexpected event network-vif-plugged-cfa211db-57c3-47a2-82e1-f9536415953c for instance with vm_state deleted and task_state None.
Aug 26 08:57:17 user nova-compute[73104]: DEBUG nova.compute.manager [req-df17a040-a9d8-4df2-b104-2a230a33e893 req-89fd1529-2d92-4a4a-b1bc-e20d8a4e1c8b service nova] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Received event network-vif-deleted-cfa211db-57c3-47a2-82e1-f9536415953c {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:57:17 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-48a3ddbe-b680-4bfe-9938-5380a0379c9d tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:57:17 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-48a3ddbe-b680-4bfe-9938-5380a0379c9d tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:57:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-48a3ddbe-b680-4bfe-9938-5380a0379c9d tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:57:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cd36e09a-3dc4-4e83-8b50-6dce2d761c1f tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Acquiring lock "67c5d379-7e2a-415b-a0a5-530afec0b1ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:57:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cd36e09a-3dc4-4e83-8b50-6dce2d761c1f tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Lock "67c5d379-7e2a-415b-a0a5-530afec0b1ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:57:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cd36e09a-3dc4-4e83-8b50-6dce2d761c1f tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Acquiring lock "67c5d379-7e2a-415b-a0a5-530afec0b1ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:57:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cd36e09a-3dc4-4e83-8b50-6dce2d761c1f tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Lock "67c5d379-7e2a-415b-a0a5-530afec0b1ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:57:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cd36e09a-3dc4-4e83-8b50-6dce2d761c1f tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Lock "67c5d379-7e2a-415b-a0a5-530afec0b1ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:57:17 user nova-compute[73104]: INFO nova.compute.manager [None req-cd36e09a-3dc4-4e83-8b50-6dce2d761c1f tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Terminating instance
Aug 26 08:57:17 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-48a3ddbe-b680-4bfe-9938-5380a0379c9d tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Deleted allocations for instance 6550b41d-2414-4b3e-9a50-9bba88033aae
Aug 26 08:57:17 user nova-compute[73104]: DEBUG nova.compute.manager [None req-cd36e09a-3dc4-4e83-8b50-6dce2d761c1f tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 08:57:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-48a3ddbe-b680-4bfe-9938-5380a0379c9d tempest-TestServerVolumeAttachScenarioOldVersion-1954048769 tempest-TestServerVolumeAttachScenarioOldVersion-1954048769-project-member] Lock "6550b41d-2414-4b3e-9a50-9bba88033aae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.958s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:57:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:18 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Instance destroyed successfully.
Aug 26 08:57:18 user nova-compute[73104]: DEBUG nova.objects.instance [None req-cd36e09a-3dc4-4e83-8b50-6dce2d761c1f tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Lazy-loading 'resources' on Instance uuid 67c5d379-7e2a-415b-a0a5-530afec0b1ea {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:57:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-cd36e09a-3dc4-4e83-8b50-6dce2d761c1f tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:55:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-334998335',display_name='tempest-VolumesNegativeTest-instance-334998335',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-334998335',id=34,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:55:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf19366c85c84b958e80d3dd3f7ad885',ramdisk_id='',reservation_id='r-1kvzay1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-30423543',owner_user_name='tempest-VolumesNegativeTest-30423543-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:55:34Z,user_data=None,user_id='ec87ee15022146bcaaad23e2196d21aa',uuid=67c5d379-7e2a-415b-a0a5-530afec0b1ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d3ab149-29a3-4045-934c-4930ed714adc", "address": "fa:16:3e:22:52:e6", "network": {"id": "3668555c-8072-4c8c-8617-bdbcc4cc7f8b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "549d3fed307c4f4c84128afef97a358e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3ab149-29", "ovs_interfaceid": "1d3ab149-29a3-4045-934c-4930ed714adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:57:18 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-cd36e09a-3dc4-4e83-8b50-6dce2d761c1f tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Converting VIF {"id": "1d3ab149-29a3-4045-934c-4930ed714adc", "address": "fa:16:3e:22:52:e6", "network": {"id": "3668555c-8072-4c8c-8617-bdbcc4cc7f8b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "549d3fed307c4f4c84128afef97a358e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d3ab149-29", "ovs_interfaceid": "1d3ab149-29a3-4045-934c-4930ed714adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:57:18 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-cd36e09a-3dc4-4e83-8b50-6dce2d761c1f tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:52:e6,bridge_name='br-int',has_traffic_filtering=True,id=1d3ab149-29a3-4045-934c-4930ed714adc,network=Network(3668555c-8072-4c8c-8617-bdbcc4cc7f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d3ab149-29') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:57:18 user nova-compute[73104]: DEBUG os_vif [None req-cd36e09a-3dc4-4e83-8b50-6dce2d761c1f tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:52:e6,bridge_name='br-int',has_traffic_filtering=True,id=1d3ab149-29a3-4045-934c-4930ed714adc,network=Network(3668555c-8072-4c8c-8617-bdbcc4cc7f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d3ab149-29') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:57:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d3ab149-29, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:57:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:57:18 user nova-compute[73104]: INFO os_vif [None req-cd36e09a-3dc4-4e83-8b50-6dce2d761c1f tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:52:e6,bridge_name='br-int',has_traffic_filtering=True,id=1d3ab149-29a3-4045-934c-4930ed714adc,network=Network(3668555c-8072-4c8c-8617-bdbcc4cc7f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d3ab149-29')
Aug 26 08:57:18 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-cd36e09a-3dc4-4e83-8b50-6dce2d761c1f tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Deleting instance files /opt/stack/data/nova/instances/67c5d379-7e2a-415b-a0a5-530afec0b1ea_del
Aug 26 08:57:18 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-cd36e09a-3dc4-4e83-8b50-6dce2d761c1f tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Deletion of /opt/stack/data/nova/instances/67c5d379-7e2a-415b-a0a5-530afec0b1ea_del complete
Aug 26 08:57:18 user nova-compute[73104]: INFO nova.compute.manager [None req-cd36e09a-3dc4-4e83-8b50-6dce2d761c1f tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Took 0.75 seconds to destroy the instance on the hypervisor.
Aug 26 08:57:18 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-cd36e09a-3dc4-4e83-8b50-6dce2d761c1f tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 08:57:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:18 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 08:57:18 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 08:57:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:19 user nova-compute[73104]: DEBUG nova.compute.manager [req-af3f08bd-becb-466a-8619-7c5c3b3dbe3a req-81040f20-ed70-4a0e-89ad-a22cefdbfcf7 service nova] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Received event network-vif-unplugged-1d3ab149-29a3-4045-934c-4930ed714adc {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:57:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-af3f08bd-becb-466a-8619-7c5c3b3dbe3a req-81040f20-ed70-4a0e-89ad-a22cefdbfcf7 service nova] Acquiring lock "67c5d379-7e2a-415b-a0a5-530afec0b1ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:57:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-af3f08bd-becb-466a-8619-7c5c3b3dbe3a req-81040f20-ed70-4a0e-89ad-a22cefdbfcf7 service nova] Lock "67c5d379-7e2a-415b-a0a5-530afec0b1ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:57:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-af3f08bd-becb-466a-8619-7c5c3b3dbe3a req-81040f20-ed70-4a0e-89ad-a22cefdbfcf7 service nova] Lock "67c5d379-7e2a-415b-a0a5-530afec0b1ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:57:19 user nova-compute[73104]: DEBUG nova.compute.manager [req-af3f08bd-becb-466a-8619-7c5c3b3dbe3a req-81040f20-ed70-4a0e-89ad-a22cefdbfcf7 service nova] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] No waiting events found dispatching network-vif-unplugged-1d3ab149-29a3-4045-934c-4930ed714adc {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:57:19 user nova-compute[73104]: DEBUG nova.compute.manager [req-af3f08bd-becb-466a-8619-7c5c3b3dbe3a req-81040f20-ed70-4a0e-89ad-a22cefdbfcf7 service nova] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Received event network-vif-unplugged-1d3ab149-29a3-4045-934c-4930ed714adc for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:57:19 user nova-compute[73104]: DEBUG nova.compute.manager [req-af3f08bd-becb-466a-8619-7c5c3b3dbe3a req-81040f20-ed70-4a0e-89ad-a22cefdbfcf7 service nova] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Received event network-vif-plugged-1d3ab149-29a3-4045-934c-4930ed714adc {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:57:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-af3f08bd-becb-466a-8619-7c5c3b3dbe3a req-81040f20-ed70-4a0e-89ad-a22cefdbfcf7 service nova] Acquiring lock "67c5d379-7e2a-415b-a0a5-530afec0b1ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:57:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-af3f08bd-becb-466a-8619-7c5c3b3dbe3a req-81040f20-ed70-4a0e-89ad-a22cefdbfcf7 service nova] Lock "67c5d379-7e2a-415b-a0a5-530afec0b1ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:57:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-af3f08bd-becb-466a-8619-7c5c3b3dbe3a req-81040f20-ed70-4a0e-89ad-a22cefdbfcf7 service nova] Lock "67c5d379-7e2a-415b-a0a5-530afec0b1ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:57:19 user nova-compute[73104]: DEBUG nova.compute.manager [req-af3f08bd-becb-466a-8619-7c5c3b3dbe3a req-81040f20-ed70-4a0e-89ad-a22cefdbfcf7 service nova] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] No waiting events found dispatching network-vif-plugged-1d3ab149-29a3-4045-934c-4930ed714adc {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:57:19 user nova-compute[73104]: WARNING nova.compute.manager [req-af3f08bd-becb-466a-8619-7c5c3b3dbe3a req-81040f20-ed70-4a0e-89ad-a22cefdbfcf7 service nova] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Received unexpected event network-vif-plugged-1d3ab149-29a3-4045-934c-4930ed714adc for instance with vm_state active and task_state deleting.
Aug 26 08:57:19 user nova-compute[73104]: DEBUG nova.compute.manager [req-af3f08bd-becb-466a-8619-7c5c3b3dbe3a req-81040f20-ed70-4a0e-89ad-a22cefdbfcf7 service nova] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Received event network-vif-plugged-1d3ab149-29a3-4045-934c-4930ed714adc {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:57:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-af3f08bd-becb-466a-8619-7c5c3b3dbe3a req-81040f20-ed70-4a0e-89ad-a22cefdbfcf7 service nova] Acquiring lock "67c5d379-7e2a-415b-a0a5-530afec0b1ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:57:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-af3f08bd-becb-466a-8619-7c5c3b3dbe3a req-81040f20-ed70-4a0e-89ad-a22cefdbfcf7 service nova] Lock "67c5d379-7e2a-415b-a0a5-530afec0b1ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:57:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-af3f08bd-becb-466a-8619-7c5c3b3dbe3a req-81040f20-ed70-4a0e-89ad-a22cefdbfcf7 service nova] Lock "67c5d379-7e2a-415b-a0a5-530afec0b1ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:57:19 user nova-compute[73104]: DEBUG nova.compute.manager [req-af3f08bd-becb-466a-8619-7c5c3b3dbe3a req-81040f20-ed70-4a0e-89ad-a22cefdbfcf7 service nova] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] No waiting events found dispatching network-vif-plugged-1d3ab149-29a3-4045-934c-4930ed714adc {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:57:19 user nova-compute[73104]: WARNING nova.compute.manager [req-af3f08bd-becb-466a-8619-7c5c3b3dbe3a req-81040f20-ed70-4a0e-89ad-a22cefdbfcf7 service nova] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Received unexpected event network-vif-plugged-1d3ab149-29a3-4045-934c-4930ed714adc for instance with vm_state active and task_state deleting.
Aug 26 08:57:19 user nova-compute[73104]: DEBUG nova.compute.manager [req-af3f08bd-becb-466a-8619-7c5c3b3dbe3a req-81040f20-ed70-4a0e-89ad-a22cefdbfcf7 service nova] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Received event network-vif-plugged-1d3ab149-29a3-4045-934c-4930ed714adc {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:57:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-af3f08bd-becb-466a-8619-7c5c3b3dbe3a req-81040f20-ed70-4a0e-89ad-a22cefdbfcf7 service nova] Acquiring lock "67c5d379-7e2a-415b-a0a5-530afec0b1ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:57:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-af3f08bd-becb-466a-8619-7c5c3b3dbe3a req-81040f20-ed70-4a0e-89ad-a22cefdbfcf7 service nova] Lock "67c5d379-7e2a-415b-a0a5-530afec0b1ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:57:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-af3f08bd-becb-466a-8619-7c5c3b3dbe3a req-81040f20-ed70-4a0e-89ad-a22cefdbfcf7 service nova] Lock "67c5d379-7e2a-415b-a0a5-530afec0b1ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:57:19 user nova-compute[73104]: DEBUG nova.compute.manager [req-af3f08bd-becb-466a-8619-7c5c3b3dbe3a req-81040f20-ed70-4a0e-89ad-a22cefdbfcf7 service nova] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] No waiting events found dispatching network-vif-plugged-1d3ab149-29a3-4045-934c-4930ed714adc {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:57:19 user nova-compute[73104]: WARNING nova.compute.manager [req-af3f08bd-becb-466a-8619-7c5c3b3dbe3a req-81040f20-ed70-4a0e-89ad-a22cefdbfcf7 service nova] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Received unexpected event network-vif-plugged-1d3ab149-29a3-4045-934c-4930ed714adc for instance with vm_state active and task_state deleting.
Aug 26 08:57:19 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:57:19 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Took 1.07 seconds to deallocate network for instance.
Aug 26 08:57:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cd36e09a-3dc4-4e83-8b50-6dce2d761c1f tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:57:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cd36e09a-3dc4-4e83-8b50-6dce2d761c1f tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:57:19 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-cd36e09a-3dc4-4e83-8b50-6dce2d761c1f tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:57:19 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-cd36e09a-3dc4-4e83-8b50-6dce2d761c1f tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:57:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cd36e09a-3dc4-4e83-8b50-6dce2d761c1f tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:57:19 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-cd36e09a-3dc4-4e83-8b50-6dce2d761c1f tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Deleted allocations for instance 67c5d379-7e2a-415b-a0a5-530afec0b1ea
Aug 26 08:57:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cd36e09a-3dc4-4e83-8b50-6dce2d761c1f tempest-VolumesNegativeTest-30423543 tempest-VolumesNegativeTest-30423543-project-member] Lock "67c5d379-7e2a-415b-a0a5-530afec0b1ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.431s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:57:21 user nova-compute[73104]: DEBUG nova.compute.manager [req-77c56540-8c82-4e2d-9155-e4c48baba040 req-1aa7bfc3-eb64-479d-80c1-db70083ccf6b service nova] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Received event network-vif-plugged-1d3ab149-29a3-4045-934c-4930ed714adc {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:57:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-77c56540-8c82-4e2d-9155-e4c48baba040 req-1aa7bfc3-eb64-479d-80c1-db70083ccf6b service nova] Acquiring lock "67c5d379-7e2a-415b-a0a5-530afec0b1ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:57:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-77c56540-8c82-4e2d-9155-e4c48baba040 req-1aa7bfc3-eb64-479d-80c1-db70083ccf6b service nova] Lock "67c5d379-7e2a-415b-a0a5-530afec0b1ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:57:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-77c56540-8c82-4e2d-9155-e4c48baba040 req-1aa7bfc3-eb64-479d-80c1-db70083ccf6b service nova] Lock "67c5d379-7e2a-415b-a0a5-530afec0b1ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:57:21 user nova-compute[73104]: DEBUG nova.compute.manager [req-77c56540-8c82-4e2d-9155-e4c48baba040 req-1aa7bfc3-eb64-479d-80c1-db70083ccf6b service nova] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] No waiting events found dispatching network-vif-plugged-1d3ab149-29a3-4045-934c-4930ed714adc {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:57:21 user nova-compute[73104]: WARNING nova.compute.manager [req-77c56540-8c82-4e2d-9155-e4c48baba040 req-1aa7bfc3-eb64-479d-80c1-db70083ccf6b service nova] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Received unexpected event network-vif-plugged-1d3ab149-29a3-4045-934c-4930ed714adc for instance with vm_state deleted and task_state None.
Aug 26 08:57:21 user nova-compute[73104]: DEBUG nova.compute.manager [req-77c56540-8c82-4e2d-9155-e4c48baba040 req-1aa7bfc3-eb64-479d-80c1-db70083ccf6b service nova] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Received event network-vif-deleted-1d3ab149-29a3-4045-934c-4930ed714adc {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:57:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:23 user nova-compute[73104]: INFO nova.compute.manager [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Rescuing
Aug 26 08:57:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "refresh_cache-0e3fb03a-d317-4eed-ad52-d066242a13e0" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:57:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquired lock "refresh_cache-0e3fb03a-d317-4eed-ad52-d066242a13e0" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:57:23 user nova-compute[73104]: DEBUG nova.network.neutron [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:57:23 user nova-compute[73104]: DEBUG nova.network.neutron [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Updating instance_info_cache with network_info: [{"id": "fd9b2f61-e1a4-47ba-8890-72715a8e241e", "address": "fa:16:3e:ed:2c:7f", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd9b2f61-e1", "ovs_interfaceid": "fd9b2f61-e1a4-47ba-8890-72715a8e241e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:57:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Releasing lock "refresh_cache-0e3fb03a-d317-4eed-ad52-d066242a13e0" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:57:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:24 user nova-compute[73104]: DEBUG nova.compute.manager [req-972b0f79-dce6-4626-9d43-51bc2b5d0d6f req-2cf3f908-db6b-465b-9019-0bb4a333889a service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Received event network-vif-unplugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:57:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-972b0f79-dce6-4626-9d43-51bc2b5d0d6f req-2cf3f908-db6b-465b-9019-0bb4a333889a service nova] Acquiring lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:57:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-972b0f79-dce6-4626-9d43-51bc2b5d0d6f req-2cf3f908-db6b-465b-9019-0bb4a333889a service nova] Lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:57:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-972b0f79-dce6-4626-9d43-51bc2b5d0d6f req-2cf3f908-db6b-465b-9019-0bb4a333889a service nova] Lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:57:24 user nova-compute[73104]: DEBUG nova.compute.manager [req-972b0f79-dce6-4626-9d43-51bc2b5d0d6f req-2cf3f908-db6b-465b-9019-0bb4a333889a service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] No waiting events found dispatching network-vif-unplugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:57:24 user nova-compute[73104]: WARNING nova.compute.manager [req-972b0f79-dce6-4626-9d43-51bc2b5d0d6f req-2cf3f908-db6b-465b-9019-0bb4a333889a service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Received unexpected event network-vif-unplugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e for instance with vm_state active and task_state rescuing.
Aug 26 08:57:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:24 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Instance destroyed successfully.
Aug 26 08:57:24 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Attempting a stable device rescue
Aug 26 08:57:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73104) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 08:57:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Instance directory exists: not creating {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 08:57:24 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Creating image(s)
Aug 26 08:57:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "/opt/stack/data/nova/instances/0e3fb03a-d317-4eed-ad52-d066242a13e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:57:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "/opt/stack/data/nova/instances/0e3fb03a-d317-4eed-ad52-d066242a13e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:57:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "/opt/stack/data/nova/instances/0e3fb03a-d317-4eed-ad52-d066242a13e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:57:24 user nova-compute[73104]: DEBUG nova.objects.instance [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0e3fb03a-d317-4eed-ad52-d066242a13e0 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:57:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "723a2d742fb8e6519c885d60345d692e8ce81fb0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:57:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "723a2d742fb8e6519c885d60345d692e8ce81fb0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:57:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/723a2d742fb8e6519c885d60345d692e8ce81fb0.part --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/723a2d742fb8e6519c885d60345d692e8ce81fb0.part --force-share --output=json" returned: 0 in 0.170s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:26 user nova-compute[73104]: DEBUG nova.virt.images [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] f633e3b1-e85f-4863-b970-aef9b677dea3 was qcow2, converting to raw {{(pid=73104) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 08:57:26 user nova-compute[73104]: DEBUG nova.privsep.utils [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73104) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 08:57:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/723a2d742fb8e6519c885d60345d692e8ce81fb0.part /opt/stack/data/nova/instances/_base/723a2d742fb8e6519c885d60345d692e8ce81fb0.converted {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:26 user nova-compute[73104]: DEBUG nova.compute.manager [req-5e11ff5f-9c86-4860-883b-81ddf92b311b req-598fb593-12a0-4e86-93f7-4e2d6f1d2152 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Received event network-vif-plugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:57:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5e11ff5f-9c86-4860-883b-81ddf92b311b req-598fb593-12a0-4e86-93f7-4e2d6f1d2152 service nova] Acquiring lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:57:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5e11ff5f-9c86-4860-883b-81ddf92b311b req-598fb593-12a0-4e86-93f7-4e2d6f1d2152 service nova] Lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:57:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5e11ff5f-9c86-4860-883b-81ddf92b311b req-598fb593-12a0-4e86-93f7-4e2d6f1d2152 service nova] Lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:57:26 user nova-compute[73104]: DEBUG nova.compute.manager [req-5e11ff5f-9c86-4860-883b-81ddf92b311b req-598fb593-12a0-4e86-93f7-4e2d6f1d2152 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] No waiting events found dispatching network-vif-plugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:57:26 user nova-compute[73104]: WARNING nova.compute.manager [req-5e11ff5f-9c86-4860-883b-81ddf92b311b req-598fb593-12a0-4e86-93f7-4e2d6f1d2152 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Received unexpected event network-vif-plugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e for instance with vm_state active and task_state rescuing.
Aug 26 08:57:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/723a2d742fb8e6519c885d60345d692e8ce81fb0.part /opt/stack/data/nova/instances/_base/723a2d742fb8e6519c885d60345d692e8ce81fb0.converted" returned: 0 in 0.567s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/723a2d742fb8e6519c885d60345d692e8ce81fb0.converted --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/723a2d742fb8e6519c885d60345d692e8ce81fb0.converted --force-share --output=json" returned: 0 in 0.200s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "723a2d742fb8e6519c885d60345d692e8ce81fb0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.057s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:57:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "723a2d742fb8e6519c885d60345d692e8ce81fb0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:57:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "723a2d742fb8e6519c885d60345d692e8ce81fb0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:57:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/723a2d742fb8e6519c885d60345d692e8ce81fb0 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/723a2d742fb8e6519c885d60345d692e8ce81fb0 --force-share --output=json" returned: 0 in 0.171s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/723a2d742fb8e6519c885d60345d692e8ce81fb0,backing_fmt=raw /opt/stack/data/nova/instances/0e3fb03a-d317-4eed-ad52-d066242a13e0/disk.rescue {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/723a2d742fb8e6519c885d60345d692e8ce81fb0,backing_fmt=raw /opt/stack/data/nova/instances/0e3fb03a-d317-4eed-ad52-d066242a13e0/disk.rescue" returned: 0 in 0.050s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "723a2d742fb8e6519c885d60345d692e8ce81fb0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.objects.instance [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lazy-loading 'migration_context' on Instance uuid 0e3fb03a-d317-4eed-ad52-d066242a13e0 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.objects.base [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Object Instance<0e3fb03a-d317-4eed-ad52-d066242a13e0> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Start _get_guest_xml network_info=[{"id": "fd9b2f61-e1a4-47ba-8890-72715a8e241e", "address": "fa:16:3e:ed:2c:7f", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "vif_mac": "fa:16:3e:ed:2c:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd9b2f61-e1", "ovs_interfaceid": "fd9b2f61-e1a4-47ba-8890-72715a8e241e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f633e3b1-e85f-4863-b970-aef9b677dea3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '05f96459-99ff-4415-9614-53964cd1ca73', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uRXgQlJf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '0e3fb03a-d317-4eed-ad52-d066242a13e0', 'attached_at': '', 'detached_at': '', 'volume_id': '65bfdc23-25e2-4b96-923f-c523f0e1ddf7', 'serial': '65bfdc23-25e2-4b96-923f-c523f0e1ddf7'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.objects.instance [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lazy-loading 'resources' on Instance uuid 0e3fb03a-d317-4eed-ad52-d066242a13e0 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.objects.base [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Object Instance<0e3fb03a-d317-4eed-ad52-d066242a13e0> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.objects.instance [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lazy-loading 'numa_topology' on Instance uuid 0e3fb03a-d317-4eed-ad52-d066242a13e0 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.objects.base [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Object Instance<0e3fb03a-d317-4eed-ad52-d066242a13e0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:57:27 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:57:27 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.objects.instance [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0e3fb03a-d317-4eed-ad52-d066242a13e0 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.objects.base [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Object Instance<0e3fb03a-d317-4eed-ad52-d066242a13e0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uRXgQlJf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:57:27 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:57:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:57:27 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:57:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:57:27 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:57:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[00731435-9006-4716-bdb5-8e17da246d5b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = uRXgQlJf\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 26 08:57:27 user nova-compute[73104]: node.name = iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7
Aug 26 08:57:27 user nova-compute[73104]: node.tpgt = -1
Aug 26 08:57:27 user nova-compute[73104]: node.startup = automatic
Aug 26 08:57:27 user nova-compute[73104]: node.leading_login = No
Aug 26 08:57:27 user nova-compute[73104]: iface.iscsi_ifacename = default
Aug 26 08:57:27 user nova-compute[73104]: iface.net_ifacename = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.ipaddress = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.prefix_len = 0
Aug 26 08:57:27 user nova-compute[73104]: iface.hwaddress = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.transport_name = tcp
Aug 26 08:57:27 user nova-compute[73104]: iface.initiatorname = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.state = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.vlan_id = 0
Aug 26 08:57:27 user nova-compute[73104]: iface.vlan_priority = 0
Aug 26 08:57:27 user nova-compute[73104]: iface.vlan_state = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.iface_num = 0
Aug 26 08:57:27 user nova-compute[73104]: iface.mtu = 0
Aug 26 08:57:27 user nova-compute[73104]: iface.port = 0
Aug 26 08:57:27 user nova-compute[73104]: iface.bootproto = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.subnet_mask = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.gateway = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.dhcp_alt_client_id_state = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.dhcp_alt_client_id = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.dhcp_dns = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.dhcp_learn_iqn = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.dhcp_req_vendor_id_state = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.dhcp_vendor_id_state = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.dhcp_vendor_id = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.dhcp_slp_da = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.fragmentation = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.gratuitous_arp = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.incoming_forwarding = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.tos_state = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.tos = 0
Aug 26 08:57:27 user nova-compute[73104]: iface.ttl = 0
Aug 26 08:57:27 user nova-compute[73104]: iface.delayed_ack = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.tcp_nagle = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.tcp_wsf_state = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.tcp_wsf = 0
Aug 26 08:57:27 user nova-compute[73104]: iface.tcp_timer_scale = 0
Aug 26 08:57:27 user nova-compute[73104]: iface.tcp_timestamp = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.redirect = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.def_task_mgmt_timeout = 0
Aug 26 08:57:27 user nova-compute[73104]: iface.header_digest = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.data_digest = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.immediate_data = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.initial_r2t = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.data_seq_inorder = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.data_pdu_inorder = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.erl = 0
Aug 26 08:57:27 user nova-compute[73104]: iface.max_receive_data_len = 0
Aug 26 08:57:27 user nova-compute[73104]: iface.first_burst_len = 0
Aug 26 08:57:27 user nova-compute[73104]: iface.max_outstanding_r2t = 0
Aug 26 08:57:27 user nova-compute[73104]: iface.max_burst_len = 0
Aug 26 08:57:27 user nova-compute[73104]: iface.chap_auth = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.bidi_chap = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.strict_login_compliance = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.discovery_auth = <empty>
Aug 26 08:57:27 user nova-compute[73104]: iface.discovery_logout = <empty>
Aug 26 08:57:27 user nova-compute[73104]: node.discovery_address = <empty>
Aug 26 08:57:27 user nova-compute[73104]: node.discovery_port = 0
Aug 26 08:57:27 user nova-compute[73104]: node.discovery_type = static
Aug 26 08:57:27 user nova-compute[73104]: node.session.initial_cmdsn = 0
Aug 26 08:57:27 user nova-compute[73104]: node.session.initial_login_retry_max = 8
Aug 26 08:57:27 user nova-compute[73104]: node.session.xmit_thread_priority = -20
Aug 26 08:57:27 user nova-compute[73104]: node.session.cmds_max = 128
Aug 26 08:57:27 user nova-compute[73104]: node.session.queue_depth = 32
Aug 26 08:57:27 user nova-compute[73104]: node.session.nr_sessions = 1
Aug 26 08:57:27 user nova-compute[73104]: node.session.auth.authmethod = CHAP
Aug 26 08:57:27 user nova-compute[73104]: node.session.auth.username = uRXgQlJf
Aug 26 08:57:27 user nova-compute[73104]: node.session.auth.password = ***
Aug 26 08:57:27 user nova-compute[73104]: node.session.auth.username_in = <empty>
Aug 26 08:57:27 user nova-compute[73104]: node.session.auth.password_in = <empty>
Aug 26 08:57:27 user nova-compute[73104]: node.session.auth.chap_algs = MD5
Aug 26 08:57:27 user nova-compute[73104]: node.session.timeo.replacement_timeout = 120
Aug 26 08:57:27 user nova-compute[73104]: node.session.err_timeo.abort_timeout = 15
Aug 26 08:57:27 user nova-compute[73104]: node.session.err_timeo.lu_reset_timeout = 30
Aug 26 08:57:27 user nova-compute[73104]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 26 08:57:27 user nova-compute[73104]: node.session.err_timeo.host_reset_timeout = 60
Aug 26 08:57:27 user nova-compute[73104]: node.session.iscsi.FastAbort = Yes
Aug 26 08:57:27 user nova-compute[73104]: node.session.iscsi.InitialR2T = No
Aug 26 08:57:27 user nova-compute[73104]: node.session.iscsi.ImmediateData = Yes
Aug 26 08:57:27 user nova-compute[73104]: node.session.iscsi.FirstBurstLength = 262144
Aug 26 08:57:27 user nova-compute[73104]: node.session.iscsi.MaxBurstLength = 16776192
Aug 26 08:57:27 user nova-compute[73104]: node.session.iscsi.DefaultTime2Retain = 0
Aug 26 08:57:27 user nova-compute[73104]: node.session.iscsi.DefaultTime2Wait = 2
Aug 26 08:57:27 user nova-compute[73104]: node.session.iscsi.MaxConnections = 1
Aug 26 08:57:27 user nova-compute[73104]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 26 08:57:27 user nova-compute[73104]: node.session.iscsi.ERL = 0
Aug 26 08:57:27 user nova-compute[73104]: node.session.scan = manual
Aug 26 08:57:27 user nova-compute[73104]: node.session.reopen_max = 0
Aug 26 08:57:27 user nova-compute[73104]: node.conn[0].address = 172.16.0.220
Aug 26 08:57:27 user nova-compute[73104]: node.conn[0].port = 3260
Aug 26 08:57:27 user nova-compute[73104]: node.conn[0].startup = manual
Aug 26 08:57:27 user nova-compute[73104]: node.conn[0].tcp.window_size = 524288
Aug 26 08:57:27 user nova-compute[73104]: node.conn[0].tcp.type_of_service = 0
Aug 26 08:57:27 user nova-compute[73104]: node.conn[0].timeo.logout_timeout = 15
Aug 26 08:57:27 user nova-compute[73104]: node.conn[0].timeo.login_timeout = 15
Aug 26 08:57:27 user nova-compute[73104]: node.conn[0].timeo.auth_timeout = 45
Aug 26 08:57:27 user nova-compute[73104]: node.conn[0].timeo.noop_out_interval = 5
Aug 26 08:57:27 user nova-compute[73104]: node.conn[0].timeo.noop_out_timeout = 5
Aug 26 08:57:27 user nova-compute[73104]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 26 08:57:27 user nova-compute[73104]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 26 08:57:27 user nova-compute[73104]: node.conn[0].iscsi.HeaderDigest = None
Aug 26 08:57:27 user nova-compute[73104]: node.conn[0].iscsi.DataDigest = None
Aug 26 08:57:27 user nova-compute[73104]: node.conn[0].iscsi.IFMarker = No
Aug 26 08:57:27 user nova-compute[73104]: node.conn[0].iscsi.OFMarker = No
Aug 26 08:57:27 user nova-compute[73104]: # END RECORD
Aug 26 08:57:27 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[891eb159-abf7-4028-9aac-65c08a441c07]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13505b4-4df4-4201-93fa-6ebdee38a75a]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uRXgQlJf {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uRXgQlJf" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7673c66-c8be-4341-9b0c-10a24ce903d1]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uRXgQlJf'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a040a2cf-b9e8-4954-89f5-8f34078ef39c]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53b6e6d-34a3-4df8-ba00-71da7b93cff1]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:57:27 user nova-compute[73104]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:57:27 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 08:57:27 user nova-compute[73104]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:57:27 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:57:27 user nova-compute[73104]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:57:27 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 08:57:27 user nova-compute[73104]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:57:27 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.149s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] HCTL ('34', '0', '0', 0) found on session 38 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d596697-969a-490d-9054-bd1def07e2a3]: (4, ('0 0 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Searching for a device in session 38 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uRXgQlJf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.172s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] <== connect_volume: return (174ms) {'type': 'block', 'scsi_wwn': '26435663064313430', 'path': '/dev/sdc'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435663064313430', 'path': '/dev/sdc'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:55:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1054489120',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1054489120',id=35,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:56:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a37356203d547c2abf0aa634c2ad548',ramdisk_id='',reservation_id='r-xgt8vddh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1111216102',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:56:03Z,user_data=None,user_id='bcd11beb7046440f814cbf4a13ab0272',uuid=0e3fb03a-d317-4eed-ad52-d066242a13e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd9b2f61-e1a4-47ba-8890-72715a8e241e", "address": "fa:16:3e:ed:2c:7f", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "vif_mac": "fa:16:3e:ed:2c:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd9b2f61-e1", "ovs_interfaceid": "fd9b2f61-e1a4-47ba-8890-72715a8e241e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Converting VIF {"id": "fd9b2f61-e1a4-47ba-8890-72715a8e241e", "address": "fa:16:3e:ed:2c:7f", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "vif_mac": "fa:16:3e:ed:2c:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd9b2f61-e1", "ovs_interfaceid": "fd9b2f61-e1a4-47ba-8890-72715a8e241e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:2c:7f,bridge_name='br-int',has_traffic_filtering=True,id=fd9b2f61-e1a4-47ba-8890-72715a8e241e,network=Network(ce0a529c-2119-4b2a-a08f-567e3671c3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd9b2f61-e1') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.objects.instance [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e3fb03a-d317-4eed-ad52-d066242a13e0 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.objects.base [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Object Instance<0e3fb03a-d317-4eed-ad52-d066242a13e0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:57:27 user nova-compute[73104]:   <uuid>0e3fb03a-d317-4eed-ad52-d066242a13e0</uuid>
Aug 26 08:57:27 user nova-compute[73104]:   <name>instance-00000023</name>
Aug 26 08:57:27 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:57:27 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:57:27 user nova-compute[73104]:   <metadata>
Aug 26 08:57:27 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:57:27 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:57:27 user nova-compute[73104]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1054489120</nova:name>
Aug 26 08:57:27 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:57:27</nova:creationTime>
Aug 26 08:57:27 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:57:27 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:57:27 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:57:27 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:57:27 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:57:27 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:57:27 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:57:27 user nova-compute[73104]:       <nova:owner>
Aug 26 08:57:27 user nova-compute[73104]:         <nova:user uuid="bcd11beb7046440f814cbf4a13ab0272">tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member</nova:user>
Aug 26 08:57:27 user nova-compute[73104]:         <nova:project uuid="8a37356203d547c2abf0aa634c2ad548">tempest-ServerBootFromVolumeStableRescueTest-1111216102</nova:project>
Aug 26 08:57:27 user nova-compute[73104]:       </nova:owner>
Aug 26 08:57:27 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:57:27 user nova-compute[73104]:       <nova:ports>
Aug 26 08:57:27 user nova-compute[73104]:         <nova:port uuid="fd9b2f61-e1a4-47ba-8890-72715a8e241e">
Aug 26 08:57:27 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 08:57:27 user nova-compute[73104]:         </nova:port>
Aug 26 08:57:27 user nova-compute[73104]:       </nova:ports>
Aug 26 08:57:27 user nova-compute[73104]:     </nova:instance>
Aug 26 08:57:27 user nova-compute[73104]:   </metadata>
Aug 26 08:57:27 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:57:27 user nova-compute[73104]:     <system>
Aug 26 08:57:27 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:57:27 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:57:27 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:57:27 user nova-compute[73104]:       <entry name="serial">0e3fb03a-d317-4eed-ad52-d066242a13e0</entry>
Aug 26 08:57:27 user nova-compute[73104]:       <entry name="uuid">0e3fb03a-d317-4eed-ad52-d066242a13e0</entry>
Aug 26 08:57:27 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:57:27 user nova-compute[73104]:     </system>
Aug 26 08:57:27 user nova-compute[73104]:   </sysinfo>
Aug 26 08:57:27 user nova-compute[73104]:   <os>
Aug 26 08:57:27 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:57:27 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:57:27 user nova-compute[73104]:   </os>
Aug 26 08:57:27 user nova-compute[73104]:   <features>
Aug 26 08:57:27 user nova-compute[73104]:     <acpi/>
Aug 26 08:57:27 user nova-compute[73104]:     <apic/>
Aug 26 08:57:27 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:57:27 user nova-compute[73104]:   </features>
Aug 26 08:57:27 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:57:27 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:57:27 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:57:27 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:57:27 user nova-compute[73104]:   </clock>
Aug 26 08:57:27 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:57:27 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:57:27 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:57:27 user nova-compute[73104]:   </cpu>
Aug 26 08:57:27 user nova-compute[73104]:   <devices>
Aug 26 08:57:27 user nova-compute[73104]:     <disk type="block" device="disk">
Aug 26 08:57:27 user nova-compute[73104]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:57:27 user nova-compute[73104]:       <source dev="/dev/sdc"/>
Aug 26 08:57:27 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:57:27 user nova-compute[73104]:       <serial>65bfdc23-25e2-4b96-923f-c523f0e1ddf7</serial>
Aug 26 08:57:27 user nova-compute[73104]:     </disk>
Aug 26 08:57:27 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:57:27 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:57:27 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/0e3fb03a-d317-4eed-ad52-d066242a13e0/disk.rescue"/>
Aug 26 08:57:27 user nova-compute[73104]:       <target dev="vdb" bus="virtio"/>
Aug 26 08:57:27 user nova-compute[73104]:       <boot order="1"/>
Aug 26 08:57:27 user nova-compute[73104]:     </disk>
Aug 26 08:57:27 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:57:27 user nova-compute[73104]:       <mac address="fa:16:3e:ed:2c:7f"/>
Aug 26 08:57:27 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:57:27 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:57:27 user nova-compute[73104]:       <target dev="tapfd9b2f61-e1"/>
Aug 26 08:57:27 user nova-compute[73104]:     </interface>
Aug 26 08:57:27 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:57:27 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/0e3fb03a-d317-4eed-ad52-d066242a13e0/console.log" append="off"/>
Aug 26 08:57:27 user nova-compute[73104]:     </serial>
Aug 26 08:57:27 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:57:27 user nova-compute[73104]:     <video>
Aug 26 08:57:27 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:57:27 user nova-compute[73104]:     </video>
Aug 26 08:57:27 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:57:27 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:57:27 user nova-compute[73104]:     </rng>
Aug 26 08:57:27 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:57:27 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:57:27 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:57:27 user nova-compute[73104]:     </memballoon>
Aug 26 08:57:27 user nova-compute[73104]:   </devices>
Aug 26 08:57:27 user nova-compute[73104]: </domain>
Aug 26 08:57:27 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:57:27 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Instance destroyed successfully.
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:57:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] No VIF found with MAC fa:16:3e:ed:2c:7f, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:57:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:29 user nova-compute[73104]: DEBUG nova.compute.manager [req-6aa9e5b2-7aa5-4284-b0a3-d4c95919b43c req-fd642c2b-5353-4704-8d10-6b76436dbaf1 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Received event network-vif-plugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:57:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6aa9e5b2-7aa5-4284-b0a3-d4c95919b43c req-fd642c2b-5353-4704-8d10-6b76436dbaf1 service nova] Acquiring lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:57:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6aa9e5b2-7aa5-4284-b0a3-d4c95919b43c req-fd642c2b-5353-4704-8d10-6b76436dbaf1 service nova] Lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:57:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6aa9e5b2-7aa5-4284-b0a3-d4c95919b43c req-fd642c2b-5353-4704-8d10-6b76436dbaf1 service nova] Lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:57:29 user nova-compute[73104]: DEBUG nova.compute.manager [req-6aa9e5b2-7aa5-4284-b0a3-d4c95919b43c req-fd642c2b-5353-4704-8d10-6b76436dbaf1 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] No waiting events found dispatching network-vif-plugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:57:29 user nova-compute[73104]: WARNING nova.compute.manager [req-6aa9e5b2-7aa5-4284-b0a3-d4c95919b43c req-fd642c2b-5353-4704-8d10-6b76436dbaf1 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Received unexpected event network-vif-plugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e for instance with vm_state active and task_state rescuing.
Aug 26 08:57:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:30 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693040235.2892282, 6550b41d-2414-4b3e-9a50-9bba88033aae => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:57:30 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] VM Stopped (Lifecycle Event)
Aug 26 08:57:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-fe4a183f-ca22-40f4-956e-223a7ee323aa None None] [instance: 6550b41d-2414-4b3e-9a50-9bba88033aae] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:57:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Removed pending event for 0e3fb03a-d317-4eed-ad52-d066242a13e0 due to event {{(pid=73104) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 08:57:30 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040250.8796558, 0e3fb03a-d317-4eed-ad52-d066242a13e0 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:57:30 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] VM Resumed (Lifecycle Event)
Aug 26 08:57:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-f17f56b5-4e90-41ef-9770-b9e18f031d8a tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:57:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:57:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:57:30 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 08:57:30 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040250.8798254, 0e3fb03a-d317-4eed-ad52-d066242a13e0 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:57:30 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] VM Started (Lifecycle Event)
Aug 26 08:57:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:57:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG nova.compute.manager [req-86222ee7-70ad-4d7f-839e-21c46afb8ff8 req-7f1c20da-a5e9-4745-84a5-953809d69249 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Received event network-vif-plugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-86222ee7-70ad-4d7f-839e-21c46afb8ff8 req-7f1c20da-a5e9-4745-84a5-953809d69249 service nova] Acquiring lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-86222ee7-70ad-4d7f-839e-21c46afb8ff8 req-7f1c20da-a5e9-4745-84a5-953809d69249 service nova] Lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-86222ee7-70ad-4d7f-839e-21c46afb8ff8 req-7f1c20da-a5e9-4745-84a5-953809d69249 service nova] Lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG nova.compute.manager [req-86222ee7-70ad-4d7f-839e-21c46afb8ff8 req-7f1c20da-a5e9-4745-84a5-953809d69249 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] No waiting events found dispatching network-vif-plugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:57:31 user nova-compute[73104]: WARNING nova.compute.manager [req-86222ee7-70ad-4d7f-839e-21c46afb8ff8 req-7f1c20da-a5e9-4745-84a5-953809d69249 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Received unexpected event network-vif-plugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e for instance with vm_state rescued and task_state None.
Aug 26 08:57:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-88d9e63a-cd25-471e-9604-511731ab7997 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "33048996-d559-4b3c-9de9-39bb176c3ec9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-88d9e63a-cd25-471e-9604-511731ab7997 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:57:31 user nova-compute[73104]: INFO nova.compute.manager [None req-88d9e63a-cd25-471e-9604-511731ab7997 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Detaching volume 575b4aa5-1edc-47c1-88ed-42ab59f35a16
Aug 26 08:57:31 user nova-compute[73104]: INFO nova.virt.block_device [None req-88d9e63a-cd25-471e-9604-511731ab7997 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Attempting to driver detach volume 575b4aa5-1edc-47c1-88ed-42ab59f35a16 from mountpoint /dev/vdb
Aug 26 08:57:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-88d9e63a-cd25-471e-9604-511731ab7997 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Attempting to detach device vdb from instance 33048996-d559-4b3c-9de9-39bb176c3ec9 from the persistent domain config. {{(pid=73104) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-88d9e63a-cd25-471e-9604-511731ab7997 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:57:31 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:57:31 user nova-compute[73104]:   <source dev="/dev/sdd"/>
Aug 26 08:57:31 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:57:31 user nova-compute[73104]:   <serial>575b4aa5-1edc-47c1-88ed-42ab59f35a16</serial>
Aug 26 08:57:31 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 08:57:31 user nova-compute[73104]: </disk>
Aug 26 08:57:31 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:57:31 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-88d9e63a-cd25-471e-9604-511731ab7997 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Successfully detached device vdb from instance 33048996-d559-4b3c-9de9-39bb176c3ec9 from the persistent domain config.
Aug 26 08:57:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-88d9e63a-cd25-471e-9604-511731ab7997 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 33048996-d559-4b3c-9de9-39bb176c3ec9 from the live domain config. {{(pid=73104) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-88d9e63a-cd25-471e-9604-511731ab7997 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 08:57:31 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:57:31 user nova-compute[73104]:   <source dev="/dev/sdd"/>
Aug 26 08:57:31 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:57:31 user nova-compute[73104]:   <serial>575b4aa5-1edc-47c1-88ed-42ab59f35a16</serial>
Aug 26 08:57:31 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 08:57:31 user nova-compute[73104]: </disk>
Aug 26 08:57:31 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Received event <DeviceRemovedEvent: 1693040251.7449126, 33048996-d559-4b3c-9de9-39bb176c3ec9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73104) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-88d9e63a-cd25-471e-9604-511731ab7997 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 33048996-d559-4b3c-9de9-39bb176c3ec9 {{(pid=73104) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 08:57:31 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-88d9e63a-cd25-471e-9604-511731ab7997 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Successfully detached device vdb from instance 33048996-d559-4b3c-9de9-39bb176c3ec9 from the live domain config.
Aug 26 08:57:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88d9e63a-cd25-471e-9604-511731ab7997 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d9e63a-cd25-471e-9604-511731ab7997 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cnwzLsMB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:57:31 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-88d9e63a-cd25-471e-9604-511731ab7997 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:57:31 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-88d9e63a-cd25-471e-9604-511731ab7997 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-88d9e63a-cd25-471e-9604-511731ab7997 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d9e63a-cd25-471e-9604-511731ab7997 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[344a016b-e10f-4d0c-9eb2-884d9d71ca17]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[987ce2aa-ed78-4b3c-be7c-70c3157441aa]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d9e63a-cd25-471e-9604-511731ab7997 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:57:31 user nova-compute[73104]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:57:31 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 08:57:31 user nova-compute[73104]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:57:31 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d9e63a-cd25-471e-9604-511731ab7997 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:57:31 user nova-compute[73104]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 (non-flash)
Aug 26 08:57:31 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 08:57:31 user nova-compute[73104]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:57:31 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d9e63a-cd25-471e-9604-511731ab7997 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0c41a15a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16'): ({'sdd'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-88d9e63a-cd25-471e-9604-511731ab7997 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Removing single pathed devices sdd {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ae56ca-3c7c-4ecc-bf8b-09eb4439b9d4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9db1b4-1b52-4e3e-a030-16f15defae51]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-88d9e63a-cd25-471e-9604-511731ab7997 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Flushing IO for device /dev/sdd {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8369f2c3-229d-4294-8b76-3ea33cfa1205]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-88d9e63a-cd25-471e-9604-511731ab7997 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c526ee83-626e-4c45-8b50-cf6c388ec8f3]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-88d9e63a-cd25-471e-9604-511731ab7997 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-88d9e63a-cd25-471e-9604-511731ab7997 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] SCSI volumes sdd have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d9e63a-cd25-471e-9604-511731ab7997 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33c6b7a-7d12-40fe-bdbd-c9d83454f555]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d9e63a-cd25-471e-9604-511731ab7997 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:57:31 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a87617-5832-491f-a0a3-4a965ca92218]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d9e63a-cd25-471e-9604-511731ab7997 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16, portal: 172.16.0.220,3260]
Aug 26 08:57:32 user nova-compute[73104]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16, portal: 172.16.0.220,3260] successful.
Aug 26 08:57:32 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:57:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575b4aa5-1edc-47c1-88ed-42ab59f35a16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9063e90e-d842-47d5-8641-6af4f0305fda]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d9e63a-cd25-471e-9604-511731ab7997 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:57:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-88d9e63a-cd25-471e-9604-511731ab7997 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:57:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d9e63a-cd25-471e-9604-511731ab7997 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] <== disconnect_volume: return (284ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:57:32 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88d9e63a-cd25-471e-9604-511731ab7997 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 08:57:32 user nova-compute[73104]: DEBUG nova.objects.instance [None req-88d9e63a-cd25-471e-9604-511731ab7997 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lazy-loading 'flavor' on Instance uuid 33048996-d559-4b3c-9de9-39bb176c3ec9 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:57:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-88d9e63a-cd25-471e-9604-511731ab7997 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.703s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:57:33 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693040238.0115166, 67c5d379-7e2a-415b-a0a5-530afec0b1ea => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:57:33 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] VM Stopped (Lifecycle Event)
Aug 26 08:57:33 user nova-compute[73104]: DEBUG nova.compute.manager [None req-3673c6c9-b2f2-40b9-bf27-756b6f27b72f None None] [instance: 67c5d379-7e2a-415b-a0a5-530afec0b1ea] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:57:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fcda95c8-3328-44f6-8097-052ca5ebe2f4 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "33048996-d559-4b3c-9de9-39bb176c3ec9" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:57:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fcda95c8-3328-44f6-8097-052ca5ebe2f4 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:57:33 user nova-compute[73104]: DEBUG nova.compute.manager [None req-fcda95c8-3328-44f6-8097-052ca5ebe2f4 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:57:33 user nova-compute[73104]: DEBUG nova.compute.manager [None req-fcda95c8-3328-44f6-8097-052ca5ebe2f4 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73104) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 26 08:57:33 user nova-compute[73104]: DEBUG nova.objects.instance [None req-fcda95c8-3328-44f6-8097-052ca5ebe2f4 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lazy-loading 'flavor' on Instance uuid 33048996-d559-4b3c-9de9-39bb176c3ec9 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:57:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:33 user nova-compute[73104]: DEBUG nova.compute.manager [req-33fae8f7-83fa-4702-999f-0697bb187076 req-917dfb68-a3a3-4e7e-943d-5a2f1e0296e9 service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Received event network-vif-unplugged-4c1b906e-2c49-4642-9183-06292be46de4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:57:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-33fae8f7-83fa-4702-999f-0697bb187076 req-917dfb68-a3a3-4e7e-943d-5a2f1e0296e9 service nova] Acquiring lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:57:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-33fae8f7-83fa-4702-999f-0697bb187076 req-917dfb68-a3a3-4e7e-943d-5a2f1e0296e9 service nova] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:57:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-33fae8f7-83fa-4702-999f-0697bb187076 req-917dfb68-a3a3-4e7e-943d-5a2f1e0296e9 service nova] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:57:33 user nova-compute[73104]: DEBUG nova.compute.manager [req-33fae8f7-83fa-4702-999f-0697bb187076 req-917dfb68-a3a3-4e7e-943d-5a2f1e0296e9 service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] No waiting events found dispatching network-vif-unplugged-4c1b906e-2c49-4642-9183-06292be46de4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:57:33 user nova-compute[73104]: WARNING nova.compute.manager [req-33fae8f7-83fa-4702-999f-0697bb187076 req-917dfb68-a3a3-4e7e-943d-5a2f1e0296e9 service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Received unexpected event network-vif-unplugged-4c1b906e-2c49-4642-9183-06292be46de4 for instance with vm_state active and task_state powering-off.
Aug 26 08:57:34 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Instance destroyed successfully.
Aug 26 08:57:34 user nova-compute[73104]: DEBUG nova.compute.manager [None req-fcda95c8-3328-44f6-8097-052ca5ebe2f4 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:57:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fcda95c8-3328-44f6-8097-052ca5ebe2f4 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.884s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:57:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:36 user nova-compute[73104]: DEBUG nova.compute.manager [req-ce2148fd-274a-4b44-97b2-ac5f6e377312 req-4116bc47-1728-4e70-a875-d3d0b3cb8c19 service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Received event network-vif-plugged-4c1b906e-2c49-4642-9183-06292be46de4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:57:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ce2148fd-274a-4b44-97b2-ac5f6e377312 req-4116bc47-1728-4e70-a875-d3d0b3cb8c19 service nova] Acquiring lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:57:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ce2148fd-274a-4b44-97b2-ac5f6e377312 req-4116bc47-1728-4e70-a875-d3d0b3cb8c19 service nova] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:57:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ce2148fd-274a-4b44-97b2-ac5f6e377312 req-4116bc47-1728-4e70-a875-d3d0b3cb8c19 service nova] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:57:36 user nova-compute[73104]: DEBUG nova.compute.manager [req-ce2148fd-274a-4b44-97b2-ac5f6e377312 req-4116bc47-1728-4e70-a875-d3d0b3cb8c19 service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] No waiting events found dispatching network-vif-plugged-4c1b906e-2c49-4642-9183-06292be46de4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:57:36 user nova-compute[73104]: WARNING nova.compute.manager [req-ce2148fd-274a-4b44-97b2-ac5f6e377312 req-4116bc47-1728-4e70-a875-d3d0b3cb8c19 service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Received unexpected event network-vif-plugged-4c1b906e-2c49-4642-9183-06292be46de4 for instance with vm_state stopped and task_state None.
Aug 26 08:57:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-49c28b94-7890-412d-8ee3-624b3d5b6b12 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "c08a447c-e25d-4f88-b15f-0c3de12559aa" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:57:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-49c28b94-7890-412d-8ee3-624b3d5b6b12 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "c08a447c-e25d-4f88-b15f-0c3de12559aa" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:57:40 user nova-compute[73104]: DEBUG nova.compute.manager [None req-49c28b94-7890-412d-8ee3-624b3d5b6b12 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Going to confirm migration 2 {{(pid=73104) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 26 08:57:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-49c28b94-7890-412d-8ee3-624b3d5b6b12 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "refresh_cache-c08a447c-e25d-4f88-b15f-0c3de12559aa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:57:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-49c28b94-7890-412d-8ee3-624b3d5b6b12 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquired lock "refresh_cache-c08a447c-e25d-4f88-b15f-0c3de12559aa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:57:40 user nova-compute[73104]: DEBUG nova.network.neutron [None req-49c28b94-7890-412d-8ee3-624b3d5b6b12 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:57:40 user nova-compute[73104]: DEBUG nova.objects.instance [None req-49c28b94-7890-412d-8ee3-624b3d5b6b12 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lazy-loading 'info_cache' on Instance uuid c08a447c-e25d-4f88-b15f-0c3de12559aa {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:57:41 user nova-compute[73104]: DEBUG nova.network.neutron [None req-49c28b94-7890-412d-8ee3-624b3d5b6b12 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Updating instance_info_cache with network_info: [{"id": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "address": "fa:16:3e:3a:b1:b8", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15317ff8-61", "ovs_interfaceid": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:57:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-49c28b94-7890-412d-8ee3-624b3d5b6b12 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Releasing lock "refresh_cache-c08a447c-e25d-4f88-b15f-0c3de12559aa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:57:41 user nova-compute[73104]: DEBUG nova.objects.instance [None req-49c28b94-7890-412d-8ee3-624b3d5b6b12 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lazy-loading 'migration_context' on Instance uuid c08a447c-e25d-4f88-b15f-0c3de12559aa {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:57:41 user nova-compute[73104]: DEBUG nova.objects.base [None req-49c28b94-7890-412d-8ee3-624b3d5b6b12 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Object Instance<c08a447c-e25d-4f88-b15f-0c3de12559aa> lazy-loaded attributes: info_cache,migration_context {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:57:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-49c28b94-7890-412d-8ee3-624b3d5b6b12 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:57:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-49c28b94-7890-412d-8ee3-624b3d5b6b12 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:57:41 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-49c28b94-7890-412d-8ee3-624b3d5b6b12 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:57:41 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-49c28b94-7890-412d-8ee3-624b3d5b6b12 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:57:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-49c28b94-7890-412d-8ee3-624b3d5b6b12 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.412s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:57:42 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-49c28b94-7890-412d-8ee3-624b3d5b6b12 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Deleted allocation for migration ab4b68e2-bb57-4dbe-ae35-63217e962a8b
Aug 26 08:57:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-49c28b94-7890-412d-8ee3-624b3d5b6b12 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "c08a447c-e25d-4f88-b15f-0c3de12559aa" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.623s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:57:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:57:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 08:57:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 08:57:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 08:57:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:49 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693040254.381452, 33048996-d559-4b3c-9de9-39bb176c3ec9 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:57:49 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] VM Stopped (Lifecycle Event)
Aug 26 08:57:49 user nova-compute[73104]: DEBUG nova.compute.manager [None req-2ec3c01e-6120-482b-ab7c-af121e459dd6 None None] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:57:49 user nova-compute[73104]: DEBUG nova.compute.manager [None req-2ec3c01e-6120-482b-ab7c-af121e459dd6 None None] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:57:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:57:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:57:56 user nova-compute[73104]: DEBUG nova.objects.instance [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lazy-loading 'flavor' on Instance uuid f9cadc09-e4ec-4d5c-a22d-912e92c09cff {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:57:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:57:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:57:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:57:57 user nova-compute[73104]: INFO nova.compute.manager [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Attaching volume f22219c0-eb5d-4a8d-9acc-0f6208525aae to /dev/vdb
Aug 26 08:57:57 user nova-compute[73104]: DEBUG os_brick.utils [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:57:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4d16ac-0f42-4f26-b6a9-53a90e8e9844]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[188804b1-51af-42fb-9d3d-6d0b3bb3366d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:57:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98a1347-926d-4d6b-be21-99faa24c84e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4da37f-399a-42e0-b794-a4fa823184d3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:57:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:57:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:57:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:57:57 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:57:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff5105e-6c13-4f0a-812b-bd64551bd7ea]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:57:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:57:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:57:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:57:57 user nova-compute[73104]: DEBUG os_brick.utils [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:57:57 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Updating existing volume attachment record: c863736d-4cfd-4a3e-976b-08096ae63787 {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 08:57:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:57:59 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:57:59 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73104) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 08:57:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:00 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:58:00 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:58:01 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:58:01 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 08:58:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:03 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:58:03 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:58:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:04 user nova-compute[73104]: DEBUG nova.compute.manager [req-b3f2b37a-bdea-4f4b-b286-bcbc8d525194 req-9a3be7d4-3fde-40e5-8353-bd7b2825100f service nova] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Received event network-changed-3c47a327-42ad-484a-8cf8-33e131233bcd {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:58:04 user nova-compute[73104]: DEBUG nova.compute.manager [req-b3f2b37a-bdea-4f4b-b286-bcbc8d525194 req-9a3be7d4-3fde-40e5-8353-bd7b2825100f service nova] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Refreshing instance network info cache due to event network-changed-3c47a327-42ad-484a-8cf8-33e131233bcd. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:58:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b3f2b37a-bdea-4f4b-b286-bcbc8d525194 req-9a3be7d4-3fde-40e5-8353-bd7b2825100f service nova] Acquiring lock "refresh_cache-1b45635b-062b-4149-8789-9f5191132cbd" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:58:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b3f2b37a-bdea-4f4b-b286-bcbc8d525194 req-9a3be7d4-3fde-40e5-8353-bd7b2825100f service nova] Acquired lock "refresh_cache-1b45635b-062b-4149-8789-9f5191132cbd" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:58:04 user nova-compute[73104]: DEBUG nova.network.neutron [req-b3f2b37a-bdea-4f4b-b286-bcbc8d525194 req-9a3be7d4-3fde-40e5-8353-bd7b2825100f service nova] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Refreshing network info cache for port 3c47a327-42ad-484a-8cf8-33e131233bcd {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:58:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d5092ee9-d9a3-40bd-8b8f-1dd946d93b18 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Acquiring lock "1b45635b-062b-4149-8789-9f5191132cbd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:58:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d5092ee9-d9a3-40bd-8b8f-1dd946d93b18 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "1b45635b-062b-4149-8789-9f5191132cbd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:58:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d5092ee9-d9a3-40bd-8b8f-1dd946d93b18 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Acquiring lock "1b45635b-062b-4149-8789-9f5191132cbd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:58:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d5092ee9-d9a3-40bd-8b8f-1dd946d93b18 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "1b45635b-062b-4149-8789-9f5191132cbd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:58:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d5092ee9-d9a3-40bd-8b8f-1dd946d93b18 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "1b45635b-062b-4149-8789-9f5191132cbd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:58:04 user nova-compute[73104]: INFO nova.compute.manager [None req-d5092ee9-d9a3-40bd-8b8f-1dd946d93b18 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Terminating instance
Aug 26 08:58:04 user nova-compute[73104]: DEBUG nova.compute.manager [None req-d5092ee9-d9a3-40bd-8b8f-1dd946d93b18 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 08:58:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:05 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:58:05 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:58:05 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:58:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:58:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:58:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:58:05 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 08:58:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:05 user nova-compute[73104]: DEBUG nova.network.neutron [req-b3f2b37a-bdea-4f4b-b286-bcbc8d525194 req-9a3be7d4-3fde-40e5-8353-bd7b2825100f service nova] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Updated VIF entry in instance network info cache for port 3c47a327-42ad-484a-8cf8-33e131233bcd. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:58:05 user nova-compute[73104]: DEBUG nova.network.neutron [req-b3f2b37a-bdea-4f4b-b286-bcbc8d525194 req-9a3be7d4-3fde-40e5-8353-bd7b2825100f service nova] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Updating instance_info_cache with network_info: [{"id": "3c47a327-42ad-484a-8cf8-33e131233bcd", "address": "fa:16:3e:0a:fc:e5", "network": {"id": "bb0ed7b6-f1d2-41e5-b975-926555200ac9", "bridge": "br-int", "label": "tempest-TestStampPattern-89239905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f8b4744aa5450ca396714b74a01049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c47a327-42", "ovs_interfaceid": "3c47a327-42ad-484a-8cf8-33e131233bcd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:58:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b3f2b37a-bdea-4f4b-b286-bcbc8d525194 req-9a3be7d4-3fde-40e5-8353-bd7b2825100f service nova] Releasing lock "refresh_cache-1b45635b-062b-4149-8789-9f5191132cbd" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:58:05 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Instance destroyed successfully.
Aug 26 08:58:05 user nova-compute[73104]: DEBUG nova.objects.instance [None req-d5092ee9-d9a3-40bd-8b8f-1dd946d93b18 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lazy-loading 'resources' on Instance uuid 1b45635b-062b-4149-8789-9f5191132cbd {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:58:05 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-d5092ee9-d9a3-40bd-8b8f-1dd946d93b18 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:55:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1006978630',display_name='tempest-TestStampPattern-server-1006978630',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1006978630',id=33,image_ref='68910971-ab50-4eeb-8296-e6f5bd45dea6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8q5d7Z9/2Nnhi0JZhZxh3ataNnlHeSdFDCIuYvXZBV7m47ag+i9lJBSd6jnykjIfpVABlmqnqwhluVSlzPsJtT5zAJjK/bV+KbeeT0wsKSGG3sFgDqmXkgbk2fMo0ekA==',key_name='tempest-TestStampPattern-1398766845',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:55:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b4f8b4744aa5450ca396714b74a01049',ramdisk_id='',reservation_id='r-zfd9a83l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='945acd46-42e2-4c45-b8e5-9ea94703bc66',image_min_disk='1',image_min_ram='0',image_owner_id='b4f8b4744aa5450ca396714b74a01049',image_owner_project_name='tempest-TestStampPattern-1989133217',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1989133217-project-member',image_user_id='dea79c0b1d874d27b63d7e5418d12505',owner_project_name='tempest-TestStampPattern-1989133217',owner_user_name='tempest-TestStampPattern-1989133217-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:55:14Z,user_data=None,user_id='dea79c0b1d874d27b63d7e5418d12505',uuid=1b45635b-062b-4149-8789-9f5191132cbd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c47a327-42ad-484a-8cf8-33e131233bcd", "address": "fa:16:3e:0a:fc:e5", "network": {"id": "bb0ed7b6-f1d2-41e5-b975-926555200ac9", "bridge": "br-int", "label": "tempest-TestStampPattern-89239905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f8b4744aa5450ca396714b74a01049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c47a327-42", "ovs_interfaceid": "3c47a327-42ad-484a-8cf8-33e131233bcd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:58:05 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-d5092ee9-d9a3-40bd-8b8f-1dd946d93b18 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Converting VIF {"id": "3c47a327-42ad-484a-8cf8-33e131233bcd", "address": "fa:16:3e:0a:fc:e5", "network": {"id": "bb0ed7b6-f1d2-41e5-b975-926555200ac9", "bridge": "br-int", "label": "tempest-TestStampPattern-89239905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f8b4744aa5450ca396714b74a01049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c47a327-42", "ovs_interfaceid": "3c47a327-42ad-484a-8cf8-33e131233bcd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:58:05 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-d5092ee9-d9a3-40bd-8b8f-1dd946d93b18 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:fc:e5,bridge_name='br-int',has_traffic_filtering=True,id=3c47a327-42ad-484a-8cf8-33e131233bcd,network=Network(bb0ed7b6-f1d2-41e5-b975-926555200ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c47a327-42') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:58:05 user nova-compute[73104]: DEBUG os_vif [None req-d5092ee9-d9a3-40bd-8b8f-1dd946d93b18 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:fc:e5,bridge_name='br-int',has_traffic_filtering=True,id=3c47a327-42ad-484a-8cf8-33e131233bcd,network=Network(bb0ed7b6-f1d2-41e5-b975-926555200ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c47a327-42') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:58:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c47a327-42, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:58:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:58:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:05 user nova-compute[73104]: INFO os_vif [None req-d5092ee9-d9a3-40bd-8b8f-1dd946d93b18 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:fc:e5,bridge_name='br-int',has_traffic_filtering=True,id=3c47a327-42ad-484a-8cf8-33e131233bcd,network=Network(bb0ed7b6-f1d2-41e5-b975-926555200ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c47a327-42')
Aug 26 08:58:05 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-d5092ee9-d9a3-40bd-8b8f-1dd946d93b18 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Deleting instance files /opt/stack/data/nova/instances/1b45635b-062b-4149-8789-9f5191132cbd_del
Aug 26 08:58:05 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-d5092ee9-d9a3-40bd-8b8f-1dd946d93b18 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Deletion of /opt/stack/data/nova/instances/1b45635b-062b-4149-8789-9f5191132cbd_del complete
Aug 26 08:58:05 user nova-compute[73104]: INFO nova.compute.manager [None req-d5092ee9-d9a3-40bd-8b8f-1dd946d93b18 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 26 08:58:05 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-d5092ee9-d9a3-40bd-8b8f-1dd946d93b18 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 08:58:05 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 08:58:05 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 08:58:05 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Error from libvirt while getting description of instance-00000021: [Error Code 42] Domain not found: no domain with matching uuid '1b45635b-062b-4149-8789-9f5191132cbd' (instance-00000021): libvirt.libvirtError: Domain not found: no domain with matching uuid '1b45635b-062b-4149-8789-9f5191132cbd' (instance-00000021)
Aug 26 08:58:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:58:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:58:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:58:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:58:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:58:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:58:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:58:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:58:06 user nova-compute[73104]: DEBUG nova.compute.manager [req-5fe9152b-cc66-4d26-be25-127ee5b564a3 req-058c8a11-dc41-4e13-98c4-cc1d5f69642a service nova] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Received event network-vif-deleted-3c47a327-42ad-484a-8cf8-33e131233bcd {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:58:06 user nova-compute[73104]: INFO nova.compute.manager [req-5fe9152b-cc66-4d26-be25-127ee5b564a3 req-058c8a11-dc41-4e13-98c4-cc1d5f69642a service nova] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Neutron deleted interface 3c47a327-42ad-484a-8cf8-33e131233bcd; detaching it from the instance and deleting it from the info cache
Aug 26 08:58:06 user nova-compute[73104]: DEBUG nova.network.neutron [req-5fe9152b-cc66-4d26-be25-127ee5b564a3 req-058c8a11-dc41-4e13-98c4-cc1d5f69642a service nova] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:58:06 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:58:06 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Took 0.73 seconds to deallocate network for instance.
Aug 26 08:58:06 user nova-compute[73104]: DEBUG nova.compute.manager [req-5fe9152b-cc66-4d26-be25-127ee5b564a3 req-058c8a11-dc41-4e13-98c4-cc1d5f69642a service nova] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Detach interface failed, port_id=3c47a327-42ad-484a-8cf8-33e131233bcd, reason: Instance 1b45635b-062b-4149-8789-9f5191132cbd could not be found. {{(pid=73104) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 08:58:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d5092ee9-d9a3-40bd-8b8f-1dd946d93b18 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:58:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d5092ee9-d9a3-40bd-8b8f-1dd946d93b18 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:58:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:58:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:58:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e3fb03a-d317-4eed-ad52-d066242a13e0/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:58:06 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-d5092ee9-d9a3-40bd-8b8f-1dd946d93b18 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Refreshing inventories for resource provider 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 08:58:06 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-d5092ee9-d9a3-40bd-8b8f-1dd946d93b18 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Updating ProviderTree inventory for provider 8a2a2397-4d47-4524-8146-84db4225a812 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 08:58:06 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-d5092ee9-d9a3-40bd-8b8f-1dd946d93b18 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Updating inventory in ProviderTree for provider 8a2a2397-4d47-4524-8146-84db4225a812 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 08:58:06 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-d5092ee9-d9a3-40bd-8b8f-1dd946d93b18 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Refreshing aggregate associations for resource provider 8a2a2397-4d47-4524-8146-84db4225a812, aggregates: None {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 08:58:06 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-d5092ee9-d9a3-40bd-8b8f-1dd946d93b18 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Refreshing trait associations for resource provider 8a2a2397-4d47-4524-8146-84db4225a812, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 08:58:06 user nova-compute[73104]: DEBUG nova.compute.manager [req-88f66088-1cf3-449a-aafb-0f527af74133 req-4bfef0ad-b2ab-44e7-8d7e-2e1b476b589b service nova] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Received event network-vif-unplugged-3c47a327-42ad-484a-8cf8-33e131233bcd {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:58:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-88f66088-1cf3-449a-aafb-0f527af74133 req-4bfef0ad-b2ab-44e7-8d7e-2e1b476b589b service nova] Acquiring lock "1b45635b-062b-4149-8789-9f5191132cbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:58:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-88f66088-1cf3-449a-aafb-0f527af74133 req-4bfef0ad-b2ab-44e7-8d7e-2e1b476b589b service nova] Lock "1b45635b-062b-4149-8789-9f5191132cbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:58:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-88f66088-1cf3-449a-aafb-0f527af74133 req-4bfef0ad-b2ab-44e7-8d7e-2e1b476b589b service nova] Lock "1b45635b-062b-4149-8789-9f5191132cbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:58:06 user nova-compute[73104]: DEBUG nova.compute.manager [req-88f66088-1cf3-449a-aafb-0f527af74133 req-4bfef0ad-b2ab-44e7-8d7e-2e1b476b589b service nova] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] No waiting events found dispatching network-vif-unplugged-3c47a327-42ad-484a-8cf8-33e131233bcd {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:58:06 user nova-compute[73104]: WARNING nova.compute.manager [req-88f66088-1cf3-449a-aafb-0f527af74133 req-4bfef0ad-b2ab-44e7-8d7e-2e1b476b589b service nova] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Received unexpected event network-vif-unplugged-3c47a327-42ad-484a-8cf8-33e131233bcd for instance with vm_state deleted and task_state None.
Aug 26 08:58:06 user nova-compute[73104]: DEBUG nova.compute.manager [req-88f66088-1cf3-449a-aafb-0f527af74133 req-4bfef0ad-b2ab-44e7-8d7e-2e1b476b589b service nova] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Received event network-vif-plugged-3c47a327-42ad-484a-8cf8-33e131233bcd {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:58:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-88f66088-1cf3-449a-aafb-0f527af74133 req-4bfef0ad-b2ab-44e7-8d7e-2e1b476b589b service nova] Acquiring lock "1b45635b-062b-4149-8789-9f5191132cbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:58:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-88f66088-1cf3-449a-aafb-0f527af74133 req-4bfef0ad-b2ab-44e7-8d7e-2e1b476b589b service nova] Lock "1b45635b-062b-4149-8789-9f5191132cbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:58:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-88f66088-1cf3-449a-aafb-0f527af74133 req-4bfef0ad-b2ab-44e7-8d7e-2e1b476b589b service nova] Lock "1b45635b-062b-4149-8789-9f5191132cbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:58:06 user nova-compute[73104]: DEBUG nova.compute.manager [req-88f66088-1cf3-449a-aafb-0f527af74133 req-4bfef0ad-b2ab-44e7-8d7e-2e1b476b589b service nova] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] No waiting events found dispatching network-vif-plugged-3c47a327-42ad-484a-8cf8-33e131233bcd {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:58:06 user nova-compute[73104]: WARNING nova.compute.manager [req-88f66088-1cf3-449a-aafb-0f527af74133 req-4bfef0ad-b2ab-44e7-8d7e-2e1b476b589b service nova] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Received unexpected event network-vif-plugged-3c47a327-42ad-484a-8cf8-33e131233bcd for instance with vm_state deleted and task_state None.
Aug 26 08:58:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e3fb03a-d317-4eed-ad52-d066242a13e0/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:58:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e3fb03a-d317-4eed-ad52-d066242a13e0/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:58:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e3fb03a-d317-4eed-ad52-d066242a13e0/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:58:07 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:58:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:58:07 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-d5092ee9-d9a3-40bd-8b8f-1dd946d93b18 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:58:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:58:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:58:07 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-d5092ee9-d9a3-40bd-8b8f-1dd946d93b18 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:58:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d5092ee9-d9a3-40bd-8b8f-1dd946d93b18 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.738s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:58:07 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-d5092ee9-d9a3-40bd-8b8f-1dd946d93b18 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Deleted allocations for instance 1b45635b-062b-4149-8789-9f5191132cbd
Aug 26 08:58:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:58:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:58:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d5092ee9-d9a3-40bd-8b8f-1dd946d93b18 tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "1b45635b-062b-4149-8789-9f5191132cbd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.607s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:58:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:58:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:58:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:58:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9cadc09-e4ec-4d5c-a22d-912e92c09cff/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ngpSfdza', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:58:08 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:58:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:58:08 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:58:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:58:08 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93ef6e9-bba5-48c0-add6-652ee6653808]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:58:08 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f6d2f5-2b24-4775-b73a-ff3e7d789a0b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae] added
Aug 26 08:58:08 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3394d205-4c5c-4b8b-93ab-bf610cca3df9]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.051s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38665ea-d9c3-4af7-aaf3-3f2aadae1a9d]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ngpSfdza {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ngpSfdza" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77d6098-74c2-477f-a4cd-fedcb69603d4]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ngpSfdza'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9cadc09-e4ec-4d5c-a22d-912e92c09cff/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9cadc09-e4ec-4d5c-a22d-912e92c09cff/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14bb8df-4526-45d1-8f6b-218a4e56afbc]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d4e402-029e-496c-954e-4a51f31a24ae]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:58:08 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 08:58:08 user nova-compute[73104]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:58:08 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:58:08 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 08:58:08 user nova-compute[73104]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:58:08 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[944d346b-7605-4209-aa25-dbc0e3b69cd4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae, portal: 172.16.0.220,3260]
Aug 26 08:58:08 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae, portal: 172.16.0.220,3260] successful.
Aug 26 08:58:08 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b9e8e0-15e9-4d87-a656-b2d21f3ea8c8]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9cadc09-e4ec-4d5c-a22d-912e92c09cff/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[862e614a-820f-475f-845c-5876e863c767]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:58:08 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 08:58:08 user nova-compute[73104]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:58:08 user nova-compute[73104]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae (non-flash)
Aug 26 08:58:08 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:58:08 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 08:58:08 user nova-compute[73104]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:58:08 user nova-compute[73104]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae (non-flash)
Aug 26 08:58:08 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:58:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f9411c-bc90-4ec0-b12c-b4deabdcdb38]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ngpSfdza', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.815s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] <== connect_volume: return (818ms) {'type': 'block', 'scsi_wwn': '23666666165303831', 'path': '/dev/sdd'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666666165303831', 'path': '/dev/sdd'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:58:09 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:58:09 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:58:09 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=7731MB free_disk=23.7864990234375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG nova.objects.instance [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lazy-loading 'flavor' on Instance uuid f9cadc09-e4ec-4d5c-a22d-912e92c09cff {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 08:58:09 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:58:09 user nova-compute[73104]:   <source dev="/dev/sdd"/>
Aug 26 08:58:09 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 08:58:09 user nova-compute[73104]:   <serial>f22219c0-eb5d-4a8d-9acc-0f6208525aae</serial>
Aug 26 08:58:09 user nova-compute[73104]: </disk>
Aug 26 08:58:09 user nova-compute[73104]:  {{(pid=73104) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance b5e1f82c-5675-4c37-8ba2-44e6a341a576 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 3cf85d2f-de0d-4e9b-a534-98c799ae8db9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance bef1e493-6b2c-4688-98c2-647261feb571 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 33048996-d559-4b3c-9de9-39bb176c3ec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 945acd46-42e2-4c45-b8e5-9ea94703bc66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance bf35aa10-80b1-4518-88b3-63c6a11e626b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 0e3fb03a-d317-4eed-ad52-d066242a13e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance c08a447c-e25d-4f88-b15f-0c3de12559aa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance f9cadc09-e4ec-4d5c-a22d-912e92c09cff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] No VIF found with MAC fa:16:3e:50:6f:2d, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.698s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Cleaning up deleted instances {{(pid=73104) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] There are 0 instances to clean {{(pid=73104) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 08:58:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-28cd9074-07fe-44dc-9091-28a5d6990745 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.891s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:58:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:11 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:58:11 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 08:58:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-33048996-d559-4b3c-9de9-39bb176c3ec9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:58:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-33048996-d559-4b3c-9de9-39bb176c3ec9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:58:11 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 08:58:13 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Updating instance_info_cache with network_info: [{"id": "4c1b906e-2c49-4642-9183-06292be46de4", "address": "fa:16:3e:7e:7d:6c", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1b906e-2c", "ovs_interfaceid": "4c1b906e-2c49-4642-9183-06292be46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:58:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-33048996-d559-4b3c-9de9-39bb176c3ec9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:58:13 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 08:58:13 user nova-compute[73104]: DEBUG nova.compute.manager [req-9b1bffec-0326-48c4-81f7-3fe4bab878c4 req-774da08d-44b3-410a-9c91-6707e9acb82f service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Received event network-changed-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:58:13 user nova-compute[73104]: DEBUG nova.compute.manager [req-9b1bffec-0326-48c4-81f7-3fe4bab878c4 req-774da08d-44b3-410a-9c91-6707e9acb82f service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Refreshing instance network info cache due to event network-changed-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:58:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9b1bffec-0326-48c4-81f7-3fe4bab878c4 req-774da08d-44b3-410a-9c91-6707e9acb82f service nova] Acquiring lock "refresh_cache-f9cadc09-e4ec-4d5c-a22d-912e92c09cff" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:58:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9b1bffec-0326-48c4-81f7-3fe4bab878c4 req-774da08d-44b3-410a-9c91-6707e9acb82f service nova] Acquired lock "refresh_cache-f9cadc09-e4ec-4d5c-a22d-912e92c09cff" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:58:13 user nova-compute[73104]: DEBUG nova.network.neutron [req-9b1bffec-0326-48c4-81f7-3fe4bab878c4 req-774da08d-44b3-410a-9c91-6707e9acb82f service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Refreshing network info cache for port 4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:58:14 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:58:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:14 user nova-compute[73104]: DEBUG nova.network.neutron [req-9b1bffec-0326-48c4-81f7-3fe4bab878c4 req-774da08d-44b3-410a-9c91-6707e9acb82f service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Updated VIF entry in instance network info cache for port 4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:58:14 user nova-compute[73104]: DEBUG nova.network.neutron [req-9b1bffec-0326-48c4-81f7-3fe4bab878c4 req-774da08d-44b3-410a-9c91-6707e9acb82f service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Updating instance_info_cache with network_info: [{"id": "4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6", "address": "fa:16:3e:50:6f:2d", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7f3393-fe", "ovs_interfaceid": "4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:58:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9b1bffec-0326-48c4-81f7-3fe4bab878c4 req-774da08d-44b3-410a-9c91-6707e9acb82f service nova] Releasing lock "refresh_cache-f9cadc09-e4ec-4d5c-a22d-912e92c09cff" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:58:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-65f5dbb3-b30b-4f5b-8f5e-7edc5b27e131 req-55e3cd22-3397-4338-9138-7b542f364613 service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Received event network-changed-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:58:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-65f5dbb3-b30b-4f5b-8f5e-7edc5b27e131 req-55e3cd22-3397-4338-9138-7b542f364613 service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Refreshing instance network info cache due to event network-changed-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:58:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-65f5dbb3-b30b-4f5b-8f5e-7edc5b27e131 req-55e3cd22-3397-4338-9138-7b542f364613 service nova] Acquiring lock "refresh_cache-f9cadc09-e4ec-4d5c-a22d-912e92c09cff" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:58:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-65f5dbb3-b30b-4f5b-8f5e-7edc5b27e131 req-55e3cd22-3397-4338-9138-7b542f364613 service nova] Acquired lock "refresh_cache-f9cadc09-e4ec-4d5c-a22d-912e92c09cff" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:58:16 user nova-compute[73104]: DEBUG nova.network.neutron [req-65f5dbb3-b30b-4f5b-8f5e-7edc5b27e131 req-55e3cd22-3397-4338-9138-7b542f364613 service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Refreshing network info cache for port 4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:58:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-06dc5d42-3afd-4729-bea5-51bd1f9e2af9 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:58:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-06dc5d42-3afd-4729-bea5-51bd1f9e2af9 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:58:16 user nova-compute[73104]: INFO nova.compute.manager [None req-06dc5d42-3afd-4729-bea5-51bd1f9e2af9 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Rebooting instance
Aug 26 08:58:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-06dc5d42-3afd-4729-bea5-51bd1f9e2af9 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "refresh_cache-f9cadc09-e4ec-4d5c-a22d-912e92c09cff" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:58:16 user nova-compute[73104]: DEBUG nova.network.neutron [req-65f5dbb3-b30b-4f5b-8f5e-7edc5b27e131 req-55e3cd22-3397-4338-9138-7b542f364613 service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Updated VIF entry in instance network info cache for port 4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:58:16 user nova-compute[73104]: DEBUG nova.network.neutron [req-65f5dbb3-b30b-4f5b-8f5e-7edc5b27e131 req-55e3cd22-3397-4338-9138-7b542f364613 service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Updating instance_info_cache with network_info: [{"id": "4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6", "address": "fa:16:3e:50:6f:2d", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7f3393-fe", "ovs_interfaceid": "4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:58:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-65f5dbb3-b30b-4f5b-8f5e-7edc5b27e131 req-55e3cd22-3397-4338-9138-7b542f364613 service nova] Releasing lock "refresh_cache-f9cadc09-e4ec-4d5c-a22d-912e92c09cff" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:58:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-06dc5d42-3afd-4729-bea5-51bd1f9e2af9 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquired lock "refresh_cache-f9cadc09-e4ec-4d5c-a22d-912e92c09cff" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:58:16 user nova-compute[73104]: DEBUG nova.network.neutron [None req-06dc5d42-3afd-4729-bea5-51bd1f9e2af9 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:58:17 user nova-compute[73104]: DEBUG nova.network.neutron [None req-06dc5d42-3afd-4729-bea5-51bd1f9e2af9 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Updating instance_info_cache with network_info: [{"id": "4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6", "address": "fa:16:3e:50:6f:2d", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7f3393-fe", "ovs_interfaceid": "4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:58:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-06dc5d42-3afd-4729-bea5-51bd1f9e2af9 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Releasing lock "refresh_cache-f9cadc09-e4ec-4d5c-a22d-912e92c09cff" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:58:17 user nova-compute[73104]: DEBUG nova.compute.manager [None req-06dc5d42-3afd-4729-bea5-51bd1f9e2af9 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:58:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:19 user nova-compute[73104]: DEBUG nova.compute.manager [req-883dd4ba-73ea-4784-838a-ecc0bb20a15b req-bb6ac7a9-2e06-46f2-9a23-64b555f41292 service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Received event network-vif-unplugged-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:58:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-883dd4ba-73ea-4784-838a-ecc0bb20a15b req-bb6ac7a9-2e06-46f2-9a23-64b555f41292 service nova] Acquiring lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:58:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-883dd4ba-73ea-4784-838a-ecc0bb20a15b req-bb6ac7a9-2e06-46f2-9a23-64b555f41292 service nova] Lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:58:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-883dd4ba-73ea-4784-838a-ecc0bb20a15b req-bb6ac7a9-2e06-46f2-9a23-64b555f41292 service nova] Lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:58:19 user nova-compute[73104]: DEBUG nova.compute.manager [req-883dd4ba-73ea-4784-838a-ecc0bb20a15b req-bb6ac7a9-2e06-46f2-9a23-64b555f41292 service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] No waiting events found dispatching network-vif-unplugged-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:58:19 user nova-compute[73104]: WARNING nova.compute.manager [req-883dd4ba-73ea-4784-838a-ecc0bb20a15b req-bb6ac7a9-2e06-46f2-9a23-64b555f41292 service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Received unexpected event network-vif-unplugged-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 for instance with vm_state active and task_state reboot_started.
Aug 26 08:58:20 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-06dc5d42-3afd-4729-bea5-51bd1f9e2af9 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Instance shutdown successfully.
Aug 26 08:58:20 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693040285.6702573, 1b45635b-062b-4149-8789-9f5191132cbd => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:58:20 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] VM Stopped (Lifecycle Event)
Aug 26 08:58:20 user nova-compute[73104]: DEBUG nova.compute.manager [None req-bf854e0b-1194-4911-a290-60620b8a59b5 None None] [instance: 1b45635b-062b-4149-8789-9f5191132cbd] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:58:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:21 user nova-compute[73104]: DEBUG nova.compute.manager [req-ca9826d7-618f-42a9-8376-ffb9a750f084 req-cede0b87-fefe-4879-8906-6fbfb17ac86f service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Received event network-vif-plugged-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:58:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ca9826d7-618f-42a9-8376-ffb9a750f084 req-cede0b87-fefe-4879-8906-6fbfb17ac86f service nova] Acquiring lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:58:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ca9826d7-618f-42a9-8376-ffb9a750f084 req-cede0b87-fefe-4879-8906-6fbfb17ac86f service nova] Lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:58:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ca9826d7-618f-42a9-8376-ffb9a750f084 req-cede0b87-fefe-4879-8906-6fbfb17ac86f service nova] Lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:58:21 user nova-compute[73104]: DEBUG nova.compute.manager [req-ca9826d7-618f-42a9-8376-ffb9a750f084 req-cede0b87-fefe-4879-8906-6fbfb17ac86f service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] No waiting events found dispatching network-vif-plugged-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:58:21 user nova-compute[73104]: WARNING nova.compute.manager [req-ca9826d7-618f-42a9-8376-ffb9a750f084 req-cede0b87-fefe-4879-8906-6fbfb17ac86f service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Received unexpected event network-vif-plugged-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 for instance with vm_state active and task_state reboot_started.
Aug 26 08:58:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:24 user nova-compute[73104]: DEBUG nova.compute.manager [req-b5386a86-da63-40f3-950d-6461394225b7 req-e6601dee-c0fa-4c1b-90b9-e89b8298078a service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Received event network-vif-plugged-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:58:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b5386a86-da63-40f3-950d-6461394225b7 req-e6601dee-c0fa-4c1b-90b9-e89b8298078a service nova] Acquiring lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:58:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b5386a86-da63-40f3-950d-6461394225b7 req-e6601dee-c0fa-4c1b-90b9-e89b8298078a service nova] Lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:58:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b5386a86-da63-40f3-950d-6461394225b7 req-e6601dee-c0fa-4c1b-90b9-e89b8298078a service nova] Lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:58:24 user nova-compute[73104]: DEBUG nova.compute.manager [req-b5386a86-da63-40f3-950d-6461394225b7 req-e6601dee-c0fa-4c1b-90b9-e89b8298078a service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] No waiting events found dispatching network-vif-plugged-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:58:24 user nova-compute[73104]: WARNING nova.compute.manager [req-b5386a86-da63-40f3-950d-6461394225b7 req-e6601dee-c0fa-4c1b-90b9-e89b8298078a service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Received unexpected event network-vif-plugged-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 for instance with vm_state active and task_state reboot_started.
Aug 26 08:58:24 user nova-compute[73104]: DEBUG nova.compute.manager [req-b5386a86-da63-40f3-950d-6461394225b7 req-e6601dee-c0fa-4c1b-90b9-e89b8298078a service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Received event network-vif-plugged-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:58:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b5386a86-da63-40f3-950d-6461394225b7 req-e6601dee-c0fa-4c1b-90b9-e89b8298078a service nova] Acquiring lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:58:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b5386a86-da63-40f3-950d-6461394225b7 req-e6601dee-c0fa-4c1b-90b9-e89b8298078a service nova] Lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:58:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b5386a86-da63-40f3-950d-6461394225b7 req-e6601dee-c0fa-4c1b-90b9-e89b8298078a service nova] Lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:58:24 user nova-compute[73104]: DEBUG nova.compute.manager [req-b5386a86-da63-40f3-950d-6461394225b7 req-e6601dee-c0fa-4c1b-90b9-e89b8298078a service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] No waiting events found dispatching network-vif-plugged-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:58:24 user nova-compute[73104]: WARNING nova.compute.manager [req-b5386a86-da63-40f3-950d-6461394225b7 req-e6601dee-c0fa-4c1b-90b9-e89b8298078a service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Received unexpected event network-vif-plugged-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 for instance with vm_state active and task_state reboot_started.
Aug 26 08:58:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Removed pending event for f9cadc09-e4ec-4d5c-a22d-912e92c09cff due to event {{(pid=73104) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 08:58:24 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040304.1231062, f9cadc09-e4ec-4d5c-a22d-912e92c09cff => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:58:24 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] VM Resumed (Lifecycle Event)
Aug 26 08:58:24 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Instance running successfully.
Aug 26 08:58:24 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-06dc5d42-3afd-4729-bea5-51bd1f9e2af9 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Instance soft rebooted successfully.
Aug 26 08:58:24 user nova-compute[73104]: DEBUG nova.compute.manager [None req-06dc5d42-3afd-4729-bea5-51bd1f9e2af9 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:58:24 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:58:24 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:58:24 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 26 08:58:24 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040304.125111, f9cadc09-e4ec-4d5c-a22d-912e92c09cff => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:58:24 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] VM Started (Lifecycle Event)
Aug 26 08:58:24 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:58:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-06dc5d42-3afd-4729-bea5-51bd1f9e2af9 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.555s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:58:24 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:58:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:25 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:35 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:50 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:58:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "4d012737-bb37-4bf0-b4f6-491f2c25da2d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:58:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "4d012737-bb37-4bf0-b4f6-491f2c25da2d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:58:58 user nova-compute[73104]: DEBUG nova.compute.manager [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 08:58:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:58:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:58:58 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 08:58:58 user nova-compute[73104]: INFO nova.compute.claims [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Claim successful on node user
Aug 26 08:58:59 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:58:59 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:58:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:58:59 user nova-compute[73104]: DEBUG nova.compute.manager [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 08:58:59 user nova-compute[73104]: DEBUG nova.compute.manager [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 08:58:59 user nova-compute[73104]: DEBUG nova.network.neutron [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 08:58:59 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 08:58:59 user nova-compute[73104]: DEBUG nova.compute.manager [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 08:58:59 user nova-compute[73104]: INFO nova.virt.block_device [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Booting with volume snapshot b0382629-d65c-47ff-8c95-6b9b8ded5eeb at /dev/vda
Aug 26 08:58:59 user nova-compute[73104]: DEBUG nova.policy [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bae03c9c8a9a40b2af6bd1fefb3561d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52518aa77344432385cfc2b73c63aebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 08:58:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:00 user nova-compute[73104]: DEBUG nova.network.neutron [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Successfully created port: 4c3948af-7a8f-4983-8e2a-c8f2c56403bf {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 08:59:00 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:59:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:01 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:59:01 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:59:01 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 08:59:01 user nova-compute[73104]: DEBUG nova.network.neutron [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Successfully updated port: 4c3948af-7a8f-4983-8e2a-c8f2c56403bf {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 08:59:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "refresh_cache-4d012737-bb37-4bf0-b4f6-491f2c25da2d" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:59:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquired lock "refresh_cache-4d012737-bb37-4bf0-b4f6-491f2c25da2d" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:59:01 user nova-compute[73104]: DEBUG nova.network.neutron [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:59:01 user nova-compute[73104]: DEBUG nova.network.neutron [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 08:59:01 user nova-compute[73104]: DEBUG nova.compute.manager [req-fa705532-fc94-4b43-9046-fc7a27cce781 req-f78f6352-e3eb-417c-bdc1-e89dc866a08e service nova] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Received event network-changed-4c3948af-7a8f-4983-8e2a-c8f2c56403bf {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:59:01 user nova-compute[73104]: DEBUG nova.compute.manager [req-fa705532-fc94-4b43-9046-fc7a27cce781 req-f78f6352-e3eb-417c-bdc1-e89dc866a08e service nova] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Refreshing instance network info cache due to event network-changed-4c3948af-7a8f-4983-8e2a-c8f2c56403bf. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:59:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-fa705532-fc94-4b43-9046-fc7a27cce781 req-f78f6352-e3eb-417c-bdc1-e89dc866a08e service nova] Acquiring lock "refresh_cache-4d012737-bb37-4bf0-b4f6-491f2c25da2d" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:59:01 user nova-compute[73104]: DEBUG nova.network.neutron [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Updating instance_info_cache with network_info: [{"id": "4c3948af-7a8f-4983-8e2a-c8f2c56403bf", "address": "fa:16:3e:3e:ca:c0", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3948af-7a", "ovs_interfaceid": "4c3948af-7a8f-4983-8e2a-c8f2c56403bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:59:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Releasing lock "refresh_cache-4d012737-bb37-4bf0-b4f6-491f2c25da2d" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:59:01 user nova-compute[73104]: DEBUG nova.compute.manager [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Instance network_info: |[{"id": "4c3948af-7a8f-4983-8e2a-c8f2c56403bf", "address": "fa:16:3e:3e:ca:c0", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3948af-7a", "ovs_interfaceid": "4c3948af-7a8f-4983-8e2a-c8f2c56403bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 08:59:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-fa705532-fc94-4b43-9046-fc7a27cce781 req-f78f6352-e3eb-417c-bdc1-e89dc866a08e service nova] Acquired lock "refresh_cache-4d012737-bb37-4bf0-b4f6-491f2c25da2d" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:59:01 user nova-compute[73104]: DEBUG nova.network.neutron [req-fa705532-fc94-4b43-9046-fc7a27cce781 req-f78f6352-e3eb-417c-bdc1-e89dc866a08e service nova] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Refreshing network info cache for port 4c3948af-7a8f-4983-8e2a-c8f2c56403bf {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:59:02 user nova-compute[73104]: DEBUG nova.network.neutron [req-fa705532-fc94-4b43-9046-fc7a27cce781 req-f78f6352-e3eb-417c-bdc1-e89dc866a08e service nova] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Updated VIF entry in instance network info cache for port 4c3948af-7a8f-4983-8e2a-c8f2c56403bf. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:59:02 user nova-compute[73104]: DEBUG nova.network.neutron [req-fa705532-fc94-4b43-9046-fc7a27cce781 req-f78f6352-e3eb-417c-bdc1-e89dc866a08e service nova] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Updating instance_info_cache with network_info: [{"id": "4c3948af-7a8f-4983-8e2a-c8f2c56403bf", "address": "fa:16:3e:3e:ca:c0", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3948af-7a", "ovs_interfaceid": "4c3948af-7a8f-4983-8e2a-c8f2c56403bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:59:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-fa705532-fc94-4b43-9046-fc7a27cce781 req-f78f6352-e3eb-417c-bdc1-e89dc866a08e service nova] Releasing lock "refresh_cache-4d012737-bb37-4bf0-b4f6-491f2c25da2d" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:59:04 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:59:04 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:59:05 user nova-compute[73104]: DEBUG os_brick.utils [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:59:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:59:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:59:05 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2e19eb-a632-47ba-b079-8e774c4bd884]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:59:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:59:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:59:05 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[23709469-5940-4460-ada1-a2be9a7bf1ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:59:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:59:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:59:05 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0953aa4-3679-44cb-b308-c8a5f7cb7b2c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:59:05 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7874e3f-a26e-4feb-a15f-d1ef60939d3e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:59:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:59:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:59:05 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 08:59:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:59:05 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 08:59:05 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 08:59:05 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac254b6-9daa-447a-92ef-581d080651da]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:59:05 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 08:59:05 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 08:59:05 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 08:59:05 user nova-compute[73104]: DEBUG os_brick.utils [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:59:05 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Updating existing volume attachment record: 2d9eacc0-a1f9-4427-ac15-4c9416a48f6e {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 08:59:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:06 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:59:06 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:59:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:59:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:59:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:59:06 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 08:59:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:59:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:59:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:59:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:59:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:59:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:59:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:59:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:59:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:59:07 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:59:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e3fb03a-d317-4eed-ad52-d066242a13e0/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:59:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e3fb03a-d317-4eed-ad52-d066242a13e0/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:59:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e3fb03a-d317-4eed-ad52-d066242a13e0/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:59:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e3fb03a-d317-4eed-ad52-d066242a13e0/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:59:07 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:59:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:59:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:59:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:59:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:59:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:59:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:59:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:59:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:59:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:59:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:59:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:59:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:59:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9cadc09-e4ec-4d5c-a22d-912e92c09cff/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:59:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9cadc09-e4ec-4d5c-a22d-912e92c09cff/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:59:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9cadc09-e4ec-4d5c-a22d-912e92c09cff/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:59:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9cadc09-e4ec-4d5c-a22d-912e92c09cff/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:59:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 08:59:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:09 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:59:09 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:59:09 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=7760MB free_disk=23.863990783691406GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 08:59:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:59:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:59:09 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance b5e1f82c-5675-4c37-8ba2-44e6a341a576 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:59:09 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 3cf85d2f-de0d-4e9b-a534-98c799ae8db9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:59:09 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance bef1e493-6b2c-4688-98c2-647261feb571 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:59:09 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 33048996-d559-4b3c-9de9-39bb176c3ec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:59:09 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 945acd46-42e2-4c45-b8e5-9ea94703bc66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:59:09 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance bf35aa10-80b1-4518-88b3-63c6a11e626b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:59:09 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 0e3fb03a-d317-4eed-ad52-d066242a13e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:59:09 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance c08a447c-e25d-4f88-b15f-0c3de12559aa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:59:09 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance f9cadc09-e4ec-4d5c-a22d-912e92c09cff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:59:09 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 4d012737-bb37-4bf0-b4f6-491f2c25da2d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 08:59:09 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 08:59:09 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 08:59:10 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:59:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:10 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:59:10 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 08:59:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.477s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:59:10 user nova-compute[73104]: DEBUG nova.compute.manager [req-d7b6bc73-7172-44d4-8a82-e299a97d648a req-0595685c-3342-4cfc-8b5d-71b086c1d6a9 service nova] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Received event network-changed-6df89783-82b3-4a16-b2ec-f5f3c2e54884 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:59:10 user nova-compute[73104]: DEBUG nova.compute.manager [req-d7b6bc73-7172-44d4-8a82-e299a97d648a req-0595685c-3342-4cfc-8b5d-71b086c1d6a9 service nova] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Refreshing instance network info cache due to event network-changed-6df89783-82b3-4a16-b2ec-f5f3c2e54884. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 08:59:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d7b6bc73-7172-44d4-8a82-e299a97d648a req-0595685c-3342-4cfc-8b5d-71b086c1d6a9 service nova] Acquiring lock "refresh_cache-945acd46-42e2-4c45-b8e5-9ea94703bc66" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:59:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d7b6bc73-7172-44d4-8a82-e299a97d648a req-0595685c-3342-4cfc-8b5d-71b086c1d6a9 service nova] Acquired lock "refresh_cache-945acd46-42e2-4c45-b8e5-9ea94703bc66" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:59:10 user nova-compute[73104]: DEBUG nova.network.neutron [req-d7b6bc73-7172-44d4-8a82-e299a97d648a req-0595685c-3342-4cfc-8b5d-71b086c1d6a9 service nova] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Refreshing network info cache for port 6df89783-82b3-4a16-b2ec-f5f3c2e54884 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 08:59:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7180f1c7-8495-4e00-bd3b-9d946cbdb56e tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Acquiring lock "945acd46-42e2-4c45-b8e5-9ea94703bc66" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:59:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7180f1c7-8495-4e00-bd3b-9d946cbdb56e tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "945acd46-42e2-4c45-b8e5-9ea94703bc66" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:59:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7180f1c7-8495-4e00-bd3b-9d946cbdb56e tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Acquiring lock "945acd46-42e2-4c45-b8e5-9ea94703bc66-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:59:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7180f1c7-8495-4e00-bd3b-9d946cbdb56e tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "945acd46-42e2-4c45-b8e5-9ea94703bc66-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:59:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7180f1c7-8495-4e00-bd3b-9d946cbdb56e tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "945acd46-42e2-4c45-b8e5-9ea94703bc66-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:59:10 user nova-compute[73104]: INFO nova.compute.manager [None req-7180f1c7-8495-4e00-bd3b-9d946cbdb56e tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Terminating instance
Aug 26 08:59:10 user nova-compute[73104]: DEBUG nova.compute.manager [None req-7180f1c7-8495-4e00-bd3b-9d946cbdb56e tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 08:59:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:10 user nova-compute[73104]: DEBUG nova.compute.manager [req-9519bb75-8931-48f5-bab6-0591c1a63e8c req-b0ff0943-ccec-48e0-93a5-fc742bbd084f service nova] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Received event network-vif-unplugged-6df89783-82b3-4a16-b2ec-f5f3c2e54884 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:59:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9519bb75-8931-48f5-bab6-0591c1a63e8c req-b0ff0943-ccec-48e0-93a5-fc742bbd084f service nova] Acquiring lock "945acd46-42e2-4c45-b8e5-9ea94703bc66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:59:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9519bb75-8931-48f5-bab6-0591c1a63e8c req-b0ff0943-ccec-48e0-93a5-fc742bbd084f service nova] Lock "945acd46-42e2-4c45-b8e5-9ea94703bc66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:59:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-9519bb75-8931-48f5-bab6-0591c1a63e8c req-b0ff0943-ccec-48e0-93a5-fc742bbd084f service nova] Lock "945acd46-42e2-4c45-b8e5-9ea94703bc66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:59:10 user nova-compute[73104]: DEBUG nova.compute.manager [req-9519bb75-8931-48f5-bab6-0591c1a63e8c req-b0ff0943-ccec-48e0-93a5-fc742bbd084f service nova] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] No waiting events found dispatching network-vif-unplugged-6df89783-82b3-4a16-b2ec-f5f3c2e54884 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:59:10 user nova-compute[73104]: DEBUG nova.compute.manager [req-9519bb75-8931-48f5-bab6-0591c1a63e8c req-b0ff0943-ccec-48e0-93a5-fc742bbd084f service nova] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Received event network-vif-unplugged-6df89783-82b3-4a16-b2ec-f5f3c2e54884 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 08:59:10 user nova-compute[73104]: DEBUG nova.network.neutron [req-d7b6bc73-7172-44d4-8a82-e299a97d648a req-0595685c-3342-4cfc-8b5d-71b086c1d6a9 service nova] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Updated VIF entry in instance network info cache for port 6df89783-82b3-4a16-b2ec-f5f3c2e54884. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 08:59:10 user nova-compute[73104]: DEBUG nova.network.neutron [req-d7b6bc73-7172-44d4-8a82-e299a97d648a req-0595685c-3342-4cfc-8b5d-71b086c1d6a9 service nova] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Updating instance_info_cache with network_info: [{"id": "6df89783-82b3-4a16-b2ec-f5f3c2e54884", "address": "fa:16:3e:b9:a6:80", "network": {"id": "bb0ed7b6-f1d2-41e5-b975-926555200ac9", "bridge": "br-int", "label": "tempest-TestStampPattern-89239905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f8b4744aa5450ca396714b74a01049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df89783-82", "ovs_interfaceid": "6df89783-82b3-4a16-b2ec-f5f3c2e54884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:59:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d7b6bc73-7172-44d4-8a82-e299a97d648a req-0595685c-3342-4cfc-8b5d-71b086c1d6a9 service nova] Releasing lock "refresh_cache-945acd46-42e2-4c45-b8e5-9ea94703bc66" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:59:11 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Instance destroyed successfully.
Aug 26 08:59:11 user nova-compute[73104]: DEBUG nova.objects.instance [None req-7180f1c7-8495-4e00-bd3b-9d946cbdb56e tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lazy-loading 'resources' on Instance uuid 945acd46-42e2-4c45-b8e5-9ea94703bc66 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:59:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-7180f1c7-8495-4e00-bd3b-9d946cbdb56e tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:51:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1369922145',display_name='tempest-TestStampPattern-server-1369922145',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1369922145',id=29,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8q5d7Z9/2Nnhi0JZhZxh3ataNnlHeSdFDCIuYvXZBV7m47ag+i9lJBSd6jnykjIfpVABlmqnqwhluVSlzPsJtT5zAJjK/bV+KbeeT0wsKSGG3sFgDqmXkgbk2fMo0ekA==',key_name='tempest-TestStampPattern-1398766845',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:51:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b4f8b4744aa5450ca396714b74a01049',ramdisk_id='',reservation_id='r-bttmbkg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1989133217',owner_user_name='tempest-TestStampPattern-1989133217-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:55:03Z,user_data=None,user_id='dea79c0b1d874d27b63d7e5418d12505',uuid=945acd46-42e2-4c45-b8e5-9ea94703bc66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6df89783-82b3-4a16-b2ec-f5f3c2e54884", "address": "fa:16:3e:b9:a6:80", "network": {"id": "bb0ed7b6-f1d2-41e5-b975-926555200ac9", "bridge": "br-int", "label": "tempest-TestStampPattern-89239905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f8b4744aa5450ca396714b74a01049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df89783-82", "ovs_interfaceid": "6df89783-82b3-4a16-b2ec-f5f3c2e54884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:59:11 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-7180f1c7-8495-4e00-bd3b-9d946cbdb56e tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Converting VIF {"id": "6df89783-82b3-4a16-b2ec-f5f3c2e54884", "address": "fa:16:3e:b9:a6:80", "network": {"id": "bb0ed7b6-f1d2-41e5-b975-926555200ac9", "bridge": "br-int", "label": "tempest-TestStampPattern-89239905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f8b4744aa5450ca396714b74a01049", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df89783-82", "ovs_interfaceid": "6df89783-82b3-4a16-b2ec-f5f3c2e54884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:59:11 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-7180f1c7-8495-4e00-bd3b-9d946cbdb56e tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:a6:80,bridge_name='br-int',has_traffic_filtering=True,id=6df89783-82b3-4a16-b2ec-f5f3c2e54884,network=Network(bb0ed7b6-f1d2-41e5-b975-926555200ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df89783-82') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:59:11 user nova-compute[73104]: DEBUG os_vif [None req-7180f1c7-8495-4e00-bd3b-9d946cbdb56e tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:a6:80,bridge_name='br-int',has_traffic_filtering=True,id=6df89783-82b3-4a16-b2ec-f5f3c2e54884,network=Network(bb0ed7b6-f1d2-41e5-b975-926555200ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df89783-82') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:59:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6df89783-82, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:59:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:59:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:11 user nova-compute[73104]: INFO os_vif [None req-7180f1c7-8495-4e00-bd3b-9d946cbdb56e tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:a6:80,bridge_name='br-int',has_traffic_filtering=True,id=6df89783-82b3-4a16-b2ec-f5f3c2e54884,network=Network(bb0ed7b6-f1d2-41e5-b975-926555200ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df89783-82')
Aug 26 08:59:11 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-7180f1c7-8495-4e00-bd3b-9d946cbdb56e tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Deleting instance files /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66_del
Aug 26 08:59:11 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-7180f1c7-8495-4e00-bd3b-9d946cbdb56e tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Deletion of /opt/stack/data/nova/instances/945acd46-42e2-4c45-b8e5-9ea94703bc66_del complete
Aug 26 08:59:11 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:59:11 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 08:59:11 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Skipping network cache update for instance because it is being deleted. {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9891}}
Aug 26 08:59:11 user nova-compute[73104]: INFO nova.compute.manager [None req-7180f1c7-8495-4e00-bd3b-9d946cbdb56e tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 26 08:59:11 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-7180f1c7-8495-4e00-bd3b-9d946cbdb56e tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 08:59:11 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 08:59:11 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 08:59:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-bf35aa10-80b1-4518-88b3-63c6a11e626b" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:59:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-bf35aa10-80b1-4518-88b3-63c6a11e626b" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:59:11 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 08:59:11 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:59:11 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Took 0.50 seconds to deallocate network for instance.
Aug 26 08:59:11 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Updating instance_info_cache with network_info: [{"id": "ba4dd86b-d62a-48be-89c7-d63a6013a1ef", "address": "fa:16:3e:bc:d7:ff", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4dd86b-d6", "ovs_interfaceid": "ba4dd86b-d62a-48be-89c7-d63a6013a1ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:59:11 user nova-compute[73104]: DEBUG nova.compute.manager [req-14247e41-7230-4722-be7c-0579a0058ec3 req-5c32d9c2-5b09-4a03-9e9c-f1faf0b3adac service nova] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Received event network-vif-deleted-6df89783-82b3-4a16-b2ec-f5f3c2e54884 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:59:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-bf35aa10-80b1-4518-88b3-63c6a11e626b" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:59:11 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 08:59:11 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:59:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7180f1c7-8495-4e00-bd3b-9d946cbdb56e tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:59:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7180f1c7-8495-4e00-bd3b-9d946cbdb56e tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:59:11 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 08:59:12 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-7180f1c7-8495-4e00-bd3b-9d946cbdb56e tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 08:59:12 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-7180f1c7-8495-4e00-bd3b-9d946cbdb56e tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 08:59:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7180f1c7-8495-4e00-bd3b-9d946cbdb56e tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:59:12 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-7180f1c7-8495-4e00-bd3b-9d946cbdb56e tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Deleted allocations for instance 945acd46-42e2-4c45-b8e5-9ea94703bc66
Aug 26 08:59:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7180f1c7-8495-4e00-bd3b-9d946cbdb56e tempest-TestStampPattern-1989133217 tempest-TestStampPattern-1989133217-project-member] Lock "945acd46-42e2-4c45-b8e5-9ea94703bc66" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.884s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:59:12 user nova-compute[73104]: DEBUG nova.compute.manager [req-fa518fe1-6610-40ca-bd29-db9a5d194135 req-6b3866af-758c-475b-9e26-6462dc8a9d58 service nova] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Received event network-vif-plugged-6df89783-82b3-4a16-b2ec-f5f3c2e54884 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:59:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-fa518fe1-6610-40ca-bd29-db9a5d194135 req-6b3866af-758c-475b-9e26-6462dc8a9d58 service nova] Acquiring lock "945acd46-42e2-4c45-b8e5-9ea94703bc66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:59:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-fa518fe1-6610-40ca-bd29-db9a5d194135 req-6b3866af-758c-475b-9e26-6462dc8a9d58 service nova] Lock "945acd46-42e2-4c45-b8e5-9ea94703bc66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:59:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-fa518fe1-6610-40ca-bd29-db9a5d194135 req-6b3866af-758c-475b-9e26-6462dc8a9d58 service nova] Lock "945acd46-42e2-4c45-b8e5-9ea94703bc66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:59:12 user nova-compute[73104]: DEBUG nova.compute.manager [req-fa518fe1-6610-40ca-bd29-db9a5d194135 req-6b3866af-758c-475b-9e26-6462dc8a9d58 service nova] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] No waiting events found dispatching network-vif-plugged-6df89783-82b3-4a16-b2ec-f5f3c2e54884 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:59:12 user nova-compute[73104]: WARNING nova.compute.manager [req-fa518fe1-6610-40ca-bd29-db9a5d194135 req-6b3866af-758c-475b-9e26-6462dc8a9d58 service nova] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Received unexpected event network-vif-plugged-6df89783-82b3-4a16-b2ec-f5f3c2e54884 for instance with vm_state deleted and task_state None.
Aug 26 08:59:14 user nova-compute[73104]: INFO nova.compute.manager [None req-457448b0-136f-4f52-b40a-c932a4d3e732 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Unrescuing
Aug 26 08:59:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-457448b0-136f-4f52-b40a-c932a4d3e732 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "refresh_cache-0e3fb03a-d317-4eed-ad52-d066242a13e0" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:59:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-457448b0-136f-4f52-b40a-c932a4d3e732 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquired lock "refresh_cache-0e3fb03a-d317-4eed-ad52-d066242a13e0" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:59:14 user nova-compute[73104]: DEBUG nova.network.neutron [None req-457448b0-136f-4f52-b40a-c932a4d3e732 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:59:14 user nova-compute[73104]: DEBUG nova.network.neutron [None req-457448b0-136f-4f52-b40a-c932a4d3e732 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Updating instance_info_cache with network_info: [{"id": "fd9b2f61-e1a4-47ba-8890-72715a8e241e", "address": "fa:16:3e:ed:2c:7f", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd9b2f61-e1", "ovs_interfaceid": "fd9b2f61-e1a4-47ba-8890-72715a8e241e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:59:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-457448b0-136f-4f52-b40a-c932a4d3e732 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Releasing lock "refresh_cache-0e3fb03a-d317-4eed-ad52-d066242a13e0" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:59:14 user nova-compute[73104]: DEBUG nova.objects.instance [None req-457448b0-136f-4f52-b40a-c932a4d3e732 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lazy-loading 'flavor' on Instance uuid 0e3fb03a-d317-4eed-ad52-d066242a13e0 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:59:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:15 user nova-compute[73104]: DEBUG nova.compute.manager [req-b2ce154e-5138-4a26-8353-9b0613d66b1b req-750fc2e1-f291-45b1-8fa6-f26ec6f3e879 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Received event network-vif-unplugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:59:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b2ce154e-5138-4a26-8353-9b0613d66b1b req-750fc2e1-f291-45b1-8fa6-f26ec6f3e879 service nova] Acquiring lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:59:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b2ce154e-5138-4a26-8353-9b0613d66b1b req-750fc2e1-f291-45b1-8fa6-f26ec6f3e879 service nova] Lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:59:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b2ce154e-5138-4a26-8353-9b0613d66b1b req-750fc2e1-f291-45b1-8fa6-f26ec6f3e879 service nova] Lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:59:15 user nova-compute[73104]: DEBUG nova.compute.manager [req-b2ce154e-5138-4a26-8353-9b0613d66b1b req-750fc2e1-f291-45b1-8fa6-f26ec6f3e879 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] No waiting events found dispatching network-vif-unplugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:59:15 user nova-compute[73104]: WARNING nova.compute.manager [req-b2ce154e-5138-4a26-8353-9b0613d66b1b req-750fc2e1-f291-45b1-8fa6-f26ec6f3e879 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Received unexpected event network-vif-unplugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e for instance with vm_state rescued and task_state unrescuing.
Aug 26 08:59:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:15 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Instance destroyed successfully.
Aug 26 08:59:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 08:59:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 08:59:16 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Creating image(s)
Aug 26 08:59:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Did not create local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 08:59:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Ensure instance console log exists: /opt/stack/data/nova/instances/4d012737-bb37-4bf0-b4f6-491f2c25da2d/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 08:59:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:59:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:59:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:59:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Start _get_guest_xml network_info=[{"id": "4c3948af-7a8f-4983-8e2a-c8f2c56403bf", "address": "fa:16:3e:3e:ca:c0", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3948af-7a", "ovs_interfaceid": "4c3948af-7a8f-4983-8e2a-c8f2c56403bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '2d9eacc0-a1f9-4427-ac15-4c9416a48f6e', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QseZKxDh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4d012737-bb37-4bf0-b4f6-491f2c25da2d', 'attached_at': '', 'detached_at': '', 'volume_id': 'ed9a2498-c3b4-4842-aaaa-9b3d88920f1a', 'serial': 'ed9a2498-c3b4-4842-aaaa-9b3d88920f1a'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:59:16 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:59:16 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:59:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:59:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:59:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:59:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:59:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:59:16 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:59:16 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:59:16 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:59:16 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:59:16 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:59:16 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:59:16 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:59:16 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:59:16 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:59:16 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:59:16 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QseZKxDh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 08:59:17 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:59:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:59:17 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 08:59:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 08:59:17 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a7aba0-ac0f-4fb9-a714-fdb4a0fbcae2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 08:59:17 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e395f3e-6eb8-4661-b682-3ab2db21fcac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a] added
Aug 26 08:59:17 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3797feee-e644-4b55-a3be-8a12f2a314f0]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4618e139-d257-46ad-b22c-5f0cefb60a86]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QseZKxDh {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QseZKxDh" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[93343095-fa20-4e64-839e-fbd1e86dee44]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QseZKxDh'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG nova.compute.manager [req-18c83c04-9f17-4b7a-b8ca-f649cb4a863a req-34e611e5-6fb1-40f6-80f9-13fa6ebbe895 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Received event network-vif-plugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-18c83c04-9f17-4b7a-b8ca-f649cb4a863a req-34e611e5-6fb1-40f6-80f9-13fa6ebbe895 service nova] Acquiring lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-18c83c04-9f17-4b7a-b8ca-f649cb4a863a req-34e611e5-6fb1-40f6-80f9-13fa6ebbe895 service nova] Lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-18c83c04-9f17-4b7a-b8ca-f649cb4a863a req-34e611e5-6fb1-40f6-80f9-13fa6ebbe895 service nova] Lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG nova.compute.manager [req-18c83c04-9f17-4b7a-b8ca-f649cb4a863a req-34e611e5-6fb1-40f6-80f9-13fa6ebbe895 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] No waiting events found dispatching network-vif-plugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:59:17 user nova-compute[73104]: WARNING nova.compute.manager [req-18c83c04-9f17-4b7a-b8ca-f649cb4a863a req-34e611e5-6fb1-40f6-80f9-13fa6ebbe895 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Received unexpected event network-vif-plugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e for instance with vm_state rescued and task_state unrescuing.
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[30edb265-9cb6-45f5-8b1b-cc7ac9c69872]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f82acca-b3d2-4a0a-9099-9d66012713d5]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:59:17 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 08:59:17 user nova-compute[73104]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:59:17 user nova-compute[73104]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae (non-flash)
Aug 26 08:59:17 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:59:17 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 08:59:17 user nova-compute[73104]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:59:17 user nova-compute[73104]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae (non-flash)
Aug 26 08:59:17 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[263f3eb7-d9d7-4913-a2d2-d0528b719195]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a, portal: 172.16.0.220,3260]
Aug 26 08:59:17 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a, portal: 172.16.0.220,3260] successful.
Aug 26 08:59:17 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[293097de-f7e6-4b00-b0a8-110269963245]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf95d62b-dd6b-4afa-8731-d6701b71ecb9]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:59:17 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 08:59:17 user nova-compute[73104]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:59:17 user nova-compute[73104]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae (non-flash)
Aug 26 08:59:17 user nova-compute[73104]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a (non-flash)
Aug 26 08:59:17 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 08:59:17 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 08:59:17 user nova-compute[73104]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 08:59:17 user nova-compute[73104]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae (non-flash)
Aug 26 08:59:17 user nova-compute[73104]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a (non-flash)
Aug 26 08:59:17 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] HCTL ('37', '-', '-', 0) found on session 44 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad8a0c1-d626-49cc-aa88-f27899bc17dd]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Searching for a device in session 44 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 08:59:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QseZKxDh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 08:59:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 08:59:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23732346137386330', 'path': '/dev/sdf'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 08:59:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732346137386330', 'path': '/dev/sdf'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 08:59:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:58:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2082038050',display_name='tempest-TestVolumeBootPattern-server-2082038050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2082038050',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52518aa77344432385cfc2b73c63aebe',ramdisk_id='',reservation_id='r-55m0yyxv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1466837638',owner_user_name='tempest-TestVolumeBootPattern-1466837638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:58:59Z,user_data=None,user_id='bae03c9c8a9a40b2af6bd1fefb3561d0',uuid=4d012737-bb37-4bf0-b4f6-491f2c25da2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c3948af-7a8f-4983-8e2a-c8f2c56403bf", "address": "fa:16:3e:3e:ca:c0", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3948af-7a", "ovs_interfaceid": "4c3948af-7a8f-4983-8e2a-c8f2c56403bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:59:18 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converting VIF {"id": "4c3948af-7a8f-4983-8e2a-c8f2c56403bf", "address": "fa:16:3e:3e:ca:c0", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3948af-7a", "ovs_interfaceid": "4c3948af-7a8f-4983-8e2a-c8f2c56403bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:59:18 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:ca:c0,bridge_name='br-int',has_traffic_filtering=True,id=4c3948af-7a8f-4983-8e2a-c8f2c56403bf,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c3948af-7a') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:59:18 user nova-compute[73104]: DEBUG nova.objects.instance [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d012737-bb37-4bf0-b4f6-491f2c25da2d {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:59:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:59:18 user nova-compute[73104]:   <uuid>4d012737-bb37-4bf0-b4f6-491f2c25da2d</uuid>
Aug 26 08:59:18 user nova-compute[73104]:   <name>instance-00000025</name>
Aug 26 08:59:18 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:59:18 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:59:18 user nova-compute[73104]:   <metadata>
Aug 26 08:59:18 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:59:18 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:59:18 user nova-compute[73104]:       <nova:name>tempest-TestVolumeBootPattern-server-2082038050</nova:name>
Aug 26 08:59:18 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:59:16</nova:creationTime>
Aug 26 08:59:18 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:59:18 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:59:18 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:59:18 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:59:18 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:59:18 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:59:18 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:59:18 user nova-compute[73104]:       <nova:owner>
Aug 26 08:59:18 user nova-compute[73104]:         <nova:user uuid="bae03c9c8a9a40b2af6bd1fefb3561d0">tempest-TestVolumeBootPattern-1466837638-project-member</nova:user>
Aug 26 08:59:18 user nova-compute[73104]:         <nova:project uuid="52518aa77344432385cfc2b73c63aebe">tempest-TestVolumeBootPattern-1466837638</nova:project>
Aug 26 08:59:18 user nova-compute[73104]:       </nova:owner>
Aug 26 08:59:18 user nova-compute[73104]:       <nova:ports>
Aug 26 08:59:18 user nova-compute[73104]:         <nova:port uuid="4c3948af-7a8f-4983-8e2a-c8f2c56403bf">
Aug 26 08:59:18 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 08:59:18 user nova-compute[73104]:         </nova:port>
Aug 26 08:59:18 user nova-compute[73104]:       </nova:ports>
Aug 26 08:59:18 user nova-compute[73104]:     </nova:instance>
Aug 26 08:59:18 user nova-compute[73104]:   </metadata>
Aug 26 08:59:18 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:59:18 user nova-compute[73104]:     <system>
Aug 26 08:59:18 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:59:18 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:59:18 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:59:18 user nova-compute[73104]:       <entry name="serial">4d012737-bb37-4bf0-b4f6-491f2c25da2d</entry>
Aug 26 08:59:18 user nova-compute[73104]:       <entry name="uuid">4d012737-bb37-4bf0-b4f6-491f2c25da2d</entry>
Aug 26 08:59:18 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:59:18 user nova-compute[73104]:     </system>
Aug 26 08:59:18 user nova-compute[73104]:   </sysinfo>
Aug 26 08:59:18 user nova-compute[73104]:   <os>
Aug 26 08:59:18 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:59:18 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:59:18 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:59:18 user nova-compute[73104]:   </os>
Aug 26 08:59:18 user nova-compute[73104]:   <features>
Aug 26 08:59:18 user nova-compute[73104]:     <acpi/>
Aug 26 08:59:18 user nova-compute[73104]:     <apic/>
Aug 26 08:59:18 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:59:18 user nova-compute[73104]:   </features>
Aug 26 08:59:18 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:59:18 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:59:18 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:59:18 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:59:18 user nova-compute[73104]:   </clock>
Aug 26 08:59:18 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:59:18 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:59:18 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:59:18 user nova-compute[73104]:   </cpu>
Aug 26 08:59:18 user nova-compute[73104]:   <devices>
Aug 26 08:59:18 user nova-compute[73104]:     <disk type="block" device="disk">
Aug 26 08:59:18 user nova-compute[73104]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 08:59:18 user nova-compute[73104]:       <source dev="/dev/sdf"/>
Aug 26 08:59:18 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:59:18 user nova-compute[73104]:       <serial>ed9a2498-c3b4-4842-aaaa-9b3d88920f1a</serial>
Aug 26 08:59:18 user nova-compute[73104]:     </disk>
Aug 26 08:59:18 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:59:18 user nova-compute[73104]:       <mac address="fa:16:3e:3e:ca:c0"/>
Aug 26 08:59:18 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:59:18 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:59:18 user nova-compute[73104]:       <target dev="tap4c3948af-7a"/>
Aug 26 08:59:18 user nova-compute[73104]:     </interface>
Aug 26 08:59:18 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:59:18 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/4d012737-bb37-4bf0-b4f6-491f2c25da2d/console.log" append="off"/>
Aug 26 08:59:18 user nova-compute[73104]:     </serial>
Aug 26 08:59:18 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:59:18 user nova-compute[73104]:     <video>
Aug 26 08:59:18 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:59:18 user nova-compute[73104]:     </video>
Aug 26 08:59:18 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:59:18 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:59:18 user nova-compute[73104]:     </rng>
Aug 26 08:59:18 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:59:18 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:59:18 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:59:18 user nova-compute[73104]:     </memballoon>
Aug 26 08:59:18 user nova-compute[73104]:   </devices>
Aug 26 08:59:18 user nova-compute[73104]: </domain>
Aug 26 08:59:18 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:59:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:58:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2082038050',display_name='tempest-TestVolumeBootPattern-server-2082038050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2082038050',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52518aa77344432385cfc2b73c63aebe',ramdisk_id='',reservation_id='r-55m0yyxv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1466837638',owner_user_name='tempest-TestVolumeBootPattern-1466837638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:58:59Z,user_data=None,user_id='bae03c9c8a9a40b2af6bd1fefb3561d0',uuid=4d012737-bb37-4bf0-b4f6-491f2c25da2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c3948af-7a8f-4983-8e2a-c8f2c56403bf", "address": "fa:16:3e:3e:ca:c0", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3948af-7a", "ovs_interfaceid": "4c3948af-7a8f-4983-8e2a-c8f2c56403bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:59:18 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converting VIF {"id": "4c3948af-7a8f-4983-8e2a-c8f2c56403bf", "address": "fa:16:3e:3e:ca:c0", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3948af-7a", "ovs_interfaceid": "4c3948af-7a8f-4983-8e2a-c8f2c56403bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:59:18 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:ca:c0,bridge_name='br-int',has_traffic_filtering=True,id=4c3948af-7a8f-4983-8e2a-c8f2c56403bf,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c3948af-7a') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:59:18 user nova-compute[73104]: DEBUG os_vif [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:ca:c0,bridge_name='br-int',has_traffic_filtering=True,id=4c3948af-7a8f-4983-8e2a-c8f2c56403bf,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c3948af-7a') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:59:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:59:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:59:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c3948af-7a, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:59:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4c3948af-7a, col_values=(('external_ids', {'iface-id': '4c3948af-7a8f-4983-8e2a-c8f2c56403bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:ca:c0', 'vm-uuid': '4d012737-bb37-4bf0-b4f6-491f2c25da2d'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:59:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:59:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:18 user nova-compute[73104]: INFO os_vif [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:ca:c0,bridge_name='br-int',has_traffic_filtering=True,id=4c3948af-7a8f-4983-8e2a-c8f2c56403bf,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c3948af-7a')
Aug 26 08:59:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 08:59:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] No VIF found with MAC fa:16:3e:3e:ca:c0, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 08:59:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Removed pending event for 0e3fb03a-d317-4eed-ad52-d066242a13e0 due to event {{(pid=73104) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 08:59:19 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040359.0210195, 0e3fb03a-d317-4eed-ad52-d066242a13e0 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:59:19 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] VM Resumed (Lifecycle Event)
Aug 26 08:59:19 user nova-compute[73104]: DEBUG nova.compute.manager [None req-457448b0-136f-4f52-b40a-c932a4d3e732 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:59:19 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:59:19 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:59:19 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 08:59:19 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040359.0224853, 0e3fb03a-d317-4eed-ad52-d066242a13e0 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:59:19 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] VM Started (Lifecycle Event)
Aug 26 08:59:19 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:59:19 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:59:19 user nova-compute[73104]: DEBUG nova.compute.manager [req-3aec5a1c-3d85-46b3-bb18-04313a21f37d req-e1f31e9d-c9dc-4cfc-b3df-e2a4037f6cd2 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Received event network-vif-plugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:59:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3aec5a1c-3d85-46b3-bb18-04313a21f37d req-e1f31e9d-c9dc-4cfc-b3df-e2a4037f6cd2 service nova] Acquiring lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:59:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3aec5a1c-3d85-46b3-bb18-04313a21f37d req-e1f31e9d-c9dc-4cfc-b3df-e2a4037f6cd2 service nova] Lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:59:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3aec5a1c-3d85-46b3-bb18-04313a21f37d req-e1f31e9d-c9dc-4cfc-b3df-e2a4037f6cd2 service nova] Lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:59:19 user nova-compute[73104]: DEBUG nova.compute.manager [req-3aec5a1c-3d85-46b3-bb18-04313a21f37d req-e1f31e9d-c9dc-4cfc-b3df-e2a4037f6cd2 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] No waiting events found dispatching network-vif-plugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:59:19 user nova-compute[73104]: WARNING nova.compute.manager [req-3aec5a1c-3d85-46b3-bb18-04313a21f37d req-e1f31e9d-c9dc-4cfc-b3df-e2a4037f6cd2 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Received unexpected event network-vif-plugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e for instance with vm_state active and task_state None.
Aug 26 08:59:19 user nova-compute[73104]: DEBUG nova.compute.manager [req-3aec5a1c-3d85-46b3-bb18-04313a21f37d req-e1f31e9d-c9dc-4cfc-b3df-e2a4037f6cd2 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Received event network-vif-plugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:59:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3aec5a1c-3d85-46b3-bb18-04313a21f37d req-e1f31e9d-c9dc-4cfc-b3df-e2a4037f6cd2 service nova] Acquiring lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:59:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3aec5a1c-3d85-46b3-bb18-04313a21f37d req-e1f31e9d-c9dc-4cfc-b3df-e2a4037f6cd2 service nova] Lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:59:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3aec5a1c-3d85-46b3-bb18-04313a21f37d req-e1f31e9d-c9dc-4cfc-b3df-e2a4037f6cd2 service nova] Lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:59:19 user nova-compute[73104]: DEBUG nova.compute.manager [req-3aec5a1c-3d85-46b3-bb18-04313a21f37d req-e1f31e9d-c9dc-4cfc-b3df-e2a4037f6cd2 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] No waiting events found dispatching network-vif-plugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:59:19 user nova-compute[73104]: WARNING nova.compute.manager [req-3aec5a1c-3d85-46b3-bb18-04313a21f37d req-e1f31e9d-c9dc-4cfc-b3df-e2a4037f6cd2 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Received unexpected event network-vif-plugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e for instance with vm_state active and task_state None.
Aug 26 08:59:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:20 user nova-compute[73104]: DEBUG nova.compute.manager [req-19c39f17-ba60-4438-817a-90496466a3d8 req-da0dde55-648b-4d0f-8209-d8df709d70ae service nova] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Received event network-vif-plugged-4c3948af-7a8f-4983-8e2a-c8f2c56403bf {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:59:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-19c39f17-ba60-4438-817a-90496466a3d8 req-da0dde55-648b-4d0f-8209-d8df709d70ae service nova] Acquiring lock "4d012737-bb37-4bf0-b4f6-491f2c25da2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:59:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-19c39f17-ba60-4438-817a-90496466a3d8 req-da0dde55-648b-4d0f-8209-d8df709d70ae service nova] Lock "4d012737-bb37-4bf0-b4f6-491f2c25da2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:59:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-19c39f17-ba60-4438-817a-90496466a3d8 req-da0dde55-648b-4d0f-8209-d8df709d70ae service nova] Lock "4d012737-bb37-4bf0-b4f6-491f2c25da2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:59:20 user nova-compute[73104]: DEBUG nova.compute.manager [req-19c39f17-ba60-4438-817a-90496466a3d8 req-da0dde55-648b-4d0f-8209-d8df709d70ae service nova] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] No waiting events found dispatching network-vif-plugged-4c3948af-7a8f-4983-8e2a-c8f2c56403bf {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:59:20 user nova-compute[73104]: WARNING nova.compute.manager [req-19c39f17-ba60-4438-817a-90496466a3d8 req-da0dde55-648b-4d0f-8209-d8df709d70ae service nova] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Received unexpected event network-vif-plugged-4c3948af-7a8f-4983-8e2a-c8f2c56403bf for instance with vm_state building and task_state spawning.
Aug 26 08:59:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:22 user nova-compute[73104]: DEBUG nova.compute.manager [req-40726e56-f4e5-40e0-8159-9d9ec73ddae3 req-e411f6af-6929-4ab9-a9c0-5d94da614cd1 service nova] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Received event network-vif-plugged-4c3948af-7a8f-4983-8e2a-c8f2c56403bf {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:59:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-40726e56-f4e5-40e0-8159-9d9ec73ddae3 req-e411f6af-6929-4ab9-a9c0-5d94da614cd1 service nova] Acquiring lock "4d012737-bb37-4bf0-b4f6-491f2c25da2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:59:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-40726e56-f4e5-40e0-8159-9d9ec73ddae3 req-e411f6af-6929-4ab9-a9c0-5d94da614cd1 service nova] Lock "4d012737-bb37-4bf0-b4f6-491f2c25da2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:59:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-40726e56-f4e5-40e0-8159-9d9ec73ddae3 req-e411f6af-6929-4ab9-a9c0-5d94da614cd1 service nova] Lock "4d012737-bb37-4bf0-b4f6-491f2c25da2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:59:22 user nova-compute[73104]: DEBUG nova.compute.manager [req-40726e56-f4e5-40e0-8159-9d9ec73ddae3 req-e411f6af-6929-4ab9-a9c0-5d94da614cd1 service nova] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] No waiting events found dispatching network-vif-plugged-4c3948af-7a8f-4983-8e2a-c8f2c56403bf {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:59:22 user nova-compute[73104]: WARNING nova.compute.manager [req-40726e56-f4e5-40e0-8159-9d9ec73ddae3 req-e411f6af-6929-4ab9-a9c0-5d94da614cd1 service nova] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Received unexpected event network-vif-plugged-4c3948af-7a8f-4983-8e2a-c8f2c56403bf for instance with vm_state building and task_state spawning.
Aug 26 08:59:22 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040362.3397982, 4d012737-bb37-4bf0-b4f6-491f2c25da2d => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:59:22 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] VM Resumed (Lifecycle Event)
Aug 26 08:59:22 user nova-compute[73104]: DEBUG nova.compute.manager [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:59:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 08:59:22 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Instance spawned successfully.
Aug 26 08:59:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 08:59:22 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:59:22 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:59:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:59:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:59:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:59:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:59:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:59:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 08:59:22 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:59:22 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040362.3401294, 4d012737-bb37-4bf0-b4f6-491f2c25da2d => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:59:22 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] VM Started (Lifecycle Event)
Aug 26 08:59:22 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:59:22 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:59:22 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 08:59:22 user nova-compute[73104]: INFO nova.compute.manager [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Took 5.51 seconds to spawn the instance on the hypervisor.
Aug 26 08:59:22 user nova-compute[73104]: DEBUG nova.compute.manager [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:59:22 user nova-compute[73104]: INFO nova.compute.manager [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Took 23.73 seconds to build instance.
Aug 26 08:59:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df4f617f-bba5-4b31-a5f8-07d3474f18fc tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "4d012737-bb37-4bf0-b4f6-491f2c25da2d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.829s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:59:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:24 user nova-compute[73104]: DEBUG nova.objects.instance [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lazy-loading 'flavor' on Instance uuid 33048996-d559-4b3c-9de9-39bb176c3ec9 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:59:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "refresh_cache-33048996-d559-4b3c-9de9-39bb176c3ec9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 08:59:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquired lock "refresh_cache-33048996-d559-4b3c-9de9-39bb176c3ec9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 08:59:24 user nova-compute[73104]: DEBUG nova.network.neutron [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 08:59:24 user nova-compute[73104]: DEBUG nova.objects.instance [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lazy-loading 'info_cache' on Instance uuid 33048996-d559-4b3c-9de9-39bb176c3ec9 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:59:24 user nova-compute[73104]: DEBUG nova.objects.base [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Object Instance<33048996-d559-4b3c-9de9-39bb176c3ec9> lazy-loaded attributes: flavor,info_cache {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.network.neutron [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Updating instance_info_cache with network_info: [{"id": "4c1b906e-2c49-4642-9183-06292be46de4", "address": "fa:16:3e:7e:7d:6c", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1b906e-2c", "ovs_interfaceid": "4c1b906e-2c49-4642-9183-06292be46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Releasing lock "refresh_cache-33048996-d559-4b3c-9de9-39bb176c3ec9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 08:59:25 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Instance destroyed successfully.
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.objects.instance [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lazy-loading 'resources' on Instance uuid 33048996-d559-4b3c-9de9-39bb176c3ec9 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.objects.base [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Object Instance<33048996-d559-4b3c-9de9-39bb176c3ec9> lazy-loaded attributes: flavor,info_cache,resources {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:51:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1372648210',display_name='tempest-AttachVolumeTestJSON-server-1372648210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1372648210',id=28,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3ruAnm8wJOtkM5YpWf3zux9ipeTcCrtMwmPCNqS87cjfXmG7Jo5HHNQzK7O8JS5TTbG/bKm+6qFm/BZVW6gKLbnDGC/QXgHLRc1/aNdWcQz6PVhir0ZiiZKQ1S1B0vIg==',key_name='tempest-keypair-1147096816',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:51:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d101cd585e604a1881c981c946f70849',ramdisk_id='',reservation_id='r-hfyybj1j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-684994869',owner_user_name='tempest-AttachVolumeTestJSON-684994869-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:57:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4191d8a10ac54389b6b633701f6e6c77',uuid=33048996-d559-4b3c-9de9-39bb176c3ec9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4c1b906e-2c49-4642-9183-06292be46de4", "address": "fa:16:3e:7e:7d:6c", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1b906e-2c", "ovs_interfaceid": "4c1b906e-2c49-4642-9183-06292be46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Converting VIF {"id": "4c1b906e-2c49-4642-9183-06292be46de4", "address": "fa:16:3e:7e:7d:6c", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1b906e-2c", "ovs_interfaceid": "4c1b906e-2c49-4642-9183-06292be46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7d:6c,bridge_name='br-int',has_traffic_filtering=True,id=4c1b906e-2c49-4642-9183-06292be46de4,network=Network(e6ddfc91-c02c-429c-90ff-aaad54b98cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1b906e-2c') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG os_vif [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7d:6c,bridge_name='br-int',has_traffic_filtering=True,id=4c1b906e-2c49-4642-9183-06292be46de4,network=Network(e6ddfc91-c02c-429c-90ff-aaad54b98cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1b906e-2c') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c1b906e-2c, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:59:25 user nova-compute[73104]: INFO os_vif [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7d:6c,bridge_name='br-int',has_traffic_filtering=True,id=4c1b906e-2c49-4642-9183-06292be46de4,network=Network(e6ddfc91-c02c-429c-90ff-aaad54b98cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1b906e-2c')
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Start _get_guest_xml network_info=[{"id": "4c1b906e-2c49-4642-9183-06292be46de4", "address": "fa:16:3e:7e:7d:6c", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1b906e-2c", "ovs_interfaceid": "4c1b906e-2c49-4642-9183-06292be46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.objects.instance [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lazy-loading 'numa_topology' on Instance uuid 33048996-d559-4b3c-9de9-39bb176c3ec9 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.objects.base [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Object Instance<33048996-d559-4b3c-9de9-39bb176c3ec9> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:59:25 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:59:25 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.objects.instance [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lazy-loading 'vcpu_model' on Instance uuid 33048996-d559-4b3c-9de9-39bb176c3ec9 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.objects.base [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Object Instance<33048996-d559-4b3c-9de9-39bb176c3ec9> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:51:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1372648210',display_name='tempest-AttachVolumeTestJSON-server-1372648210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1372648210',id=28,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3ruAnm8wJOtkM5YpWf3zux9ipeTcCrtMwmPCNqS87cjfXmG7Jo5HHNQzK7O8JS5TTbG/bKm+6qFm/BZVW6gKLbnDGC/QXgHLRc1/aNdWcQz6PVhir0ZiiZKQ1S1B0vIg==',key_name='tempest-keypair-1147096816',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:51:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d101cd585e604a1881c981c946f70849',ramdisk_id='',reservation_id='r-hfyybj1j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-684994869',owner_user_name='tempest-AttachVolumeTestJSON-684994869-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:57:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4191d8a10ac54389b6b633701f6e6c77',uuid=33048996-d559-4b3c-9de9-39bb176c3ec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4c1b906e-2c49-4642-9183-06292be46de4", "address": "fa:16:3e:7e:7d:6c", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1b906e-2c", "ovs_interfaceid": "4c1b906e-2c49-4642-9183-06292be46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Converting VIF {"id": "4c1b906e-2c49-4642-9183-06292be46de4", "address": "fa:16:3e:7e:7d:6c", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1b906e-2c", "ovs_interfaceid": "4c1b906e-2c49-4642-9183-06292be46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7d:6c,bridge_name='br-int',has_traffic_filtering=True,id=4c1b906e-2c49-4642-9183-06292be46de4,network=Network(e6ddfc91-c02c-429c-90ff-aaad54b98cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1b906e-2c') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.objects.instance [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lazy-loading 'pci_devices' on Instance uuid 33048996-d559-4b3c-9de9-39bb176c3ec9 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.objects.base [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Object Instance<33048996-d559-4b3c-9de9-39bb176c3ec9> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] End _get_guest_xml xml=<domain type="kvm">
Aug 26 08:59:25 user nova-compute[73104]:   <uuid>33048996-d559-4b3c-9de9-39bb176c3ec9</uuid>
Aug 26 08:59:25 user nova-compute[73104]:   <name>instance-0000001c</name>
Aug 26 08:59:25 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 08:59:25 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 08:59:25 user nova-compute[73104]:   <metadata>
Aug 26 08:59:25 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 08:59:25 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 08:59:25 user nova-compute[73104]:       <nova:name>tempest-AttachVolumeTestJSON-server-1372648210</nova:name>
Aug 26 08:59:25 user nova-compute[73104]:       <nova:creationTime>2023-08-26 08:59:25</nova:creationTime>
Aug 26 08:59:25 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 08:59:25 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 08:59:25 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 08:59:25 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 08:59:25 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 08:59:25 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 08:59:25 user nova-compute[73104]:       </nova:flavor>
Aug 26 08:59:25 user nova-compute[73104]:       <nova:owner>
Aug 26 08:59:25 user nova-compute[73104]:         <nova:user uuid="4191d8a10ac54389b6b633701f6e6c77">tempest-AttachVolumeTestJSON-684994869-project-member</nova:user>
Aug 26 08:59:25 user nova-compute[73104]:         <nova:project uuid="d101cd585e604a1881c981c946f70849">tempest-AttachVolumeTestJSON-684994869</nova:project>
Aug 26 08:59:25 user nova-compute[73104]:       </nova:owner>
Aug 26 08:59:25 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 08:59:25 user nova-compute[73104]:       <nova:ports>
Aug 26 08:59:25 user nova-compute[73104]:         <nova:port uuid="4c1b906e-2c49-4642-9183-06292be46de4">
Aug 26 08:59:25 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 08:59:25 user nova-compute[73104]:         </nova:port>
Aug 26 08:59:25 user nova-compute[73104]:       </nova:ports>
Aug 26 08:59:25 user nova-compute[73104]:     </nova:instance>
Aug 26 08:59:25 user nova-compute[73104]:   </metadata>
Aug 26 08:59:25 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 08:59:25 user nova-compute[73104]:     <system>
Aug 26 08:59:25 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 08:59:25 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 08:59:25 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 08:59:25 user nova-compute[73104]:       <entry name="serial">33048996-d559-4b3c-9de9-39bb176c3ec9</entry>
Aug 26 08:59:25 user nova-compute[73104]:       <entry name="uuid">33048996-d559-4b3c-9de9-39bb176c3ec9</entry>
Aug 26 08:59:25 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 08:59:25 user nova-compute[73104]:     </system>
Aug 26 08:59:25 user nova-compute[73104]:   </sysinfo>
Aug 26 08:59:25 user nova-compute[73104]:   <os>
Aug 26 08:59:25 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 08:59:25 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 08:59:25 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 08:59:25 user nova-compute[73104]:   </os>
Aug 26 08:59:25 user nova-compute[73104]:   <features>
Aug 26 08:59:25 user nova-compute[73104]:     <acpi/>
Aug 26 08:59:25 user nova-compute[73104]:     <apic/>
Aug 26 08:59:25 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 08:59:25 user nova-compute[73104]:   </features>
Aug 26 08:59:25 user nova-compute[73104]:   <clock offset="utc">
Aug 26 08:59:25 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 08:59:25 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 08:59:25 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 08:59:25 user nova-compute[73104]:   </clock>
Aug 26 08:59:25 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 08:59:25 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 08:59:25 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 08:59:25 user nova-compute[73104]:   </cpu>
Aug 26 08:59:25 user nova-compute[73104]:   <devices>
Aug 26 08:59:25 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 08:59:25 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 08:59:25 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk"/>
Aug 26 08:59:25 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 08:59:25 user nova-compute[73104]:     </disk>
Aug 26 08:59:25 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 08:59:25 user nova-compute[73104]:       <mac address="fa:16:3e:7e:7d:6c"/>
Aug 26 08:59:25 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:59:25 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 08:59:25 user nova-compute[73104]:       <target dev="tap4c1b906e-2c"/>
Aug 26 08:59:25 user nova-compute[73104]:     </interface>
Aug 26 08:59:25 user nova-compute[73104]:     <serial type="pty">
Aug 26 08:59:25 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/console.log" append="off"/>
Aug 26 08:59:25 user nova-compute[73104]:     </serial>
Aug 26 08:59:25 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 08:59:25 user nova-compute[73104]:     <video>
Aug 26 08:59:25 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 08:59:25 user nova-compute[73104]:     </video>
Aug 26 08:59:25 user nova-compute[73104]:     <rng model="virtio">
Aug 26 08:59:25 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 08:59:25 user nova-compute[73104]:     </rng>
Aug 26 08:59:25 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 08:59:25 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 08:59:25 user nova-compute[73104]:       <stats period="10"/>
Aug 26 08:59:25 user nova-compute[73104]:     </memballoon>
Aug 26 08:59:25 user nova-compute[73104]:   </devices>
Aug 26 08:59:25 user nova-compute[73104]: </domain>
Aug 26 08:59:25 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.objects.instance [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lazy-loading 'trusted_certs' on Instance uuid 33048996-d559-4b3c-9de9-39bb176c3ec9 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG nova.objects.base [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Object Instance<33048996-d559-4b3c-9de9-39bb176c3ec9> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:59:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:59:26 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693040351.0972323, 945acd46-42e2-4c45-b8e5-9ea94703bc66 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:59:26 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] VM Stopped (Lifecycle Event)
Aug 26 08:59:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.192s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:59:26 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 08:59:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 08:59:26 user nova-compute[73104]: DEBUG nova.compute.manager [None req-4998fffd-0f5d-4e41-a0bf-a7de42749838 None None] [instance: 945acd46-42e2-4c45-b8e5-9ea94703bc66] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:59:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 08:59:26 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Cannot resize image /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 08:59:26 user nova-compute[73104]: DEBUG nova.objects.instance [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lazy-loading 'migration_context' on Instance uuid 33048996-d559-4b3c-9de9-39bb176c3ec9 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 08:59:26 user nova-compute[73104]: DEBUG nova.objects.base [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Object Instance<33048996-d559-4b3c-9de9-39bb176c3ec9> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 08:59:26 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:51:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1372648210',display_name='tempest-AttachVolumeTestJSON-server-1372648210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1372648210',id=28,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3ruAnm8wJOtkM5YpWf3zux9ipeTcCrtMwmPCNqS87cjfXmG7Jo5HHNQzK7O8JS5TTbG/bKm+6qFm/BZVW6gKLbnDGC/QXgHLRc1/aNdWcQz6PVhir0ZiiZKQ1S1B0vIg==',key_name='tempest-keypair-1147096816',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:51:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='d101cd585e604a1881c981c946f70849',ramdisk_id='',reservation_id='r-hfyybj1j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-684994869',owner_user_name='tempest-AttachVolumeTestJSON-684994869-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T08:57:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4191d8a10ac54389b6b633701f6e6c77',uuid=33048996-d559-4b3c-9de9-39bb176c3ec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4c1b906e-2c49-4642-9183-06292be46de4", "address": "fa:16:3e:7e:7d:6c", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1b906e-2c", "ovs_interfaceid": "4c1b906e-2c49-4642-9183-06292be46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 08:59:26 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Converting VIF {"id": "4c1b906e-2c49-4642-9183-06292be46de4", "address": "fa:16:3e:7e:7d:6c", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1b906e-2c", "ovs_interfaceid": "4c1b906e-2c49-4642-9183-06292be46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 08:59:26 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7d:6c,bridge_name='br-int',has_traffic_filtering=True,id=4c1b906e-2c49-4642-9183-06292be46de4,network=Network(e6ddfc91-c02c-429c-90ff-aaad54b98cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1b906e-2c') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 08:59:26 user nova-compute[73104]: DEBUG os_vif [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7d:6c,bridge_name='br-int',has_traffic_filtering=True,id=4c1b906e-2c49-4642-9183-06292be46de4,network=Network(e6ddfc91-c02c-429c-90ff-aaad54b98cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1b906e-2c') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 08:59:26 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:26 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:59:26 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 08:59:26 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:26 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c1b906e-2c, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:59:26 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4c1b906e-2c, col_values=(('external_ids', {'iface-id': '4c1b906e-2c49-4642-9183-06292be46de4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:7d:6c', 'vm-uuid': '33048996-d559-4b3c-9de9-39bb176c3ec9'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 08:59:26 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:26 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 08:59:26 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:26 user nova-compute[73104]: INFO os_vif [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7d:6c,bridge_name='br-int',has_traffic_filtering=True,id=4c1b906e-2c49-4642-9183-06292be46de4,network=Network(e6ddfc91-c02c-429c-90ff-aaad54b98cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1b906e-2c')
Aug 26 08:59:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:28 user nova-compute[73104]: DEBUG nova.compute.manager [req-5f31f460-5ba1-4373-9059-21fb39d1c829 req-f82b2298-54e5-4f7c-8e59-431a66e77294 service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Received event network-vif-plugged-4c1b906e-2c49-4642-9183-06292be46de4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:59:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5f31f460-5ba1-4373-9059-21fb39d1c829 req-f82b2298-54e5-4f7c-8e59-431a66e77294 service nova] Acquiring lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:59:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5f31f460-5ba1-4373-9059-21fb39d1c829 req-f82b2298-54e5-4f7c-8e59-431a66e77294 service nova] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:59:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5f31f460-5ba1-4373-9059-21fb39d1c829 req-f82b2298-54e5-4f7c-8e59-431a66e77294 service nova] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:59:28 user nova-compute[73104]: DEBUG nova.compute.manager [req-5f31f460-5ba1-4373-9059-21fb39d1c829 req-f82b2298-54e5-4f7c-8e59-431a66e77294 service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] No waiting events found dispatching network-vif-plugged-4c1b906e-2c49-4642-9183-06292be46de4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:59:28 user nova-compute[73104]: WARNING nova.compute.manager [req-5f31f460-5ba1-4373-9059-21fb39d1c829 req-f82b2298-54e5-4f7c-8e59-431a66e77294 service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Received unexpected event network-vif-plugged-4c1b906e-2c49-4642-9183-06292be46de4 for instance with vm_state stopped and task_state powering-on.
Aug 26 08:59:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:29 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040369.9723706, 33048996-d559-4b3c-9de9-39bb176c3ec9 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:59:29 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] VM Resumed (Lifecycle Event)
Aug 26 08:59:29 user nova-compute[73104]: DEBUG nova.compute.manager [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 08:59:29 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Instance rebooted successfully.
Aug 26 08:59:29 user nova-compute[73104]: DEBUG nova.compute.manager [None req-0e67c930-6309-4fee-9283-cad28089c137 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:59:29 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:59:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:59:30 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 26 08:59:30 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040369.976296, 33048996-d559-4b3c-9de9-39bb176c3ec9 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 08:59:30 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] VM Started (Lifecycle Event)
Aug 26 08:59:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 08:59:30 user nova-compute[73104]: DEBUG nova.compute.manager [req-af551b3b-196e-4ccf-98aa-0aa65647b463 req-5fad5b3d-39d9-4732-93a9-d7ce9bcae2a6 service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Received event network-vif-plugged-4c1b906e-2c49-4642-9183-06292be46de4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 08:59:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-af551b3b-196e-4ccf-98aa-0aa65647b463 req-5fad5b3d-39d9-4732-93a9-d7ce9bcae2a6 service nova] Acquiring lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 08:59:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-af551b3b-196e-4ccf-98aa-0aa65647b463 req-5fad5b3d-39d9-4732-93a9-d7ce9bcae2a6 service nova] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 08:59:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-af551b3b-196e-4ccf-98aa-0aa65647b463 req-5fad5b3d-39d9-4732-93a9-d7ce9bcae2a6 service nova] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 08:59:30 user nova-compute[73104]: DEBUG nova.compute.manager [req-af551b3b-196e-4ccf-98aa-0aa65647b463 req-5fad5b3d-39d9-4732-93a9-d7ce9bcae2a6 service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] No waiting events found dispatching network-vif-plugged-4c1b906e-2c49-4642-9183-06292be46de4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 08:59:30 user nova-compute[73104]: WARNING nova.compute.manager [req-af551b3b-196e-4ccf-98aa-0aa65647b463 req-5fad5b3d-39d9-4732-93a9-d7ce9bcae2a6 service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Received unexpected event network-vif-plugged-4c1b906e-2c49-4642-9183-06292be46de4 for instance with vm_state stopped and task_state powering-on.
Aug 26 08:59:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 08:59:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:31 user nova-compute[73104]: INFO nova.compute.manager [None req-ec44ab24-3797-4228-ba82-c8f1d83de6b8 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Get console output
Aug 26 08:59:32 user nova-compute[73104]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 26 08:59:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:36 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:41 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:51 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 08:59:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:00:01 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:00:01 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:00:01 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:00:02 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:00:02 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:00:06 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:00:06 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:00:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:00:07 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:00:07 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:00:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:00:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:00:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:00:07 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:00:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:07 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 09:00:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:08 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 09:00:08 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 09:00:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:08 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 09:00:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:00:08 user nova-compute[73104]: DEBUG nova.compute.manager [req-871ef0b6-77d0-4c38-8a97-6f49437f72f7 req-8a01e1cb-8d90-4096-828e-99a964c890f1 service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Received event network-changed-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:00:08 user nova-compute[73104]: DEBUG nova.compute.manager [req-871ef0b6-77d0-4c38-8a97-6f49437f72f7 req-8a01e1cb-8d90-4096-828e-99a964c890f1 service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Refreshing instance network info cache due to event network-changed-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:00:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-871ef0b6-77d0-4c38-8a97-6f49437f72f7 req-8a01e1cb-8d90-4096-828e-99a964c890f1 service nova] Acquiring lock "refresh_cache-f9cadc09-e4ec-4d5c-a22d-912e92c09cff" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:00:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-871ef0b6-77d0-4c38-8a97-6f49437f72f7 req-8a01e1cb-8d90-4096-828e-99a964c890f1 service nova] Acquired lock "refresh_cache-f9cadc09-e4ec-4d5c-a22d-912e92c09cff" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:00:08 user nova-compute[73104]: DEBUG nova.network.neutron [req-871ef0b6-77d0-4c38-8a97-6f49437f72f7 req-8a01e1cb-8d90-4096-828e-99a964c890f1 service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Refreshing network info cache for port 4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:00:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9cadc09-e4ec-4d5c-a22d-912e92c09cff/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9cadc09-e4ec-4d5c-a22d-912e92c09cff/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9cadc09-e4ec-4d5c-a22d-912e92c09cff/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:09 user nova-compute[73104]: DEBUG nova.network.neutron [req-871ef0b6-77d0-4c38-8a97-6f49437f72f7 req-8a01e1cb-8d90-4096-828e-99a964c890f1 service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Updated VIF entry in instance network info cache for port 4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:00:09 user nova-compute[73104]: DEBUG nova.network.neutron [req-871ef0b6-77d0-4c38-8a97-6f49437f72f7 req-8a01e1cb-8d90-4096-828e-99a964c890f1 service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Updating instance_info_cache with network_info: [{"id": "4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6", "address": "fa:16:3e:50:6f:2d", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7f3393-fe", "ovs_interfaceid": "4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:00:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-871ef0b6-77d0-4c38-8a97-6f49437f72f7 req-8a01e1cb-8d90-4096-828e-99a964c890f1 service nova] Releasing lock "refresh_cache-f9cadc09-e4ec-4d5c-a22d-912e92c09cff" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:00:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9cadc09-e4ec-4d5c-a22d-912e92c09cff/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 09:00:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:00:09 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:00:09 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:00:09 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=7569MB free_disk=23.888973236083984GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:00:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:00:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:00:10 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance b5e1f82c-5675-4c37-8ba2-44e6a341a576 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:00:10 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 3cf85d2f-de0d-4e9b-a534-98c799ae8db9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:00:10 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance bef1e493-6b2c-4688-98c2-647261feb571 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:00:10 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 33048996-d559-4b3c-9de9-39bb176c3ec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:00:10 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance bf35aa10-80b1-4518-88b3-63c6a11e626b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:00:10 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 0e3fb03a-d317-4eed-ad52-d066242a13e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:00:10 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance c08a447c-e25d-4f88-b15f-0c3de12559aa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:00:10 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance f9cadc09-e4ec-4d5c-a22d-912e92c09cff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:00:10 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 4d012737-bb37-4bf0-b4f6-491f2c25da2d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:00:10 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:00:10 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:00:10 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:00:10 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:00:10 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:00:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.497s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:00:10 user nova-compute[73104]: DEBUG nova.compute.manager [req-f7e586b7-7e8a-4cca-86f1-7d32fe1908fe req-501e2d5b-9329-4cc1-8afa-4641678c1471 service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Received event network-changed-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:00:10 user nova-compute[73104]: DEBUG nova.compute.manager [req-f7e586b7-7e8a-4cca-86f1-7d32fe1908fe req-501e2d5b-9329-4cc1-8afa-4641678c1471 service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Refreshing instance network info cache due to event network-changed-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:00:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f7e586b7-7e8a-4cca-86f1-7d32fe1908fe req-501e2d5b-9329-4cc1-8afa-4641678c1471 service nova] Acquiring lock "refresh_cache-f9cadc09-e4ec-4d5c-a22d-912e92c09cff" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:00:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f7e586b7-7e8a-4cca-86f1-7d32fe1908fe req-501e2d5b-9329-4cc1-8afa-4641678c1471 service nova] Acquired lock "refresh_cache-f9cadc09-e4ec-4d5c-a22d-912e92c09cff" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:00:10 user nova-compute[73104]: DEBUG nova.network.neutron [req-f7e586b7-7e8a-4cca-86f1-7d32fe1908fe req-501e2d5b-9329-4cc1-8afa-4641678c1471 service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Refreshing network info cache for port 4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:00:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-86dfcea0-cbb5-448b-865f-4f033fed35dc tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:00:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-86dfcea0-cbb5-448b-865f-4f033fed35dc tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:00:10 user nova-compute[73104]: INFO nova.compute.manager [None req-86dfcea0-cbb5-448b-865f-4f033fed35dc tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Detaching volume f22219c0-eb5d-4a8d-9acc-0f6208525aae
Aug 26 09:00:10 user nova-compute[73104]: INFO nova.virt.block_device [None req-86dfcea0-cbb5-448b-865f-4f033fed35dc tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Attempting to driver detach volume f22219c0-eb5d-4a8d-9acc-0f6208525aae from mountpoint /dev/vdb
Aug 26 09:00:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-86dfcea0-cbb5-448b-865f-4f033fed35dc tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Attempting to detach device vdb from instance f9cadc09-e4ec-4d5c-a22d-912e92c09cff from the persistent domain config. {{(pid=73104) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 09:00:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-86dfcea0-cbb5-448b-865f-4f033fed35dc tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 09:00:10 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:00:10 user nova-compute[73104]:   <source dev="/dev/sdd"/>
Aug 26 09:00:10 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:00:10 user nova-compute[73104]:   <serial>f22219c0-eb5d-4a8d-9acc-0f6208525aae</serial>
Aug 26 09:00:10 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 09:00:10 user nova-compute[73104]: </disk>
Aug 26 09:00:10 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 09:00:10 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-86dfcea0-cbb5-448b-865f-4f033fed35dc tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Successfully detached device vdb from instance f9cadc09-e4ec-4d5c-a22d-912e92c09cff from the persistent domain config.
Aug 26 09:00:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-86dfcea0-cbb5-448b-865f-4f033fed35dc tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f9cadc09-e4ec-4d5c-a22d-912e92c09cff from the live domain config. {{(pid=73104) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 09:00:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-86dfcea0-cbb5-448b-865f-4f033fed35dc tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 09:00:10 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:00:10 user nova-compute[73104]:   <source dev="/dev/sdd"/>
Aug 26 09:00:10 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:00:10 user nova-compute[73104]:   <serial>f22219c0-eb5d-4a8d-9acc-0f6208525aae</serial>
Aug 26 09:00:10 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 09:00:10 user nova-compute[73104]: </disk>
Aug 26 09:00:10 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG nova.network.neutron [req-f7e586b7-7e8a-4cca-86f1-7d32fe1908fe req-501e2d5b-9329-4cc1-8afa-4641678c1471 service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Updated VIF entry in instance network info cache for port 4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG nova.network.neutron [req-f7e586b7-7e8a-4cca-86f1-7d32fe1908fe req-501e2d5b-9329-4cc1-8afa-4641678c1471 service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Updating instance_info_cache with network_info: [{"id": "4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6", "address": "fa:16:3e:50:6f:2d", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7f3393-fe", "ovs_interfaceid": "4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f7e586b7-7e8a-4cca-86f1-7d32fe1908fe req-501e2d5b-9329-4cc1-8afa-4641678c1471 service nova] Releasing lock "refresh_cache-f9cadc09-e4ec-4d5c-a22d-912e92c09cff" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Received event <DeviceRemovedEvent: 1693040411.3396664, f9cadc09-e4ec-4d5c-a22d-912e92c09cff => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73104) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-86dfcea0-cbb5-448b-865f-4f033fed35dc tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f9cadc09-e4ec-4d5c-a22d-912e92c09cff {{(pid=73104) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 09:00:11 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-86dfcea0-cbb5-448b-865f-4f033fed35dc tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Successfully detached device vdb from instance f9cadc09-e4ec-4d5c-a22d-912e92c09cff from the live domain config.
Aug 26 09:00:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86dfcea0-cbb5-448b-865f-4f033fed35dc tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-86dfcea0-cbb5-448b-865f-4f033fed35dc tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ngpSfdza', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:00:11 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-86dfcea0-cbb5-448b-865f-4f033fed35dc tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:00:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-86dfcea0-cbb5-448b-865f-4f033fed35dc tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-86dfcea0-cbb5-448b-865f-4f033fed35dc tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-86dfcea0-cbb5-448b-865f-4f033fed35dc tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bc5edb-9b90-4fa2-9df3-145be10072b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6df860d-3ffb-4ef7-88d5-d27e4163c68a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-86dfcea0-cbb5-448b-865f-4f033fed35dc tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 09:00:11 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 09:00:11 user nova-compute[73104]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 09:00:11 user nova-compute[73104]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae (non-flash)
Aug 26 09:00:11 user nova-compute[73104]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a (non-flash)
Aug 26 09:00:11 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-86dfcea0-cbb5-448b-865f-4f033fed35dc tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 09:00:11 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 09:00:11 user nova-compute[73104]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 09:00:11 user nova-compute[73104]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae (non-flash)
Aug 26 09:00:11 user nova-compute[73104]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a (non-flash)
Aug 26 09:00:11 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-86dfcea0-cbb5-448b-865f-4f033fed35dc tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0cc295120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae'): ({'sdd'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-86dfcea0-cbb5-448b-865f-4f033fed35dc tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Removing single pathed devices sdd {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9eb985b-38d6-461d-9c39-29f8e8ce2ea6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f0f32d-600a-4f0b-a1e5-4a611afd1e7c]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-86dfcea0-cbb5-448b-865f-4f033fed35dc tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Flushing IO for device /dev/sdd {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60cab3c-3f5d-4750-ac50-1dbe7059856c]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-86dfcea0-cbb5-448b-865f-4f033fed35dc tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[284bc68a-c56c-4b9f-9d8e-dd59728c68b4]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-86dfcea0-cbb5-448b-865f-4f033fed35dc tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-86dfcea0-cbb5-448b-865f-4f033fed35dc tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] SCSI volumes sdd have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-86dfcea0-cbb5-448b-865f-4f033fed35dc tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c54a2d-db2d-491e-bfe3-22dbf9966282]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-86dfcea0-cbb5-448b-865f-4f033fed35dc tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-c08a447c-e25d-4f88-b15f-0c3de12559aa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-c08a447c-e25d-4f88-b15f-0c3de12559aa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f026e553-d8cc-472f-8907-f8d095aa0c8e]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-86dfcea0-cbb5-448b-865f-4f033fed35dc tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae, portal: 172.16.0.220,3260]
Aug 26 09:00:11 user nova-compute[73104]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae, portal: 172.16.0.220,3260] successful.
Aug 26 09:00:11 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f22219c0-eb5d-4a8d-9acc-0f6208525aae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9dc158-385f-4bea-81f2-b2c6d3571fc1]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-86dfcea0-cbb5-448b-865f-4f033fed35dc tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-86dfcea0-cbb5-448b-865f-4f033fed35dc tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-86dfcea0-cbb5-448b-865f-4f033fed35dc tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] <== disconnect_volume: return (314ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:00:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86dfcea0-cbb5-448b-865f-4f033fed35dc tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 09:00:12 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Updating instance_info_cache with network_info: [{"id": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "address": "fa:16:3e:3a:b1:b8", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15317ff8-61", "ovs_interfaceid": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:00:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-c08a447c-e25d-4f88-b15f-0c3de12559aa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:00:12 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 09:00:12 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:00:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:00:12 user nova-compute[73104]: DEBUG nova.objects.instance [None req-86dfcea0-cbb5-448b-865f-4f033fed35dc tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lazy-loading 'flavor' on Instance uuid f9cadc09-e4ec-4d5c-a22d-912e92c09cff {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:00:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-86dfcea0-cbb5-448b-865f-4f033fed35dc tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.830s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:00:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:00:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:00:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:00:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:00:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:00:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:00:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:00:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:00:26 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:00:26 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:00:26 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:00:26 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:00:26 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:00:26 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:00:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:00:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "c08a447c-e25d-4f88-b15f-0c3de12559aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:00:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "c08a447c-e25d-4f88-b15f-0c3de12559aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:00:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "c08a447c-e25d-4f88-b15f-0c3de12559aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:00:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "c08a447c-e25d-4f88-b15f-0c3de12559aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:00:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "c08a447c-e25d-4f88-b15f-0c3de12559aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:00:32 user nova-compute[73104]: INFO nova.compute.manager [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Terminating instance
Aug 26 09:00:32 user nova-compute[73104]: DEBUG nova.compute.manager [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 09:00:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:00:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG nova.compute.manager [req-80283946-9a0f-43ef-a8d7-9b627974d94e req-8c663521-d9fb-4777-9434-652f9f691904 service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Received event network-vif-unplugged-15317ff8-610b-4e0a-b0a8-ef37bb219ba8 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-80283946-9a0f-43ef-a8d7-9b627974d94e req-8c663521-d9fb-4777-9434-652f9f691904 service nova] Acquiring lock "c08a447c-e25d-4f88-b15f-0c3de12559aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-80283946-9a0f-43ef-a8d7-9b627974d94e req-8c663521-d9fb-4777-9434-652f9f691904 service nova] Lock "c08a447c-e25d-4f88-b15f-0c3de12559aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-80283946-9a0f-43ef-a8d7-9b627974d94e req-8c663521-d9fb-4777-9434-652f9f691904 service nova] Lock "c08a447c-e25d-4f88-b15f-0c3de12559aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG nova.compute.manager [req-80283946-9a0f-43ef-a8d7-9b627974d94e req-8c663521-d9fb-4777-9434-652f9f691904 service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] No waiting events found dispatching network-vif-unplugged-15317ff8-610b-4e0a-b0a8-ef37bb219ba8 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG nova.compute.manager [req-80283946-9a0f-43ef-a8d7-9b627974d94e req-8c663521-d9fb-4777-9434-652f9f691904 service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Received event network-vif-unplugged-15317ff8-610b-4e0a-b0a8-ef37bb219ba8 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:00:33 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Instance destroyed successfully.
Aug 26 09:00:33 user nova-compute[73104]: DEBUG nova.objects.instance [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lazy-loading 'resources' on Instance uuid c08a447c-e25d-4f88-b15f-0c3de12559aa {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:53:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-437929114',display_name='tempest-ServerActionsTestOtherA-server-437929114',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-437929114',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDd7CVbfrgJk+LANTVyASPXlTQ9/WFcC61mCbmrDUGOXT5afWNcplXvZ22xaA7blYJtw8QDJAtG8f1dybdt3ItZCTVqOwov6sASWzyNlxMeQebqYtQoQd/bQsWZ9J2R2Q==',key_name='tempest-keypair-923484929',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:56:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='efb864c0a34541dca00c6dbbcea17319',ramdisk_id='',reservation_id='r-iqtdg5qf',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1245661612',owner_user_name='tempest-ServerActionsTestOtherA-1245661612-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:57:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='257343af54bd42b591e8874ef4ecf8dc',uuid=c08a447c-e25d-4f88-b15f-0c3de12559aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "address": "fa:16:3e:3a:b1:b8", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15317ff8-61", "ovs_interfaceid": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Converting VIF {"id": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "address": "fa:16:3e:3a:b1:b8", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15317ff8-61", "ovs_interfaceid": "15317ff8-610b-4e0a-b0a8-ef37bb219ba8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:b1:b8,bridge_name='br-int',has_traffic_filtering=True,id=15317ff8-610b-4e0a-b0a8-ef37bb219ba8,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15317ff8-61') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG os_vif [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:b1:b8,bridge_name='br-int',has_traffic_filtering=True,id=15317ff8-610b-4e0a-b0a8-ef37bb219ba8,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15317ff8-61') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15317ff8-61, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:00:33 user nova-compute[73104]: INFO os_vif [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:b1:b8,bridge_name='br-int',has_traffic_filtering=True,id=15317ff8-610b-4e0a-b0a8-ef37bb219ba8,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15317ff8-61')
Aug 26 09:00:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pPYHBKjQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:00:33 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:00:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[819b583f-1d93-4898-8eb6-dbf9226f7f87]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e5f5ca-a62d-4352-977b-bb3b3e471679]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 09:00:33 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 09:00:33 user nova-compute[73104]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 09:00:33 user nova-compute[73104]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a (non-flash)
Aug 26 09:00:33 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 09:00:33 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 09:00:33 user nova-compute[73104]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 (non-flash)
Aug 26 09:00:33 user nova-compute[73104]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a (non-flash)
Aug 26 09:00:33 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0cc172b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185'): ({'sde'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Removing single pathed devices sde {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb9e5ba-65a1-4443-9b12-7bcedc9efd8a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0886318e-f043-4b47-8936-92886d23ece1]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Flushing IO for device /dev/sde {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[01070924-79d9-4c89-88b2-c3b64a821d49]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.064s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60b9606-41ee-437b-ae7c-a4feacd25939]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] SCSI volumes sde have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd198d8-2304-4a77-9f02-eb0dba4c6338]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c350e6f9-969d-44a5-a636-7a4b075aa833]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185, portal: 172.16.0.220,3260]
Aug 26 09:00:33 user nova-compute[73104]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185, portal: 172.16.0.220,3260] successful.
Aug 26 09:00:33 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bad36aef-53e3-49c3-9dd8-e4b9c2d65185 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a12ced-b0b7-473a-a21b-662f1f01aad3]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] <== disconnect_volume: return (301ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 09:00:33 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Deleting instance files /opt/stack/data/nova/instances/c08a447c-e25d-4f88-b15f-0c3de12559aa_del
Aug 26 09:00:33 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Deletion of /opt/stack/data/nova/instances/c08a447c-e25d-4f88-b15f-0c3de12559aa_del complete
Aug 26 09:00:33 user nova-compute[73104]: INFO nova.compute.manager [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 26 09:00:33 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 09:00:33 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 09:00:35 user nova-compute[73104]: DEBUG nova.compute.manager [req-d2ef8b9b-9541-44c5-98fb-71ea9f8dd579 req-a396f9dd-f55f-4f0d-b44b-e7f93296d63c service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Received event network-vif-plugged-15317ff8-610b-4e0a-b0a8-ef37bb219ba8 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:00:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d2ef8b9b-9541-44c5-98fb-71ea9f8dd579 req-a396f9dd-f55f-4f0d-b44b-e7f93296d63c service nova] Acquiring lock "c08a447c-e25d-4f88-b15f-0c3de12559aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:00:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d2ef8b9b-9541-44c5-98fb-71ea9f8dd579 req-a396f9dd-f55f-4f0d-b44b-e7f93296d63c service nova] Lock "c08a447c-e25d-4f88-b15f-0c3de12559aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:00:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d2ef8b9b-9541-44c5-98fb-71ea9f8dd579 req-a396f9dd-f55f-4f0d-b44b-e7f93296d63c service nova] Lock "c08a447c-e25d-4f88-b15f-0c3de12559aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:00:35 user nova-compute[73104]: DEBUG nova.compute.manager [req-d2ef8b9b-9541-44c5-98fb-71ea9f8dd579 req-a396f9dd-f55f-4f0d-b44b-e7f93296d63c service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] No waiting events found dispatching network-vif-plugged-15317ff8-610b-4e0a-b0a8-ef37bb219ba8 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:00:35 user nova-compute[73104]: WARNING nova.compute.manager [req-d2ef8b9b-9541-44c5-98fb-71ea9f8dd579 req-a396f9dd-f55f-4f0d-b44b-e7f93296d63c service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Received unexpected event network-vif-plugged-15317ff8-610b-4e0a-b0a8-ef37bb219ba8 for instance with vm_state active and task_state deleting.
Aug 26 09:00:35 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:00:35 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Took 1.22 seconds to deallocate network for instance.
Aug 26 09:00:35 user nova-compute[73104]: DEBUG nova.compute.manager [req-37ff723e-e1cb-40eb-9823-89b34f8d22b2 req-733dd956-52e6-4487-890e-4a77cf887d86 service nova] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Received event network-vif-deleted-15317ff8-610b-4e0a-b0a8-ef37bb219ba8 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:00:36 user nova-compute[73104]: INFO nova.compute.manager [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Took 0.85 seconds to detach 1 volumes for instance.
Aug 26 09:00:36 user nova-compute[73104]: DEBUG nova.compute.manager [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Deleting volume: bad36aef-53e3-49c3-9dd8-e4b9c2d65185 {{(pid=73104) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 09:00:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:00:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:00:36 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:00:36 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:00:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:00:36 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Deleted allocations for instance c08a447c-e25d-4f88-b15f-0c3de12559aa
Aug 26 09:00:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-19ea3a2e-ad09-43e3-957b-b396dd2c61d4 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "c08a447c-e25d-4f88-b15f-0c3de12559aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.894s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:00:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:00:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:00:48 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693040433.532789, c08a447c-e25d-4f88-b15f-0c3de12559aa => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:00:48 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] VM Stopped (Lifecycle Event)
Aug 26 09:00:48 user nova-compute[73104]: DEBUG nova.compute.manager [None req-dd09880b-70e3-4c39-99e4-311097cd3cc3 None None] [instance: c08a447c-e25d-4f88-b15f-0c3de12559aa] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:00:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:00:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "4d012737-bb37-4bf0-b4f6-491f2c25da2d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:00:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "4d012737-bb37-4bf0-b4f6-491f2c25da2d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:00:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "4d012737-bb37-4bf0-b4f6-491f2c25da2d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:00:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "4d012737-bb37-4bf0-b4f6-491f2c25da2d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:00:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "4d012737-bb37-4bf0-b4f6-491f2c25da2d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:00:49 user nova-compute[73104]: INFO nova.compute.manager [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Terminating instance
Aug 26 09:00:49 user nova-compute[73104]: DEBUG nova.compute.manager [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 09:00:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:00:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:00:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:00:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:00:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-940d6558-e740-430f-aeaf-f167f7590374 req-a6b99645-c42e-40bc-9a5a-6e5f5eb101a4 service nova] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Received event network-vif-unplugged-4c3948af-7a8f-4983-8e2a-c8f2c56403bf {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:00:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-940d6558-e740-430f-aeaf-f167f7590374 req-a6b99645-c42e-40bc-9a5a-6e5f5eb101a4 service nova] Acquiring lock "4d012737-bb37-4bf0-b4f6-491f2c25da2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:00:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-940d6558-e740-430f-aeaf-f167f7590374 req-a6b99645-c42e-40bc-9a5a-6e5f5eb101a4 service nova] Lock "4d012737-bb37-4bf0-b4f6-491f2c25da2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:00:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-940d6558-e740-430f-aeaf-f167f7590374 req-a6b99645-c42e-40bc-9a5a-6e5f5eb101a4 service nova] Lock "4d012737-bb37-4bf0-b4f6-491f2c25da2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:00:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-940d6558-e740-430f-aeaf-f167f7590374 req-a6b99645-c42e-40bc-9a5a-6e5f5eb101a4 service nova] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] No waiting events found dispatching network-vif-unplugged-4c3948af-7a8f-4983-8e2a-c8f2c56403bf {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:00:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-940d6558-e740-430f-aeaf-f167f7590374 req-a6b99645-c42e-40bc-9a5a-6e5f5eb101a4 service nova] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Received event network-vif-unplugged-4c3948af-7a8f-4983-8e2a-c8f2c56403bf for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 09:00:50 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Instance destroyed successfully.
Aug 26 09:00:50 user nova-compute[73104]: DEBUG nova.objects.instance [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lazy-loading 'resources' on Instance uuid 4d012737-bb37-4bf0-b4f6-491f2c25da2d {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:58:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2082038050',display_name='tempest-TestVolumeBootPattern-server-2082038050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2082038050',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:59:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52518aa77344432385cfc2b73c63aebe',ramdisk_id='',reservation_id='r-55m0yyxv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1466837638',owner_user_name='tempest-TestVolumeBootPattern-1466837638-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:59:23Z,user_data=None,user_id='bae03c9c8a9a40b2af6bd1fefb3561d0',uuid=4d012737-bb37-4bf0-b4f6-491f2c25da2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c3948af-7a8f-4983-8e2a-c8f2c56403bf", "address": "fa:16:3e:3e:ca:c0", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3948af-7a", "ovs_interfaceid": "4c3948af-7a8f-4983-8e2a-c8f2c56403bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converting VIF {"id": "4c3948af-7a8f-4983-8e2a-c8f2c56403bf", "address": "fa:16:3e:3e:ca:c0", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3948af-7a", "ovs_interfaceid": "4c3948af-7a8f-4983-8e2a-c8f2c56403bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:ca:c0,bridge_name='br-int',has_traffic_filtering=True,id=4c3948af-7a8f-4983-8e2a-c8f2c56403bf,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c3948af-7a') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG os_vif [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:ca:c0,bridge_name='br-int',has_traffic_filtering=True,id=4c3948af-7a8f-4983-8e2a-c8f2c56403bf,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c3948af-7a') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c3948af-7a, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:00:50 user nova-compute[73104]: INFO os_vif [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:ca:c0,bridge_name='br-int',has_traffic_filtering=True,id=4c3948af-7a8f-4983-8e2a-c8f2c56403bf,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c3948af-7a')
Aug 26 09:00:50 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QseZKxDh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:00:50 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:00:50 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b3a3d3-0f90-4a41-a4f7-c1d34dd45bea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2ded51-dfdc-49b9-8289-d40b7f909238]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 09:00:50 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 09:00:50 user nova-compute[73104]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a (non-flash)
Aug 26 09:00:50 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 09:00:50 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 09:00:50 user nova-compute[73104]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a (non-flash)
Aug 26 09:00:50 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0cc295120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a'): ({'sdf'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Removing single pathed devices sdf {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a52f9e-4c08-4528-b128-a7969ebe43e7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f102a07-8825-4fc3-b7f2-8f282aed4965]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Flushing IO for device /dev/sdf {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[975081fb-0a55-4b68-bb9d-adb58faea38b]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[463481da-1d87-4224-bd16-f20e842444d1]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] SCSI volumes sdf have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23732346137386330', '/dev/disk/by-id/scsi-1SCST_BIOdaec64b5-724a78c0b8e263d5', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_daec64b5') {{(pid=84263) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[663bbf90-329e-447e-8776-7756f8224b47]: (4, None) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8026c23-a803-4df3-b809-999da9751a25]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f65afeb-0688-4387-8975-517357e71948]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a, portal: 172.16.0.220,3260]
Aug 26 09:00:50 user nova-compute[73104]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a, portal: 172.16.0.220,3260] successful.
Aug 26 09:00:50 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed9a2498-c3b4-4842-aaaa-9b3d88920f1a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[42620c27-8881-4cf7-a9c6-a5f118618b3f]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] <== disconnect_volume: return (294ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 09:00:50 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Deleting instance files /opt/stack/data/nova/instances/4d012737-bb37-4bf0-b4f6-491f2c25da2d_del
Aug 26 09:00:50 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Deletion of /opt/stack/data/nova/instances/4d012737-bb37-4bf0-b4f6-491f2c25da2d_del complete
Aug 26 09:00:50 user nova-compute[73104]: INFO nova.compute.manager [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 26 09:00:50 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 09:00:50 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 09:00:51 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:00:51 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Took 0.60 seconds to deallocate network for instance.
Aug 26 09:00:51 user nova-compute[73104]: DEBUG nova.compute.manager [req-2139622c-3f31-4a91-96a8-8b50b5370a30 req-466554c5-b10e-478e-8551-d2b59ae767d5 service nova] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Received event network-vif-plugged-4c3948af-7a8f-4983-8e2a-c8f2c56403bf {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:00:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2139622c-3f31-4a91-96a8-8b50b5370a30 req-466554c5-b10e-478e-8551-d2b59ae767d5 service nova] Acquiring lock "4d012737-bb37-4bf0-b4f6-491f2c25da2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:00:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2139622c-3f31-4a91-96a8-8b50b5370a30 req-466554c5-b10e-478e-8551-d2b59ae767d5 service nova] Lock "4d012737-bb37-4bf0-b4f6-491f2c25da2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:00:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2139622c-3f31-4a91-96a8-8b50b5370a30 req-466554c5-b10e-478e-8551-d2b59ae767d5 service nova] Lock "4d012737-bb37-4bf0-b4f6-491f2c25da2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:00:51 user nova-compute[73104]: DEBUG nova.compute.manager [req-2139622c-3f31-4a91-96a8-8b50b5370a30 req-466554c5-b10e-478e-8551-d2b59ae767d5 service nova] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] No waiting events found dispatching network-vif-plugged-4c3948af-7a8f-4983-8e2a-c8f2c56403bf {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:00:51 user nova-compute[73104]: WARNING nova.compute.manager [req-2139622c-3f31-4a91-96a8-8b50b5370a30 req-466554c5-b10e-478e-8551-d2b59ae767d5 service nova] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Received unexpected event network-vif-plugged-4c3948af-7a8f-4983-8e2a-c8f2c56403bf for instance with vm_state active and task_state deleting.
Aug 26 09:00:51 user nova-compute[73104]: DEBUG nova.compute.manager [req-2139622c-3f31-4a91-96a8-8b50b5370a30 req-466554c5-b10e-478e-8551-d2b59ae767d5 service nova] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Received event network-vif-deleted-4c3948af-7a8f-4983-8e2a-c8f2c56403bf {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:00:51 user nova-compute[73104]: INFO nova.compute.manager [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Took 0.80 seconds to detach 1 volumes for instance.
Aug 26 09:00:51 user nova-compute[73104]: DEBUG nova.compute.manager [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Deleting volume: ed9a2498-c3b4-4842-aaaa-9b3d88920f1a {{(pid=73104) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 09:00:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:00:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:00:52 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:00:52 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:00:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:00:52 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Deleted allocations for instance 4d012737-bb37-4bf0-b4f6-491f2c25da2d
Aug 26 09:00:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5be26b2a-7bd7-458c-994b-089a92ce5065 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "4d012737-bb37-4bf0-b4f6-491f2c25da2d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.166s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:00:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:01:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:01:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:01:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:01:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:02 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:01:02 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:01:04 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:01:04 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:01:05 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693040450.1902323, 4d012737-bb37-4bf0-b4f6-491f2c25da2d => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:01:05 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] VM Stopped (Lifecycle Event)
Aug 26 09:01:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:05 user nova-compute[73104]: DEBUG nova.compute.manager [None req-76d0481c-7580-468b-8308-dad649b9566f None None] [instance: 4d012737-bb37-4bf0-b4f6-491f2c25da2d] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:01:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "0e3fb03a-d317-4eed-ad52-d066242a13e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:01:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "0e3fb03a-d317-4eed-ad52-d066242a13e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:01:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:01:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:01:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:01:05 user nova-compute[73104]: INFO nova.compute.manager [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Terminating instance
Aug 26 09:01:05 user nova-compute[73104]: DEBUG nova.compute.manager [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 09:01:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:05 user nova-compute[73104]: DEBUG nova.compute.manager [req-b63eecb3-4065-43ce-ac49-b19c95d1787a req-0dfc9172-1b4d-464a-bd64-8a1c94ca2c8b service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Received event network-vif-unplugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:01:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b63eecb3-4065-43ce-ac49-b19c95d1787a req-0dfc9172-1b4d-464a-bd64-8a1c94ca2c8b service nova] Acquiring lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:01:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b63eecb3-4065-43ce-ac49-b19c95d1787a req-0dfc9172-1b4d-464a-bd64-8a1c94ca2c8b service nova] Lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:01:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b63eecb3-4065-43ce-ac49-b19c95d1787a req-0dfc9172-1b4d-464a-bd64-8a1c94ca2c8b service nova] Lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:01:05 user nova-compute[73104]: DEBUG nova.compute.manager [req-b63eecb3-4065-43ce-ac49-b19c95d1787a req-0dfc9172-1b4d-464a-bd64-8a1c94ca2c8b service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] No waiting events found dispatching network-vif-unplugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:01:05 user nova-compute[73104]: DEBUG nova.compute.manager [req-b63eecb3-4065-43ce-ac49-b19c95d1787a req-0dfc9172-1b4d-464a-bd64-8a1c94ca2c8b service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Received event network-vif-unplugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:06 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Instance destroyed successfully.
Aug 26 09:01:06 user nova-compute[73104]: DEBUG nova.objects.instance [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lazy-loading 'resources' on Instance uuid 0e3fb03a-d317-4eed-ad52-d066242a13e0 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:55:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1054489120',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1054489120',id=35,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:57:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a37356203d547c2abf0aa634c2ad548',ramdisk_id='',reservation_id='r-xgt8vddh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1111216102',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:59:19Z,user_data=None,user_id='bcd11beb7046440f814cbf4a13ab0272',uuid=0e3fb03a-d317-4eed-ad52-d066242a13e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd9b2f61-e1a4-47ba-8890-72715a8e241e", "address": "fa:16:3e:ed:2c:7f", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd9b2f61-e1", "ovs_interfaceid": "fd9b2f61-e1a4-47ba-8890-72715a8e241e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Converting VIF {"id": "fd9b2f61-e1a4-47ba-8890-72715a8e241e", "address": "fa:16:3e:ed:2c:7f", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd9b2f61-e1", "ovs_interfaceid": "fd9b2f61-e1a4-47ba-8890-72715a8e241e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:2c:7f,bridge_name='br-int',has_traffic_filtering=True,id=fd9b2f61-e1a4-47ba-8890-72715a8e241e,network=Network(ce0a529c-2119-4b2a-a08f-567e3671c3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd9b2f61-e1') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG os_vif [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:2c:7f,bridge_name='br-int',has_traffic_filtering=True,id=fd9b2f61-e1a4-47ba-8890-72715a8e241e,network=Network(ce0a529c-2119-4b2a-a08f-567e3671c3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd9b2f61-e1') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd9b2f61-e1, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:01:06 user nova-compute[73104]: INFO os_vif [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:2c:7f,bridge_name='br-int',has_traffic_filtering=True,id=fd9b2f61-e1a4-47ba-8890-72715a8e241e,network=Network(ce0a529c-2119-4b2a-a08f-567e3671c3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd9b2f61-e1')
Aug 26 09:01:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uRXgQlJf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:01:06 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:01:06 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ecb762-8939-460b-bf43-5772287b2494]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb3a293-8d5d-4d5c-9e4c-61f7ddcc4c2a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 09:01:06 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 09:01:06 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 09:01:06 user nova-compute[73104]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 (non-flash)
Aug 26 09:01:06 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b4797910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7'): ({'sdc'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Removing single pathed devices sdc {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e6a084-5a3c-449f-9ff1-e2df9a072a2e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5a2719-5d97-4582-88d7-a00e302cbfbe]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Flushing IO for device /dev/sdc {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f234a823-1020-48ec-b4b9-69cde9e2c656]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22b6346-2db3-4c8a-af9e-0eb2a2dcd982]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] SCSI volumes sdc have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO6cc0fa28-d5f0d140997b50c3', '/dev/disk/by-id/scsi-26435663064313430', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6cc0fa28') {{(pid=84263) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[dead8c2b-c4b2-4393-a394-1a0d743b8849]: (4, None) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.075s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ef35ea-f880-4ecf-8a35-6e799a6cf17b]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[291a93c3-6741-4886-b4cd-b934c658e956]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7, portal: 172.16.0.220,3260]
Aug 26 09:01:06 user nova-compute[73104]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7, portal: 172.16.0.220,3260] successful.
Aug 26 09:01:06 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65bfdc23-25e2-4b96-923f-c523f0e1ddf7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fc1195-968f-48e4-ae6c-f997c8e2677f]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] <== disconnect_volume: return (394ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 09:01:06 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Deleting instance files /opt/stack/data/nova/instances/0e3fb03a-d317-4eed-ad52-d066242a13e0_del
Aug 26 09:01:06 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Deletion of /opt/stack/data/nova/instances/0e3fb03a-d317-4eed-ad52-d066242a13e0_del complete
Aug 26 09:01:06 user nova-compute[73104]: INFO nova.compute.manager [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Took 1.30 seconds to destroy the instance on the hypervisor.
Aug 26 09:01:06 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 09:01:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:07 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:01:07 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:01:07 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:01:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:01:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:01:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:01:07 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:01:07 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:01:07 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Took 0.75 seconds to deallocate network for instance.
Aug 26 09:01:07 user nova-compute[73104]: DEBUG nova.compute.manager [req-236c329d-5970-4225-8c4d-c3445fd01da7 req-4572a7d1-4699-4fd6-98c0-76e3137d3af5 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Received event network-vif-deleted-fd9b2f61-e1a4-47ba-8890-72715a8e241e {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:01:07 user nova-compute[73104]: INFO nova.compute.manager [req-236c329d-5970-4225-8c4d-c3445fd01da7 req-4572a7d1-4699-4fd6-98c0-76e3137d3af5 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Neutron deleted interface fd9b2f61-e1a4-47ba-8890-72715a8e241e; detaching it from the instance and deleting it from the info cache
Aug 26 09:01:07 user nova-compute[73104]: DEBUG nova.network.neutron [req-236c329d-5970-4225-8c4d-c3445fd01da7 req-4572a7d1-4699-4fd6-98c0-76e3137d3af5 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:01:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:01:07 user nova-compute[73104]: DEBUG nova.compute.manager [req-236c329d-5970-4225-8c4d-c3445fd01da7 req-4572a7d1-4699-4fd6-98c0-76e3137d3af5 service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Detach interface failed, port_id=fd9b2f61-e1a4-47ba-8890-72715a8e241e, reason: Instance 0e3fb03a-d317-4eed-ad52-d066242a13e0 could not be found. {{(pid=73104) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 09:01:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:01:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:01:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:01:07 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 09:01:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:01:07 user nova-compute[73104]: DEBUG nova.compute.manager [req-4c138533-17c8-4f8e-811d-cc3331bb8549 req-ccadcd36-5803-494d-888b-6660d33bc7ee service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Received event network-vif-plugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:01:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4c138533-17c8-4f8e-811d-cc3331bb8549 req-ccadcd36-5803-494d-888b-6660d33bc7ee service nova] Acquiring lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:01:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4c138533-17c8-4f8e-811d-cc3331bb8549 req-ccadcd36-5803-494d-888b-6660d33bc7ee service nova] Lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:01:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4c138533-17c8-4f8e-811d-cc3331bb8549 req-ccadcd36-5803-494d-888b-6660d33bc7ee service nova] Lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:01:07 user nova-compute[73104]: DEBUG nova.compute.manager [req-4c138533-17c8-4f8e-811d-cc3331bb8549 req-ccadcd36-5803-494d-888b-6660d33bc7ee service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] No waiting events found dispatching network-vif-plugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:01:07 user nova-compute[73104]: WARNING nova.compute.manager [req-4c138533-17c8-4f8e-811d-cc3331bb8549 req-ccadcd36-5803-494d-888b-6660d33bc7ee service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Received unexpected event network-vif-plugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e for instance with vm_state active and task_state deleting.
Aug 26 09:01:07 user nova-compute[73104]: DEBUG nova.compute.manager [req-4c138533-17c8-4f8e-811d-cc3331bb8549 req-ccadcd36-5803-494d-888b-6660d33bc7ee service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Received event network-vif-plugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:01:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4c138533-17c8-4f8e-811d-cc3331bb8549 req-ccadcd36-5803-494d-888b-6660d33bc7ee service nova] Acquiring lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:01:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4c138533-17c8-4f8e-811d-cc3331bb8549 req-ccadcd36-5803-494d-888b-6660d33bc7ee service nova] Lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:01:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4c138533-17c8-4f8e-811d-cc3331bb8549 req-ccadcd36-5803-494d-888b-6660d33bc7ee service nova] Lock "0e3fb03a-d317-4eed-ad52-d066242a13e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:01:07 user nova-compute[73104]: DEBUG nova.compute.manager [req-4c138533-17c8-4f8e-811d-cc3331bb8549 req-ccadcd36-5803-494d-888b-6660d33bc7ee service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] No waiting events found dispatching network-vif-plugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:01:07 user nova-compute[73104]: WARNING nova.compute.manager [req-4c138533-17c8-4f8e-811d-cc3331bb8549 req-ccadcd36-5803-494d-888b-6660d33bc7ee service nova] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Received unexpected event network-vif-plugged-fd9b2f61-e1a4-47ba-8890-72715a8e241e for instance with vm_state active and task_state deleting.
Aug 26 09:01:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:01:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:01:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:01:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:01:08 user nova-compute[73104]: INFO nova.compute.manager [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Took 0.97 seconds to detach 1 volumes for instance.
Aug 26 09:01:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:01:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:01:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:01:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:01:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:01:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:01:08 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:01:08 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:01:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.399s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:01:08 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Deleted allocations for instance 0e3fb03a-d317-4eed-ad52-d066242a13e0
Aug 26 09:01:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:01:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:01:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2923b82d-6391-40b5-add0-bd12771405a8 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:01:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2923b82d-6391-40b5-add0-bd12771405a8 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:01:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2923b82d-6391-40b5-add0-bd12771405a8 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:01:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2923b82d-6391-40b5-add0-bd12771405a8 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:01:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2923b82d-6391-40b5-add0-bd12771405a8 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:01:08 user nova-compute[73104]: INFO nova.compute.manager [None req-2923b82d-6391-40b5-add0-bd12771405a8 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Terminating instance
Aug 26 09:01:08 user nova-compute[73104]: DEBUG nova.compute.manager [None req-2923b82d-6391-40b5-add0-bd12771405a8 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 09:01:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2607b445-cd57-476c-9cde-9deaf40aa5ae tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "0e3fb03a-d317-4eed-ad52-d066242a13e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.673s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:01:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:01:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9cadc09-e4ec-4d5c-a22d-912e92c09cff/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:01:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9cadc09-e4ec-4d5c-a22d-912e92c09cff/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:01:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9cadc09-e4ec-4d5c-a22d-912e92c09cff/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:01:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:09 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Instance destroyed successfully.
Aug 26 09:01:09 user nova-compute[73104]: DEBUG nova.objects.instance [None req-2923b82d-6391-40b5-add0-bd12771405a8 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lazy-loading 'resources' on Instance uuid f9cadc09-e4ec-4d5c-a22d-912e92c09cff {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:01:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-2923b82d-6391-40b5-add0-bd12771405a8 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:56:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-649658045',display_name='tempest-TestMinimumBasicScenario-server-649658045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-649658045',id=36,image_ref='dd37b38e-c03a-412e-96fc-c296d19c2399',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIR6WrKTQc87JvDvGA6RP7PEin63Ysd2MRaez9o8vAjF3n9YEN6qsw7K36Gf596EaWwz/c2ujq8m12/Zv3hB9OEZbdgdidX8h9j8mwXl6ETw1+aJV7H3lKsipmUQp9MxSg==',key_name='tempest-TestMinimumBasicScenario-462156163',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:56:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='718e3cb41d5342069cd73b96bade97e7',ramdisk_id='',reservation_id='r-vtsndtep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd37b38e-c03a-412e-96fc-c296d19c2399',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1112860810',owner_user_name='tempest-TestMinimumBasicScenario-1112860810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:58:24Z,user_data=None,user_id='6fd47a4b6ae846a79a378d6ed543fd1c',uuid=f9cadc09-e4ec-4d5c-a22d-912e92c09cff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6", "address": "fa:16:3e:50:6f:2d", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7f3393-fe", "ovs_interfaceid": "4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 09:01:09 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-2923b82d-6391-40b5-add0-bd12771405a8 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Converting VIF {"id": "4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6", "address": "fa:16:3e:50:6f:2d", "network": {"id": "85684c43-d34e-47e3-a067-9c4fb1520baf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-89141303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "718e3cb41d5342069cd73b96bade97e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b7f3393-fe", "ovs_interfaceid": "4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:01:09 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-2923b82d-6391-40b5-add0-bd12771405a8 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:6f:2d,bridge_name='br-int',has_traffic_filtering=True,id=4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6,network=Network(85684c43-d34e-47e3-a067-9c4fb1520baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b7f3393-fe') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:01:09 user nova-compute[73104]: DEBUG os_vif [None req-2923b82d-6391-40b5-add0-bd12771405a8 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:6f:2d,bridge_name='br-int',has_traffic_filtering=True,id=4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6,network=Network(85684c43-d34e-47e3-a067-9c4fb1520baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b7f3393-fe') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 09:01:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9cadc09-e4ec-4d5c-a22d-912e92c09cff/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:01:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b7f3393-fe, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:01:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:01:09 user nova-compute[73104]: INFO os_vif [None req-2923b82d-6391-40b5-add0-bd12771405a8 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:6f:2d,bridge_name='br-int',has_traffic_filtering=True,id=4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6,network=Network(85684c43-d34e-47e3-a067-9c4fb1520baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b7f3393-fe')
Aug 26 09:01:09 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-2923b82d-6391-40b5-add0-bd12771405a8 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Deleting instance files /opt/stack/data/nova/instances/f9cadc09-e4ec-4d5c-a22d-912e92c09cff_del
Aug 26 09:01:09 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-2923b82d-6391-40b5-add0-bd12771405a8 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Deletion of /opt/stack/data/nova/instances/f9cadc09-e4ec-4d5c-a22d-912e92c09cff_del complete
Aug 26 09:01:10 user nova-compute[73104]: DEBUG nova.compute.manager [req-0697dc83-eb7b-4c3b-b9cf-abcd4da95363 req-79a621b6-71bf-412d-974d-94d5e11d593b service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Received event network-vif-unplugged-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:01:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0697dc83-eb7b-4c3b-b9cf-abcd4da95363 req-79a621b6-71bf-412d-974d-94d5e11d593b service nova] Acquiring lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:01:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0697dc83-eb7b-4c3b-b9cf-abcd4da95363 req-79a621b6-71bf-412d-974d-94d5e11d593b service nova] Lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:01:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0697dc83-eb7b-4c3b-b9cf-abcd4da95363 req-79a621b6-71bf-412d-974d-94d5e11d593b service nova] Lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:01:10 user nova-compute[73104]: DEBUG nova.compute.manager [req-0697dc83-eb7b-4c3b-b9cf-abcd4da95363 req-79a621b6-71bf-412d-974d-94d5e11d593b service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] No waiting events found dispatching network-vif-unplugged-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:01:10 user nova-compute[73104]: DEBUG nova.compute.manager [req-0697dc83-eb7b-4c3b-b9cf-abcd4da95363 req-79a621b6-71bf-412d-974d-94d5e11d593b service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Received event network-vif-unplugged-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 09:01:10 user nova-compute[73104]: DEBUG nova.compute.manager [req-0697dc83-eb7b-4c3b-b9cf-abcd4da95363 req-79a621b6-71bf-412d-974d-94d5e11d593b service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Received event network-vif-plugged-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:01:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0697dc83-eb7b-4c3b-b9cf-abcd4da95363 req-79a621b6-71bf-412d-974d-94d5e11d593b service nova] Acquiring lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:01:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0697dc83-eb7b-4c3b-b9cf-abcd4da95363 req-79a621b6-71bf-412d-974d-94d5e11d593b service nova] Lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:01:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0697dc83-eb7b-4c3b-b9cf-abcd4da95363 req-79a621b6-71bf-412d-974d-94d5e11d593b service nova] Lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:01:10 user nova-compute[73104]: DEBUG nova.compute.manager [req-0697dc83-eb7b-4c3b-b9cf-abcd4da95363 req-79a621b6-71bf-412d-974d-94d5e11d593b service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] No waiting events found dispatching network-vif-plugged-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:01:10 user nova-compute[73104]: WARNING nova.compute.manager [req-0697dc83-eb7b-4c3b-b9cf-abcd4da95363 req-79a621b6-71bf-412d-974d-94d5e11d593b service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Received unexpected event network-vif-plugged-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 for instance with vm_state active and task_state deleting.
Aug 26 09:01:10 user nova-compute[73104]: INFO nova.compute.manager [None req-2923b82d-6391-40b5-add0-bd12771405a8 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Took 1.31 seconds to destroy the instance on the hypervisor.
Aug 26 09:01:10 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-2923b82d-6391-40b5-add0-bd12771405a8 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 09:01:10 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 09:01:10 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 09:01:10 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:01:10 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:01:10 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8146MB free_disk=23.886016845703125GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:01:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:01:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:01:10 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance b5e1f82c-5675-4c37-8ba2-44e6a341a576 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:01:10 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 3cf85d2f-de0d-4e9b-a534-98c799ae8db9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:01:10 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance bef1e493-6b2c-4688-98c2-647261feb571 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:01:10 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 33048996-d559-4b3c-9de9-39bb176c3ec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:01:10 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance bf35aa10-80b1-4518-88b3-63c6a11e626b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:01:10 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance f9cadc09-e4ec-4d5c-a22d-912e92c09cff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:01:10 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:01:10 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:01:10 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:01:10 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:01:10 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:01:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.357s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:01:10 user nova-compute[73104]: DEBUG nova.compute.manager [req-331341a6-ecaa-49e5-877d-b67d6abae2dc req-873e1101-8d22-4fdd-9649-751ed185595f service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Received event network-vif-deleted-4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:01:10 user nova-compute[73104]: INFO nova.compute.manager [req-331341a6-ecaa-49e5-877d-b67d6abae2dc req-873e1101-8d22-4fdd-9649-751ed185595f service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Neutron deleted interface 4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6; detaching it from the instance and deleting it from the info cache
Aug 26 09:01:10 user nova-compute[73104]: DEBUG nova.network.neutron [req-331341a6-ecaa-49e5-877d-b67d6abae2dc req-873e1101-8d22-4fdd-9649-751ed185595f service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:01:10 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:01:10 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Took 0.64 seconds to deallocate network for instance.
Aug 26 09:01:10 user nova-compute[73104]: DEBUG nova.compute.manager [req-331341a6-ecaa-49e5-877d-b67d6abae2dc req-873e1101-8d22-4fdd-9649-751ed185595f service nova] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Detach interface failed, port_id=4b7f3393-fe90-48c8-bcc6-6e0ecf3628d6, reason: Instance f9cadc09-e4ec-4d5c-a22d-912e92c09cff could not be found. {{(pid=73104) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 09:01:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2923b82d-6391-40b5-add0-bd12771405a8 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:01:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2923b82d-6391-40b5-add0-bd12771405a8 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:01:11 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-2923b82d-6391-40b5-add0-bd12771405a8 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:01:11 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-2923b82d-6391-40b5-add0-bd12771405a8 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:01:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2923b82d-6391-40b5-add0-bd12771405a8 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:01:11 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-2923b82d-6391-40b5-add0-bd12771405a8 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Deleted allocations for instance f9cadc09-e4ec-4d5c-a22d-912e92c09cff
Aug 26 09:01:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2923b82d-6391-40b5-add0-bd12771405a8 tempest-TestMinimumBasicScenario-1112860810 tempest-TestMinimumBasicScenario-1112860810-project-member] Lock "f9cadc09-e4ec-4d5c-a22d-912e92c09cff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.394s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:01:13 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:01:13 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:01:13 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:01:13 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Didn't find any instances for network info cache update. {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 09:01:13 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:01:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-82059cde-41da-4716-81d3-8fe8358ee0fd tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "33048996-d559-4b3c-9de9-39bb176c3ec9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:01:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-82059cde-41da-4716-81d3-8fe8358ee0fd tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:01:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-82059cde-41da-4716-81d3-8fe8358ee0fd tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:01:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-82059cde-41da-4716-81d3-8fe8358ee0fd tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:01:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-82059cde-41da-4716-81d3-8fe8358ee0fd tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:01:16 user nova-compute[73104]: INFO nova.compute.manager [None req-82059cde-41da-4716-81d3-8fe8358ee0fd tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Terminating instance
Aug 26 09:01:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-82059cde-41da-4716-81d3-8fe8358ee0fd tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 09:01:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-f8a3e5ff-ef6c-4900-a2d6-056eed1ade4e req-5da1a3cb-ebe8-4b2e-974d-00c002e55616 service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Received event network-vif-unplugged-4c1b906e-2c49-4642-9183-06292be46de4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:01:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f8a3e5ff-ef6c-4900-a2d6-056eed1ade4e req-5da1a3cb-ebe8-4b2e-974d-00c002e55616 service nova] Acquiring lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:01:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f8a3e5ff-ef6c-4900-a2d6-056eed1ade4e req-5da1a3cb-ebe8-4b2e-974d-00c002e55616 service nova] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:01:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f8a3e5ff-ef6c-4900-a2d6-056eed1ade4e req-5da1a3cb-ebe8-4b2e-974d-00c002e55616 service nova] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:01:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-f8a3e5ff-ef6c-4900-a2d6-056eed1ade4e req-5da1a3cb-ebe8-4b2e-974d-00c002e55616 service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] No waiting events found dispatching network-vif-unplugged-4c1b906e-2c49-4642-9183-06292be46de4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:01:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-f8a3e5ff-ef6c-4900-a2d6-056eed1ade4e req-5da1a3cb-ebe8-4b2e-974d-00c002e55616 service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Received event network-vif-unplugged-4c1b906e-2c49-4642-9183-06292be46de4 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 09:01:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:17 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Instance destroyed successfully.
Aug 26 09:01:17 user nova-compute[73104]: DEBUG nova.objects.instance [None req-82059cde-41da-4716-81d3-8fe8358ee0fd tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lazy-loading 'resources' on Instance uuid 33048996-d559-4b3c-9de9-39bb176c3ec9 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:01:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-82059cde-41da-4716-81d3-8fe8358ee0fd tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:51:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1372648210',display_name='tempest-AttachVolumeTestJSON-server-1372648210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1372648210',id=28,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3ruAnm8wJOtkM5YpWf3zux9ipeTcCrtMwmPCNqS87cjfXmG7Jo5HHNQzK7O8JS5TTbG/bKm+6qFm/BZVW6gKLbnDGC/QXgHLRc1/aNdWcQz6PVhir0ZiiZKQ1S1B0vIg==',key_name='tempest-keypair-1147096816',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:51:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d101cd585e604a1881c981c946f70849',ramdisk_id='',reservation_id='r-hfyybj1j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-684994869',owner_user_name='tempest-AttachVolumeTestJSON-684994869-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:59:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4191d8a10ac54389b6b633701f6e6c77',uuid=33048996-d559-4b3c-9de9-39bb176c3ec9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c1b906e-2c49-4642-9183-06292be46de4", "address": "fa:16:3e:7e:7d:6c", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1b906e-2c", "ovs_interfaceid": "4c1b906e-2c49-4642-9183-06292be46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 09:01:17 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-82059cde-41da-4716-81d3-8fe8358ee0fd tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Converting VIF {"id": "4c1b906e-2c49-4642-9183-06292be46de4", "address": "fa:16:3e:7e:7d:6c", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1b906e-2c", "ovs_interfaceid": "4c1b906e-2c49-4642-9183-06292be46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:01:17 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-82059cde-41da-4716-81d3-8fe8358ee0fd tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7d:6c,bridge_name='br-int',has_traffic_filtering=True,id=4c1b906e-2c49-4642-9183-06292be46de4,network=Network(e6ddfc91-c02c-429c-90ff-aaad54b98cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1b906e-2c') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:01:17 user nova-compute[73104]: DEBUG os_vif [None req-82059cde-41da-4716-81d3-8fe8358ee0fd tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7d:6c,bridge_name='br-int',has_traffic_filtering=True,id=4c1b906e-2c49-4642-9183-06292be46de4,network=Network(e6ddfc91-c02c-429c-90ff-aaad54b98cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1b906e-2c') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 09:01:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c1b906e-2c, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:01:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:01:17 user nova-compute[73104]: INFO os_vif [None req-82059cde-41da-4716-81d3-8fe8358ee0fd tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7d:6c,bridge_name='br-int',has_traffic_filtering=True,id=4c1b906e-2c49-4642-9183-06292be46de4,network=Network(e6ddfc91-c02c-429c-90ff-aaad54b98cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1b906e-2c')
Aug 26 09:01:17 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-82059cde-41da-4716-81d3-8fe8358ee0fd tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Deleting instance files /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9_del
Aug 26 09:01:17 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-82059cde-41da-4716-81d3-8fe8358ee0fd tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Deletion of /opt/stack/data/nova/instances/33048996-d559-4b3c-9de9-39bb176c3ec9_del complete
Aug 26 09:01:17 user nova-compute[73104]: INFO nova.compute.manager [None req-82059cde-41da-4716-81d3-8fe8358ee0fd tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 26 09:01:17 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-82059cde-41da-4716-81d3-8fe8358ee0fd tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 09:01:17 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 09:01:17 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 09:01:18 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:01:18 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Took 0.95 seconds to deallocate network for instance.
Aug 26 09:01:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-82059cde-41da-4716-81d3-8fe8358ee0fd tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:01:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-82059cde-41da-4716-81d3-8fe8358ee0fd tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:01:18 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-82059cde-41da-4716-81d3-8fe8358ee0fd tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:01:18 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-82059cde-41da-4716-81d3-8fe8358ee0fd tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:01:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-82059cde-41da-4716-81d3-8fe8358ee0fd tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.222s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:01:18 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-82059cde-41da-4716-81d3-8fe8358ee0fd tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Deleted allocations for instance 33048996-d559-4b3c-9de9-39bb176c3ec9
Aug 26 09:01:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-82059cde-41da-4716-81d3-8fe8358ee0fd tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.268s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:01:18 user nova-compute[73104]: DEBUG nova.compute.manager [req-7f4efc4e-be60-423f-b03a-d88604175783 req-ab6f7eb7-84da-47fe-b7b3-aa85bf176b67 service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Received event network-vif-plugged-4c1b906e-2c49-4642-9183-06292be46de4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:01:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-7f4efc4e-be60-423f-b03a-d88604175783 req-ab6f7eb7-84da-47fe-b7b3-aa85bf176b67 service nova] Acquiring lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:01:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-7f4efc4e-be60-423f-b03a-d88604175783 req-ab6f7eb7-84da-47fe-b7b3-aa85bf176b67 service nova] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:01:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-7f4efc4e-be60-423f-b03a-d88604175783 req-ab6f7eb7-84da-47fe-b7b3-aa85bf176b67 service nova] Lock "33048996-d559-4b3c-9de9-39bb176c3ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:01:18 user nova-compute[73104]: DEBUG nova.compute.manager [req-7f4efc4e-be60-423f-b03a-d88604175783 req-ab6f7eb7-84da-47fe-b7b3-aa85bf176b67 service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] No waiting events found dispatching network-vif-plugged-4c1b906e-2c49-4642-9183-06292be46de4 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:01:18 user nova-compute[73104]: WARNING nova.compute.manager [req-7f4efc4e-be60-423f-b03a-d88604175783 req-ab6f7eb7-84da-47fe-b7b3-aa85bf176b67 service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Received unexpected event network-vif-plugged-4c1b906e-2c49-4642-9183-06292be46de4 for instance with vm_state deleted and task_state None.
Aug 26 09:01:18 user nova-compute[73104]: DEBUG nova.compute.manager [req-7f4efc4e-be60-423f-b03a-d88604175783 req-ab6f7eb7-84da-47fe-b7b3-aa85bf176b67 service nova] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Received event network-vif-deleted-4c1b906e-2c49-4642-9183-06292be46de4 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:01:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:21 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693040466.1116726, 0e3fb03a-d317-4eed-ad52-d066242a13e0 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:01:21 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] VM Stopped (Lifecycle Event)
Aug 26 09:01:21 user nova-compute[73104]: DEBUG nova.compute.manager [None req-4342e349-c29c-409c-aa24-b5d469fe7b87 None None] [instance: 0e3fb03a-d317-4eed-ad52-d066242a13e0] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:01:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:24 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693040469.7362566, f9cadc09-e4ec-4d5c-a22d-912e92c09cff => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:01:24 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] VM Stopped (Lifecycle Event)
Aug 26 09:01:24 user nova-compute[73104]: DEBUG nova.compute.manager [None req-79491141-58ce-4d9d-9551-5f173d950206 None None] [instance: f9cadc09-e4ec-4d5c-a22d-912e92c09cff] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:01:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12eb3027-9710-4891-9d4c-d3f429590563 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "b5e1f82c-5675-4c37-8ba2-44e6a341a576" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:01:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12eb3027-9710-4891-9d4c-d3f429590563 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "b5e1f82c-5675-4c37-8ba2-44e6a341a576" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:01:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12eb3027-9710-4891-9d4c-d3f429590563 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "b5e1f82c-5675-4c37-8ba2-44e6a341a576-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:01:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12eb3027-9710-4891-9d4c-d3f429590563 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "b5e1f82c-5675-4c37-8ba2-44e6a341a576-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:01:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12eb3027-9710-4891-9d4c-d3f429590563 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "b5e1f82c-5675-4c37-8ba2-44e6a341a576-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:01:29 user nova-compute[73104]: INFO nova.compute.manager [None req-12eb3027-9710-4891-9d4c-d3f429590563 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Terminating instance
Aug 26 09:01:29 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12eb3027-9710-4891-9d4c-d3f429590563 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 09:01:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:30 user nova-compute[73104]: DEBUG nova.compute.manager [req-d28202a2-960b-45fb-8d3d-f4d0dfcae296 req-1ada1105-78ca-4bf2-a501-7dabf8e4e7f6 service nova] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Received event network-vif-unplugged-3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:01:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d28202a2-960b-45fb-8d3d-f4d0dfcae296 req-1ada1105-78ca-4bf2-a501-7dabf8e4e7f6 service nova] Acquiring lock "b5e1f82c-5675-4c37-8ba2-44e6a341a576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:01:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d28202a2-960b-45fb-8d3d-f4d0dfcae296 req-1ada1105-78ca-4bf2-a501-7dabf8e4e7f6 service nova] Lock "b5e1f82c-5675-4c37-8ba2-44e6a341a576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:01:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d28202a2-960b-45fb-8d3d-f4d0dfcae296 req-1ada1105-78ca-4bf2-a501-7dabf8e4e7f6 service nova] Lock "b5e1f82c-5675-4c37-8ba2-44e6a341a576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:01:30 user nova-compute[73104]: DEBUG nova.compute.manager [req-d28202a2-960b-45fb-8d3d-f4d0dfcae296 req-1ada1105-78ca-4bf2-a501-7dabf8e4e7f6 service nova] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] No waiting events found dispatching network-vif-unplugged-3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:01:30 user nova-compute[73104]: DEBUG nova.compute.manager [req-d28202a2-960b-45fb-8d3d-f4d0dfcae296 req-1ada1105-78ca-4bf2-a501-7dabf8e4e7f6 service nova] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Received event network-vif-unplugged-3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 09:01:30 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Instance destroyed successfully.
Aug 26 09:01:30 user nova-compute[73104]: DEBUG nova.objects.instance [None req-12eb3027-9710-4891-9d4c-d3f429590563 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lazy-loading 'resources' on Instance uuid b5e1f82c-5675-4c37-8ba2-44e6a341a576 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:01:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-12eb3027-9710-4891-9d4c-d3f429590563 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:42:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-896235300',display_name='tempest-ServerActionsTestOtherA-server-896235300',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-896235300',id=17,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDd7CVbfrgJk+LANTVyASPXlTQ9/WFcC61mCbmrDUGOXT5afWNcplXvZ22xaA7blYJtw8QDJAtG8f1dybdt3ItZCTVqOwov6sASWzyNlxMeQebqYtQoQd/bQsWZ9J2R2Q==',key_name='tempest-keypair-923484929',keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:42:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='efb864c0a34541dca00c6dbbcea17319',ramdisk_id='',reservation_id='r-dutocx91',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1245661612',owner_user_name='tempest-ServerActionsTestOtherA-1245661612-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:42:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='257343af54bd42b591e8874ef4ecf8dc',uuid=b5e1f82c-5675-4c37-8ba2-44e6a341a576,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96", "address": "fa:16:3e:c0:56:86", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3913bdf7-1f", "ovs_interfaceid": "3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 09:01:30 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-12eb3027-9710-4891-9d4c-d3f429590563 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Converting VIF {"id": "3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96", "address": "fa:16:3e:c0:56:86", "network": {"id": "2edcedef-6090-4f79-a2f0-5875a9916a61", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1986549533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb864c0a34541dca00c6dbbcea17319", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3913bdf7-1f", "ovs_interfaceid": "3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:01:30 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-12eb3027-9710-4891-9d4c-d3f429590563 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:56:86,bridge_name='br-int',has_traffic_filtering=True,id=3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3913bdf7-1f') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:01:30 user nova-compute[73104]: DEBUG os_vif [None req-12eb3027-9710-4891-9d4c-d3f429590563 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:56:86,bridge_name='br-int',has_traffic_filtering=True,id=3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3913bdf7-1f') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 09:01:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3913bdf7-1f, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:01:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:01:30 user nova-compute[73104]: INFO os_vif [None req-12eb3027-9710-4891-9d4c-d3f429590563 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:56:86,bridge_name='br-int',has_traffic_filtering=True,id=3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96,network=Network(2edcedef-6090-4f79-a2f0-5875a9916a61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3913bdf7-1f')
Aug 26 09:01:30 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-12eb3027-9710-4891-9d4c-d3f429590563 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Deleting instance files /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576_del
Aug 26 09:01:30 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-12eb3027-9710-4891-9d4c-d3f429590563 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Deletion of /opt/stack/data/nova/instances/b5e1f82c-5675-4c37-8ba2-44e6a341a576_del complete
Aug 26 09:01:30 user nova-compute[73104]: INFO nova.compute.manager [None req-12eb3027-9710-4891-9d4c-d3f429590563 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Took 0.71 seconds to destroy the instance on the hypervisor.
Aug 26 09:01:30 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-12eb3027-9710-4891-9d4c-d3f429590563 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 09:01:30 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 09:01:30 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 09:01:31 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:01:31 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Took 0.51 seconds to deallocate network for instance.
Aug 26 09:01:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12eb3027-9710-4891-9d4c-d3f429590563 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:01:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12eb3027-9710-4891-9d4c-d3f429590563 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:01:31 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12eb3027-9710-4891-9d4c-d3f429590563 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:01:31 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12eb3027-9710-4891-9d4c-d3f429590563 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:01:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12eb3027-9710-4891-9d4c-d3f429590563 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:01:31 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-12eb3027-9710-4891-9d4c-d3f429590563 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Deleted allocations for instance b5e1f82c-5675-4c37-8ba2-44e6a341a576
Aug 26 09:01:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12eb3027-9710-4891-9d4c-d3f429590563 tempest-ServerActionsTestOtherA-1245661612 tempest-ServerActionsTestOtherA-1245661612-project-member] Lock "b5e1f82c-5675-4c37-8ba2-44e6a341a576" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.567s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:01:32 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693040477.0138836, 33048996-d559-4b3c-9de9-39bb176c3ec9 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:01:32 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] VM Stopped (Lifecycle Event)
Aug 26 09:01:32 user nova-compute[73104]: DEBUG nova.compute.manager [None req-d47f531d-04b6-4aa4-a238-43470353ed3f None None] [instance: 33048996-d559-4b3c-9de9-39bb176c3ec9] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:01:32 user nova-compute[73104]: DEBUG nova.compute.manager [req-c63ff16f-483b-47ff-934b-e719ff587074 req-1d72812b-6acf-45e8-b311-b1497a4cef6b service nova] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Received event network-vif-plugged-3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:01:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c63ff16f-483b-47ff-934b-e719ff587074 req-1d72812b-6acf-45e8-b311-b1497a4cef6b service nova] Acquiring lock "b5e1f82c-5675-4c37-8ba2-44e6a341a576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:01:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c63ff16f-483b-47ff-934b-e719ff587074 req-1d72812b-6acf-45e8-b311-b1497a4cef6b service nova] Lock "b5e1f82c-5675-4c37-8ba2-44e6a341a576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:01:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c63ff16f-483b-47ff-934b-e719ff587074 req-1d72812b-6acf-45e8-b311-b1497a4cef6b service nova] Lock "b5e1f82c-5675-4c37-8ba2-44e6a341a576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:01:32 user nova-compute[73104]: DEBUG nova.compute.manager [req-c63ff16f-483b-47ff-934b-e719ff587074 req-1d72812b-6acf-45e8-b311-b1497a4cef6b service nova] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] No waiting events found dispatching network-vif-plugged-3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:01:32 user nova-compute[73104]: WARNING nova.compute.manager [req-c63ff16f-483b-47ff-934b-e719ff587074 req-1d72812b-6acf-45e8-b311-b1497a4cef6b service nova] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Received unexpected event network-vif-plugged-3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96 for instance with vm_state deleted and task_state None.
Aug 26 09:01:32 user nova-compute[73104]: DEBUG nova.compute.manager [req-c63ff16f-483b-47ff-934b-e719ff587074 req-1d72812b-6acf-45e8-b311-b1497a4cef6b service nova] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Received event network-vif-deleted-3913bdf7-1f45-4fc6-a4bf-4eaae6d85e96 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:01:35 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:01:45 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693040490.4172363, b5e1f82c-5675-4c37-8ba2-44e6a341a576 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:01:45 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] VM Stopped (Lifecycle Event)
Aug 26 09:01:45 user nova-compute[73104]: DEBUG nova.compute.manager [None req-97c7c8ca-c585-4b6e-9429-324a93a95c82 None None] [instance: b5e1f82c-5675-4c37-8ba2-44e6a341a576] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:01:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:01:50 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b72046f4-f579-481a-b354-6f7474c0b240 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "bf35aa10-80b1-4518-88b3-63c6a11e626b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:01:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b72046f4-f579-481a-b354-6f7474c0b240 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "bf35aa10-80b1-4518-88b3-63c6a11e626b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:01:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b72046f4-f579-481a-b354-6f7474c0b240 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "bf35aa10-80b1-4518-88b3-63c6a11e626b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:01:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b72046f4-f579-481a-b354-6f7474c0b240 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "bf35aa10-80b1-4518-88b3-63c6a11e626b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:01:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b72046f4-f579-481a-b354-6f7474c0b240 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "bf35aa10-80b1-4518-88b3-63c6a11e626b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:01:56 user nova-compute[73104]: INFO nova.compute.manager [None req-b72046f4-f579-481a-b354-6f7474c0b240 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Terminating instance
Aug 26 09:01:56 user nova-compute[73104]: DEBUG nova.compute.manager [None req-b72046f4-f579-481a-b354-6f7474c0b240 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 09:01:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:56 user nova-compute[73104]: DEBUG nova.compute.manager [req-a3c7cbde-3c22-44d7-9f96-0de5e4e91c06 req-1af9a849-eed3-4bd5-8614-06ae032aa46e service nova] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Received event network-vif-unplugged-ba4dd86b-d62a-48be-89c7-d63a6013a1ef {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:01:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a3c7cbde-3c22-44d7-9f96-0de5e4e91c06 req-1af9a849-eed3-4bd5-8614-06ae032aa46e service nova] Acquiring lock "bf35aa10-80b1-4518-88b3-63c6a11e626b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:01:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a3c7cbde-3c22-44d7-9f96-0de5e4e91c06 req-1af9a849-eed3-4bd5-8614-06ae032aa46e service nova] Lock "bf35aa10-80b1-4518-88b3-63c6a11e626b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:01:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a3c7cbde-3c22-44d7-9f96-0de5e4e91c06 req-1af9a849-eed3-4bd5-8614-06ae032aa46e service nova] Lock "bf35aa10-80b1-4518-88b3-63c6a11e626b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:01:56 user nova-compute[73104]: DEBUG nova.compute.manager [req-a3c7cbde-3c22-44d7-9f96-0de5e4e91c06 req-1af9a849-eed3-4bd5-8614-06ae032aa46e service nova] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] No waiting events found dispatching network-vif-unplugged-ba4dd86b-d62a-48be-89c7-d63a6013a1ef {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:01:56 user nova-compute[73104]: DEBUG nova.compute.manager [req-a3c7cbde-3c22-44d7-9f96-0de5e4e91c06 req-1af9a849-eed3-4bd5-8614-06ae032aa46e service nova] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Received event network-vif-unplugged-ba4dd86b-d62a-48be-89c7-d63a6013a1ef for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 09:01:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:56 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Instance destroyed successfully.
Aug 26 09:01:56 user nova-compute[73104]: DEBUG nova.objects.instance [None req-b72046f4-f579-481a-b354-6f7474c0b240 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lazy-loading 'resources' on Instance uuid bf35aa10-80b1-4518-88b3-63c6a11e626b {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:01:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-b72046f4-f579-481a-b354-6f7474c0b240 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-757348124',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-757348124',id=30,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:52:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a37356203d547c2abf0aa634c2ad548',ramdisk_id='',reservation_id='r-nwqltj8v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1111216102',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:54:30Z,user_data=None,user_id='bcd11beb7046440f814cbf4a13ab0272',uuid=bf35aa10-80b1-4518-88b3-63c6a11e626b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba4dd86b-d62a-48be-89c7-d63a6013a1ef", "address": "fa:16:3e:bc:d7:ff", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4dd86b-d6", "ovs_interfaceid": "ba4dd86b-d62a-48be-89c7-d63a6013a1ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 09:01:56 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-b72046f4-f579-481a-b354-6f7474c0b240 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Converting VIF {"id": "ba4dd86b-d62a-48be-89c7-d63a6013a1ef", "address": "fa:16:3e:bc:d7:ff", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4dd86b-d6", "ovs_interfaceid": "ba4dd86b-d62a-48be-89c7-d63a6013a1ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:01:56 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-b72046f4-f579-481a-b354-6f7474c0b240 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:d7:ff,bridge_name='br-int',has_traffic_filtering=True,id=ba4dd86b-d62a-48be-89c7-d63a6013a1ef,network=Network(ce0a529c-2119-4b2a-a08f-567e3671c3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4dd86b-d6') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:01:56 user nova-compute[73104]: DEBUG os_vif [None req-b72046f4-f579-481a-b354-6f7474c0b240 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:d7:ff,bridge_name='br-int',has_traffic_filtering=True,id=ba4dd86b-d62a-48be-89c7-d63a6013a1ef,network=Network(ce0a529c-2119-4b2a-a08f-567e3671c3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4dd86b-d6') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 09:01:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba4dd86b-d6, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:01:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:01:56 user nova-compute[73104]: INFO os_vif [None req-b72046f4-f579-481a-b354-6f7474c0b240 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:d7:ff,bridge_name='br-int',has_traffic_filtering=True,id=ba4dd86b-d62a-48be-89c7-d63a6013a1ef,network=Network(ce0a529c-2119-4b2a-a08f-567e3671c3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4dd86b-d6')
Aug 26 09:01:56 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-b72046f4-f579-481a-b354-6f7474c0b240 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Deleting instance files /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b_del
Aug 26 09:01:56 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-b72046f4-f579-481a-b354-6f7474c0b240 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Deletion of /opt/stack/data/nova/instances/bf35aa10-80b1-4518-88b3-63c6a11e626b_del complete
Aug 26 09:01:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:56 user nova-compute[73104]: INFO nova.compute.manager [None req-b72046f4-f579-481a-b354-6f7474c0b240 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Took 0.79 seconds to destroy the instance on the hypervisor.
Aug 26 09:01:56 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-b72046f4-f579-481a-b354-6f7474c0b240 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 09:01:56 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 09:01:56 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 09:01:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:01:57 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:01:57 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Took 0.52 seconds to deallocate network for instance.
Aug 26 09:01:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b72046f4-f579-481a-b354-6f7474c0b240 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:01:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b72046f4-f579-481a-b354-6f7474c0b240 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:01:57 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-b72046f4-f579-481a-b354-6f7474c0b240 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:01:57 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-b72046f4-f579-481a-b354-6f7474c0b240 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:01:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b72046f4-f579-481a-b354-6f7474c0b240 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.162s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:01:57 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-b72046f4-f579-481a-b354-6f7474c0b240 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Deleted allocations for instance bf35aa10-80b1-4518-88b3-63c6a11e626b
Aug 26 09:01:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b72046f4-f579-481a-b354-6f7474c0b240 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "bf35aa10-80b1-4518-88b3-63c6a11e626b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.723s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:01:58 user nova-compute[73104]: DEBUG nova.compute.manager [req-3914e665-dfc5-42fe-b1c3-e4795cf7e079 req-ade3e10e-5747-4530-9c81-5123c3e42240 service nova] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Received event network-vif-plugged-ba4dd86b-d62a-48be-89c7-d63a6013a1ef {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:01:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3914e665-dfc5-42fe-b1c3-e4795cf7e079 req-ade3e10e-5747-4530-9c81-5123c3e42240 service nova] Acquiring lock "bf35aa10-80b1-4518-88b3-63c6a11e626b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:01:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3914e665-dfc5-42fe-b1c3-e4795cf7e079 req-ade3e10e-5747-4530-9c81-5123c3e42240 service nova] Lock "bf35aa10-80b1-4518-88b3-63c6a11e626b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:01:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3914e665-dfc5-42fe-b1c3-e4795cf7e079 req-ade3e10e-5747-4530-9c81-5123c3e42240 service nova] Lock "bf35aa10-80b1-4518-88b3-63c6a11e626b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:01:58 user nova-compute[73104]: DEBUG nova.compute.manager [req-3914e665-dfc5-42fe-b1c3-e4795cf7e079 req-ade3e10e-5747-4530-9c81-5123c3e42240 service nova] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] No waiting events found dispatching network-vif-plugged-ba4dd86b-d62a-48be-89c7-d63a6013a1ef {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:01:58 user nova-compute[73104]: WARNING nova.compute.manager [req-3914e665-dfc5-42fe-b1c3-e4795cf7e079 req-ade3e10e-5747-4530-9c81-5123c3e42240 service nova] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Received unexpected event network-vif-plugged-ba4dd86b-d62a-48be-89c7-d63a6013a1ef for instance with vm_state deleted and task_state None.
Aug 26 09:01:58 user nova-compute[73104]: DEBUG nova.compute.manager [req-3914e665-dfc5-42fe-b1c3-e4795cf7e079 req-ade3e10e-5747-4530-9c81-5123c3e42240 service nova] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Received event network-vif-deleted-ba4dd86b-d62a-48be-89c7-d63a6013a1ef {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:02:01 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:03 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:02:03 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:02:04 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:02:04 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:02:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "56e8f70f-f077-41a7-9cbd-749c40ec0a23" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "56e8f70f-f077-41a7-9cbd-749c40ec0a23" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:05 user nova-compute[73104]: DEBUG nova.compute.manager [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 09:02:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 09:02:06 user nova-compute[73104]: INFO nova.compute.claims [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Claim successful on node user
Aug 26 09:02:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:06 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:02:06 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:02:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:06 user nova-compute[73104]: DEBUG nova.compute.manager [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 09:02:06 user nova-compute[73104]: DEBUG nova.compute.manager [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 09:02:06 user nova-compute[73104]: DEBUG nova.network.neutron [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 09:02:06 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 09:02:06 user nova-compute[73104]: DEBUG nova.compute.manager [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 09:02:06 user nova-compute[73104]: INFO nova.virt.block_device [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Booting with volume 2bb579eb-a354-482f-93fd-8a500f30d57e at /dev/vda
Aug 26 09:02:06 user nova-compute[73104]: DEBUG nova.policy [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bae03c9c8a9a40b2af6bd1fefb3561d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52518aa77344432385cfc2b73c63aebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 09:02:06 user nova-compute[73104]: DEBUG os_brick.utils [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:02:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:06 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eaeef86-bbed-44e1-ac32-d182a24c06d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:02:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:06 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb14e25-c063-4a20-b9ab-c29fa474cc88]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:02:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:06 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdfb6e2-8b91-467f-a89b-6710160b60ab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:02:06 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6f3788-2e13-494a-864d-99ec06cd14f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:02:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:02:06 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 09:02:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:02:06 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 09:02:06 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b9dcd9-f6f7-4580-976b-f21a75d426b7]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:02:06 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 09:02:06 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 09:02:06 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 09:02:06 user nova-compute[73104]: DEBUG os_brick.utils [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:02:06 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Updating existing volume attachment record: b9247081-8fec-4475-8aae-5a031d827945 {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 09:02:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:07 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:02:07 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:02:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:07 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:02:07 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 09:02:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:07 user nova-compute[73104]: DEBUG nova.network.neutron [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Successfully created port: 7dbed8ca-ccd9-491a-9abe-c0a71f17e2af {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 09:02:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:08 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:02:08 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:02:08 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8593MB free_disk=24.124717712402344GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:02:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:08 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 3cf85d2f-de0d-4e9b-a534-98c799ae8db9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:02:08 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance bef1e493-6b2c-4688-98c2-647261feb571 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:02:08 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 56e8f70f-f077-41a7-9cbd-749c40ec0a23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:02:08 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:02:08 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:02:08 user nova-compute[73104]: DEBUG nova.network.neutron [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Successfully updated port: 7dbed8ca-ccd9-491a-9abe-c0a71f17e2af {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 09:02:08 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:02:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "refresh_cache-56e8f70f-f077-41a7-9cbd-749c40ec0a23" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:02:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquired lock "refresh_cache-56e8f70f-f077-41a7-9cbd-749c40ec0a23" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:02:08 user nova-compute[73104]: DEBUG nova.network.neutron [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 09:02:08 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:02:08 user nova-compute[73104]: DEBUG nova.compute.manager [req-76a88681-2ee6-4efb-b651-0881e59c9407 req-1c7fcef7-a923-450a-9f80-b763091fa001 service nova] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Received event network-changed-7dbed8ca-ccd9-491a-9abe-c0a71f17e2af {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:02:08 user nova-compute[73104]: DEBUG nova.compute.manager [req-76a88681-2ee6-4efb-b651-0881e59c9407 req-1c7fcef7-a923-450a-9f80-b763091fa001 service nova] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Refreshing instance network info cache due to event network-changed-7dbed8ca-ccd9-491a-9abe-c0a71f17e2af. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:02:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-76a88681-2ee6-4efb-b651-0881e59c9407 req-1c7fcef7-a923-450a-9f80-b763091fa001 service nova] Acquiring lock "refresh_cache-56e8f70f-f077-41a7-9cbd-749c40ec0a23" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:02:08 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:02:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:08 user nova-compute[73104]: DEBUG nova.network.neutron [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 09:02:08 user nova-compute[73104]: DEBUG nova.network.neutron [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Updating instance_info_cache with network_info: [{"id": "7dbed8ca-ccd9-491a-9abe-c0a71f17e2af", "address": "fa:16:3e:6a:35:ce", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dbed8ca-cc", "ovs_interfaceid": "7dbed8ca-ccd9-491a-9abe-c0a71f17e2af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:02:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Releasing lock "refresh_cache-56e8f70f-f077-41a7-9cbd-749c40ec0a23" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:02:09 user nova-compute[73104]: DEBUG nova.compute.manager [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Instance network_info: |[{"id": "7dbed8ca-ccd9-491a-9abe-c0a71f17e2af", "address": "fa:16:3e:6a:35:ce", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dbed8ca-cc", "ovs_interfaceid": "7dbed8ca-ccd9-491a-9abe-c0a71f17e2af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 09:02:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-76a88681-2ee6-4efb-b651-0881e59c9407 req-1c7fcef7-a923-450a-9f80-b763091fa001 service nova] Acquired lock "refresh_cache-56e8f70f-f077-41a7-9cbd-749c40ec0a23" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:02:09 user nova-compute[73104]: DEBUG nova.network.neutron [req-76a88681-2ee6-4efb-b651-0881e59c9407 req-1c7fcef7-a923-450a-9f80-b763091fa001 service nova] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Refreshing network info cache for port 7dbed8ca-ccd9-491a-9abe-c0a71f17e2af {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:02:09 user nova-compute[73104]: DEBUG nova.network.neutron [req-76a88681-2ee6-4efb-b651-0881e59c9407 req-1c7fcef7-a923-450a-9f80-b763091fa001 service nova] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Updated VIF entry in instance network info cache for port 7dbed8ca-ccd9-491a-9abe-c0a71f17e2af. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:02:09 user nova-compute[73104]: DEBUG nova.network.neutron [req-76a88681-2ee6-4efb-b651-0881e59c9407 req-1c7fcef7-a923-450a-9f80-b763091fa001 service nova] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Updating instance_info_cache with network_info: [{"id": "7dbed8ca-ccd9-491a-9abe-c0a71f17e2af", "address": "fa:16:3e:6a:35:ce", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dbed8ca-cc", "ovs_interfaceid": "7dbed8ca-ccd9-491a-9abe-c0a71f17e2af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:02:09 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:02:09 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:02:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-76a88681-2ee6-4efb-b651-0881e59c9407 req-1c7fcef7-a923-450a-9f80-b763091fa001 service nova] Releasing lock "refresh_cache-56e8f70f-f077-41a7-9cbd-749c40ec0a23" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:02:10 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:02:10 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:02:10 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Rebuilding the list of instances to heal {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 09:02:10 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Skipping network cache update for instance because it is Building. {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 26 09:02:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-3cf85d2f-de0d-4e9b-a534-98c799ae8db9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:02:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-3cf85d2f-de0d-4e9b-a534-98c799ae8db9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:02:10 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 09:02:10 user nova-compute[73104]: DEBUG nova.objects.instance [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lazy-loading 'info_cache' on Instance uuid 3cf85d2f-de0d-4e9b-a534-98c799ae8db9 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:02:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:10 user nova-compute[73104]: DEBUG nova.compute.manager [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 09:02:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 09:02:10 user nova-compute[73104]: INFO nova.compute.claims [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Claim successful on node user
Aug 26 09:02:11 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:02:11 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Updating instance_info_cache with network_info: [{"id": "1ff011d7-db1c-4bac-a2d3-ecf253085265", "address": "fa:16:3e:72:e3:65", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff011d7-db", "ovs_interfaceid": "1ff011d7-db1c-4bac-a2d3-ecf253085265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:02:11 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:02:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-3cf85d2f-de0d-4e9b-a534-98c799ae8db9" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:02:11 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 09:02:11 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:02:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.266s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:11 user nova-compute[73104]: DEBUG nova.compute.manager [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 09:02:11 user nova-compute[73104]: DEBUG nova.compute.manager [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 09:02:11 user nova-compute[73104]: DEBUG nova.network.neutron [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 09:02:11 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 09:02:11 user nova-compute[73104]: DEBUG nova.compute.manager [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 09:02:11 user nova-compute[73104]: DEBUG nova.policy [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4191d8a10ac54389b6b633701f6e6c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd101cd585e604a1881c981c946f70849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 09:02:11 user nova-compute[73104]: DEBUG nova.compute.manager [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 09:02:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 09:02:11 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Creating image(s)
Aug 26 09:02:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "/opt/stack/data/nova/instances/e259e21c-3a8b-4ffd-880d-1fb29a2ef64f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "/opt/stack/data/nova/instances/e259e21c-3a8b-4ffd-880d-1fb29a2ef64f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "/opt/stack/data/nova/instances/e259e21c-3a8b-4ffd-880d-1fb29a2ef64f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.194s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.174s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/e259e21c-3a8b-4ffd-880d-1fb29a2ef64f/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:11 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693040516.7771842, bf35aa10-80b1-4518-88b3-63c6a11e626b => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:02:11 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] VM Stopped (Lifecycle Event)
Aug 26 09:02:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/e259e21c-3a8b-4ffd-880d-1fb29a2ef64f/disk 1073741824" returned: 0 in 0.054s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:11 user nova-compute[73104]: DEBUG nova.compute.manager [None req-74cf4684-e51a-49ab-94bf-57baf5e3ba40 None None] [instance: bf35aa10-80b1-4518-88b3-63c6a11e626b] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:02:12 user nova-compute[73104]: DEBUG nova.network.neutron [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Successfully created port: ffb99eae-6874-4496-9694-5f2aaae75465 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 09:02:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.194s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:12 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e259e21c-3a8b-4ffd-880d-1fb29a2ef64f/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 09:02:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e259e21c-3a8b-4ffd-880d-1fb29a2ef64f/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e259e21c-3a8b-4ffd-880d-1fb29a2ef64f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:12 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Cannot resize image /opt/stack/data/nova/instances/e259e21c-3a8b-4ffd-880d-1fb29a2ef64f/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 09:02:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 09:02:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Ensure instance console log exists: /opt/stack/data/nova/instances/e259e21c-3a8b-4ffd-880d-1fb29a2ef64f/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 09:02:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:12 user nova-compute[73104]: DEBUG nova.network.neutron [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Successfully updated port: ffb99eae-6874-4496-9694-5f2aaae75465 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 09:02:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "refresh_cache-e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:02:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquired lock "refresh_cache-e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:02:12 user nova-compute[73104]: DEBUG nova.network.neutron [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 09:02:12 user nova-compute[73104]: DEBUG nova.compute.manager [req-a25f931e-5c9e-4544-9257-ac89ed0f97a4 req-54733514-db3c-4f4c-a22f-b0121a2487ea service nova] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Received event network-changed-ffb99eae-6874-4496-9694-5f2aaae75465 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:02:12 user nova-compute[73104]: DEBUG nova.compute.manager [req-a25f931e-5c9e-4544-9257-ac89ed0f97a4 req-54733514-db3c-4f4c-a22f-b0121a2487ea service nova] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Refreshing instance network info cache due to event network-changed-ffb99eae-6874-4496-9694-5f2aaae75465. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:02:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a25f931e-5c9e-4544-9257-ac89ed0f97a4 req-54733514-db3c-4f4c-a22f-b0121a2487ea service nova] Acquiring lock "refresh_cache-e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:02:12 user nova-compute[73104]: DEBUG nova.network.neutron [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 09:02:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG nova.network.neutron [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Updating instance_info_cache with network_info: [{"id": "ffb99eae-6874-4496-9694-5f2aaae75465", "address": "fa:16:3e:a8:fd:bc", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb99eae-68", "ovs_interfaceid": "ffb99eae-6874-4496-9694-5f2aaae75465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Releasing lock "refresh_cache-e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG nova.compute.manager [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Instance network_info: |[{"id": "ffb99eae-6874-4496-9694-5f2aaae75465", "address": "fa:16:3e:a8:fd:bc", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb99eae-68", "ovs_interfaceid": "ffb99eae-6874-4496-9694-5f2aaae75465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a25f931e-5c9e-4544-9257-ac89ed0f97a4 req-54733514-db3c-4f4c-a22f-b0121a2487ea service nova] Acquired lock "refresh_cache-e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG nova.network.neutron [req-a25f931e-5c9e-4544-9257-ac89ed0f97a4 req-54733514-db3c-4f4c-a22f-b0121a2487ea service nova] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Refreshing network info cache for port ffb99eae-6874-4496-9694-5f2aaae75465 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Start _get_guest_xml network_info=[{"id": "ffb99eae-6874-4496-9694-5f2aaae75465", "address": "fa:16:3e:a8:fd:bc", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb99eae-68", "ovs_interfaceid": "ffb99eae-6874-4496-9694-5f2aaae75465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 09:02:13 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:02:13 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:02:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:02:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1113605941',display_name='tempest-AttachVolumeTestJSON-server-1113605941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1113605941',id=39,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHX2rVCUcsMK21h7FAxOfZZ8BaADgRr5T9eZA9Oiveg8YQT/AgIiOKXqdQZSN6RZy9xQqv7Chej6soWaGTL+fc5qP+cvZrw4H82o8hrdNvB+5aaElpVHnHyhngdsTd/hPQ==',key_name='tempest-keypair-259052926',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d101cd585e604a1881c981c946f70849',ramdisk_id='',reservation_id='r-qgesbccd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-684994869',owner_user_name='tempest-AttachVolumeTestJSON-684994869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:02:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4191d8a10ac54389b6b633701f6e6c77',uuid=e259e21c-3a8b-4ffd-880d-1fb29a2ef64f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffb99eae-6874-4496-9694-5f2aaae75465", "address": "fa:16:3e:a8:fd:bc", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb99eae-68", "ovs_interfaceid": "ffb99eae-6874-4496-9694-5f2aaae75465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Converting VIF {"id": "ffb99eae-6874-4496-9694-5f2aaae75465", "address": "fa:16:3e:a8:fd:bc", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb99eae-68", "ovs_interfaceid": "ffb99eae-6874-4496-9694-5f2aaae75465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:fd:bc,bridge_name='br-int',has_traffic_filtering=True,id=ffb99eae-6874-4496-9694-5f2aaae75465,network=Network(e6ddfc91-c02c-429c-90ff-aaad54b98cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb99eae-68') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG nova.objects.instance [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lazy-loading 'pci_devices' on Instance uuid e259e21c-3a8b-4ffd-880d-1fb29a2ef64f {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] End _get_guest_xml xml=<domain type="kvm">
Aug 26 09:02:13 user nova-compute[73104]:   <uuid>e259e21c-3a8b-4ffd-880d-1fb29a2ef64f</uuid>
Aug 26 09:02:13 user nova-compute[73104]:   <name>instance-00000027</name>
Aug 26 09:02:13 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 09:02:13 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 09:02:13 user nova-compute[73104]:   <metadata>
Aug 26 09:02:13 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 09:02:13 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 09:02:13 user nova-compute[73104]:       <nova:name>tempest-AttachVolumeTestJSON-server-1113605941</nova:name>
Aug 26 09:02:13 user nova-compute[73104]:       <nova:creationTime>2023-08-26 09:02:13</nova:creationTime>
Aug 26 09:02:13 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 09:02:13 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 09:02:13 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 09:02:13 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 09:02:13 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 09:02:13 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 09:02:13 user nova-compute[73104]:       </nova:flavor>
Aug 26 09:02:13 user nova-compute[73104]:       <nova:owner>
Aug 26 09:02:13 user nova-compute[73104]:         <nova:user uuid="4191d8a10ac54389b6b633701f6e6c77">tempest-AttachVolumeTestJSON-684994869-project-member</nova:user>
Aug 26 09:02:13 user nova-compute[73104]:         <nova:project uuid="d101cd585e604a1881c981c946f70849">tempest-AttachVolumeTestJSON-684994869</nova:project>
Aug 26 09:02:13 user nova-compute[73104]:       </nova:owner>
Aug 26 09:02:13 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 09:02:13 user nova-compute[73104]:       <nova:ports>
Aug 26 09:02:13 user nova-compute[73104]:         <nova:port uuid="ffb99eae-6874-4496-9694-5f2aaae75465">
Aug 26 09:02:13 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 09:02:13 user nova-compute[73104]:         </nova:port>
Aug 26 09:02:13 user nova-compute[73104]:       </nova:ports>
Aug 26 09:02:13 user nova-compute[73104]:     </nova:instance>
Aug 26 09:02:13 user nova-compute[73104]:   </metadata>
Aug 26 09:02:13 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 09:02:13 user nova-compute[73104]:     <system>
Aug 26 09:02:13 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 09:02:13 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 09:02:13 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 09:02:13 user nova-compute[73104]:       <entry name="serial">e259e21c-3a8b-4ffd-880d-1fb29a2ef64f</entry>
Aug 26 09:02:13 user nova-compute[73104]:       <entry name="uuid">e259e21c-3a8b-4ffd-880d-1fb29a2ef64f</entry>
Aug 26 09:02:13 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 09:02:13 user nova-compute[73104]:     </system>
Aug 26 09:02:13 user nova-compute[73104]:   </sysinfo>
Aug 26 09:02:13 user nova-compute[73104]:   <os>
Aug 26 09:02:13 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 09:02:13 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 09:02:13 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 09:02:13 user nova-compute[73104]:   </os>
Aug 26 09:02:13 user nova-compute[73104]:   <features>
Aug 26 09:02:13 user nova-compute[73104]:     <acpi/>
Aug 26 09:02:13 user nova-compute[73104]:     <apic/>
Aug 26 09:02:13 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 09:02:13 user nova-compute[73104]:   </features>
Aug 26 09:02:13 user nova-compute[73104]:   <clock offset="utc">
Aug 26 09:02:13 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 09:02:13 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 09:02:13 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 09:02:13 user nova-compute[73104]:   </clock>
Aug 26 09:02:13 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 09:02:13 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 09:02:13 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 09:02:13 user nova-compute[73104]:   </cpu>
Aug 26 09:02:13 user nova-compute[73104]:   <devices>
Aug 26 09:02:13 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 09:02:13 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 09:02:13 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/e259e21c-3a8b-4ffd-880d-1fb29a2ef64f/disk"/>
Aug 26 09:02:13 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 09:02:13 user nova-compute[73104]:     </disk>
Aug 26 09:02:13 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 09:02:13 user nova-compute[73104]:       <mac address="fa:16:3e:a8:fd:bc"/>
Aug 26 09:02:13 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:02:13 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 09:02:13 user nova-compute[73104]:       <target dev="tapffb99eae-68"/>
Aug 26 09:02:13 user nova-compute[73104]:     </interface>
Aug 26 09:02:13 user nova-compute[73104]:     <serial type="pty">
Aug 26 09:02:13 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/e259e21c-3a8b-4ffd-880d-1fb29a2ef64f/console.log" append="off"/>
Aug 26 09:02:13 user nova-compute[73104]:     </serial>
Aug 26 09:02:13 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 09:02:13 user nova-compute[73104]:     <video>
Aug 26 09:02:13 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:02:13 user nova-compute[73104]:     </video>
Aug 26 09:02:13 user nova-compute[73104]:     <rng model="virtio">
Aug 26 09:02:13 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 09:02:13 user nova-compute[73104]:     </rng>
Aug 26 09:02:13 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 09:02:13 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 09:02:13 user nova-compute[73104]:       <stats period="10"/>
Aug 26 09:02:13 user nova-compute[73104]:     </memballoon>
Aug 26 09:02:13 user nova-compute[73104]:   </devices>
Aug 26 09:02:13 user nova-compute[73104]: </domain>
Aug 26 09:02:13 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:02:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1113605941',display_name='tempest-AttachVolumeTestJSON-server-1113605941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1113605941',id=39,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHX2rVCUcsMK21h7FAxOfZZ8BaADgRr5T9eZA9Oiveg8YQT/AgIiOKXqdQZSN6RZy9xQqv7Chej6soWaGTL+fc5qP+cvZrw4H82o8hrdNvB+5aaElpVHnHyhngdsTd/hPQ==',key_name='tempest-keypair-259052926',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d101cd585e604a1881c981c946f70849',ramdisk_id='',reservation_id='r-qgesbccd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-684994869',owner_user_name='tempest-AttachVolumeTestJSON-684994869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:02:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4191d8a10ac54389b6b633701f6e6c77',uuid=e259e21c-3a8b-4ffd-880d-1fb29a2ef64f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffb99eae-6874-4496-9694-5f2aaae75465", "address": "fa:16:3e:a8:fd:bc", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb99eae-68", "ovs_interfaceid": "ffb99eae-6874-4496-9694-5f2aaae75465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Converting VIF {"id": "ffb99eae-6874-4496-9694-5f2aaae75465", "address": "fa:16:3e:a8:fd:bc", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb99eae-68", "ovs_interfaceid": "ffb99eae-6874-4496-9694-5f2aaae75465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:fd:bc,bridge_name='br-int',has_traffic_filtering=True,id=ffb99eae-6874-4496-9694-5f2aaae75465,network=Network(e6ddfc91-c02c-429c-90ff-aaad54b98cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb99eae-68') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG os_vif [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:fd:bc,bridge_name='br-int',has_traffic_filtering=True,id=ffb99eae-6874-4496-9694-5f2aaae75465,network=Network(e6ddfc91-c02c-429c-90ff-aaad54b98cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb99eae-68') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapffb99eae-68, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapffb99eae-68, col_values=(('external_ids', {'iface-id': 'ffb99eae-6874-4496-9694-5f2aaae75465', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:fd:bc', 'vm-uuid': 'e259e21c-3a8b-4ffd-880d-1fb29a2ef64f'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:13 user nova-compute[73104]: INFO os_vif [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:fd:bc,bridge_name='br-int',has_traffic_filtering=True,id=ffb99eae-6874-4496-9694-5f2aaae75465,network=Network(e6ddfc91-c02c-429c-90ff-aaad54b98cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb99eae-68')
Aug 26 09:02:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] No VIF found with MAC fa:16:3e:a8:fd:bc, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG nova.network.neutron [req-a25f931e-5c9e-4544-9257-ac89ed0f97a4 req-54733514-db3c-4f4c-a22f-b0121a2487ea service nova] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Updated VIF entry in instance network info cache for port ffb99eae-6874-4496-9694-5f2aaae75465. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG nova.network.neutron [req-a25f931e-5c9e-4544-9257-ac89ed0f97a4 req-54733514-db3c-4f4c-a22f-b0121a2487ea service nova] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Updating instance_info_cache with network_info: [{"id": "ffb99eae-6874-4496-9694-5f2aaae75465", "address": "fa:16:3e:a8:fd:bc", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb99eae-68", "ovs_interfaceid": "ffb99eae-6874-4496-9694-5f2aaae75465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:02:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a25f931e-5c9e-4544-9257-ac89ed0f97a4 req-54733514-db3c-4f4c-a22f-b0121a2487ea service nova] Releasing lock "refresh_cache-e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:02:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:16 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040536.986927, e259e21c-3a8b-4ffd-880d-1fb29a2ef64f => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:02:16 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] VM Resumed (Lifecycle Event)
Aug 26 09:02:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 09:02:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 09:02:16 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Instance spawned successfully.
Aug 26 09:02:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 09:02:17 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:02:17 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:02:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:02:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:02:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:02:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:02:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:02:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:02:17 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 09:02:17 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040536.9874215, e259e21c-3a8b-4ffd-880d-1fb29a2ef64f => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:02:17 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] VM Started (Lifecycle Event)
Aug 26 09:02:17 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:02:17 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:02:17 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 09:02:17 user nova-compute[73104]: INFO nova.compute.manager [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Took 5.76 seconds to spawn the instance on the hypervisor.
Aug 26 09:02:17 user nova-compute[73104]: DEBUG nova.compute.manager [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:02:17 user nova-compute[73104]: INFO nova.compute.manager [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Took 6.34 seconds to build instance.
Aug 26 09:02:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e14f29cb-dc73-4f78-8051-97b54734dae6 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.475s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:17 user nova-compute[73104]: DEBUG nova.compute.manager [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 09:02:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 09:02:17 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Creating image(s)
Aug 26 09:02:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Did not create local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 09:02:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Ensure instance console log exists: /opt/stack/data/nova/instances/56e8f70f-f077-41a7-9cbd-749c40ec0a23/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 09:02:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Start _get_guest_xml network_info=[{"id": "7dbed8ca-ccd9-491a-9abe-c0a71f17e2af", "address": "fa:16:3e:6a:35:ce", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dbed8ca-cc", "ovs_interfaceid": "7dbed8ca-ccd9-491a-9abe-c0a71f17e2af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'b9247081-8fec-4475-8aae-5a031d827945', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVsApFlG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '56e8f70f-f077-41a7-9cbd-749c40ec0a23', 'attached_at': '', 'detached_at': '', 'volume_id': '2bb579eb-a354-482f-93fd-8a500f30d57e', 'serial': '2bb579eb-a354-482f-93fd-8a500f30d57e'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 09:02:17 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:02:17 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:02:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVsApFlG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:02:18 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:02:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:02:18 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:02:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:02:18 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 09:02:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[22aa4c2a-c96d-4710-b35c-da35150a5452]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 09:02:18 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[088bb673-942c-4813-9f18-9f988134220c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e] added
Aug 26 09:02:18 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[27aa8089-5677-48c0-8be3-15104e0f8920]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[942e33d7-bbe2-4723-906c-87331385f6e1]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cVsApFlG {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cVsApFlG" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[44940e0e-313e-4c7c-893f-6fb4c5286ddb]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cVsApFlG'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c626bfae-3d86-46f5-920f-74844d32fc7d]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8bca28-e61d-4155-8f21-09cf16a52ca4]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 09:02:18 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 09:02:18 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e -p 172.16.0.220:3260 --login" returned: 0 in 1.055s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:19 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9a7197-1f74-490e-bd48-84abd0043a39]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:02:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e, portal: 172.16.0.220,3260]
Aug 26 09:02:19 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e, portal: 172.16.0.220,3260] successful.
Aug 26 09:02:19 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:02:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:19 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f26d9f-0c70-47e3-b54f-8b5f46e7b2b3]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:02:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:02:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:19 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6d7a0b-ac31-4d72-a50d-6a6397cb16eb]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:02:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 09:02:19 user nova-compute[73104]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:02:19 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:02:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 09:02:19 user nova-compute[73104]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:02:19 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:02:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.267s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:02:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 09:02:19 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 09:02:19 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 09:02:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:19 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[09842462-c569-4525-8a12-b6b4eaca9805]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:02:19 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 09:02:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVsApFlG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 09:02:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:20 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.297s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:02:20 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] <== connect_volume: return (2298ms) {'type': 'block', 'scsi_wwn': '23866313833363664', 'path': '/dev/sdc'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:02:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866313833363664', 'path': '/dev/sdc'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 09:02:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:02:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1991857493',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1991857493',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1991857493',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPEQWXOPX4GJR2SwUUbvPmB8y/rgY1wN6ELjP7tBluOT610x8Gq5t/UH38fHqrIDxRNj9+nrBXIDox4qwcjnMQyVEXhOgj1hovUE7Ta2xcMsojoFMeytCQBM9VWC+1rVA==',key_name='tempest-keypair-1751671084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52518aa77344432385cfc2b73c63aebe',ramdisk_id='',reservation_id='r-x53p0pir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1466837638',owner_user_name='tempest-TestVolumeBootPattern-1466837638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:02:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bae03c9c8a9a40b2af6bd1fefb3561d0',uuid=56e8f70f-f077-41a7-9cbd-749c40ec0a23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7dbed8ca-ccd9-491a-9abe-c0a71f17e2af", "address": "fa:16:3e:6a:35:ce", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dbed8ca-cc", "ovs_interfaceid": "7dbed8ca-ccd9-491a-9abe-c0a71f17e2af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 09:02:20 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converting VIF {"id": "7dbed8ca-ccd9-491a-9abe-c0a71f17e2af", "address": "fa:16:3e:6a:35:ce", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dbed8ca-cc", "ovs_interfaceid": "7dbed8ca-ccd9-491a-9abe-c0a71f17e2af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:02:20 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:35:ce,bridge_name='br-int',has_traffic_filtering=True,id=7dbed8ca-ccd9-491a-9abe-c0a71f17e2af,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dbed8ca-cc') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:02:20 user nova-compute[73104]: DEBUG nova.objects.instance [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lazy-loading 'pci_devices' on Instance uuid 56e8f70f-f077-41a7-9cbd-749c40ec0a23 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:02:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] End _get_guest_xml xml=<domain type="kvm">
Aug 26 09:02:20 user nova-compute[73104]:   <uuid>56e8f70f-f077-41a7-9cbd-749c40ec0a23</uuid>
Aug 26 09:02:20 user nova-compute[73104]:   <name>instance-00000026</name>
Aug 26 09:02:20 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 09:02:20 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 09:02:20 user nova-compute[73104]:   <metadata>
Aug 26 09:02:20 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 09:02:20 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 09:02:20 user nova-compute[73104]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1991857493</nova:name>
Aug 26 09:02:20 user nova-compute[73104]:       <nova:creationTime>2023-08-26 09:02:18</nova:creationTime>
Aug 26 09:02:20 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 09:02:20 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 09:02:20 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 09:02:20 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 09:02:20 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 09:02:20 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 09:02:20 user nova-compute[73104]:       </nova:flavor>
Aug 26 09:02:20 user nova-compute[73104]:       <nova:owner>
Aug 26 09:02:20 user nova-compute[73104]:         <nova:user uuid="bae03c9c8a9a40b2af6bd1fefb3561d0">tempest-TestVolumeBootPattern-1466837638-project-member</nova:user>
Aug 26 09:02:20 user nova-compute[73104]:         <nova:project uuid="52518aa77344432385cfc2b73c63aebe">tempest-TestVolumeBootPattern-1466837638</nova:project>
Aug 26 09:02:20 user nova-compute[73104]:       </nova:owner>
Aug 26 09:02:20 user nova-compute[73104]:       <nova:ports>
Aug 26 09:02:20 user nova-compute[73104]:         <nova:port uuid="7dbed8ca-ccd9-491a-9abe-c0a71f17e2af">
Aug 26 09:02:20 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 09:02:20 user nova-compute[73104]:         </nova:port>
Aug 26 09:02:20 user nova-compute[73104]:       </nova:ports>
Aug 26 09:02:20 user nova-compute[73104]:     </nova:instance>
Aug 26 09:02:20 user nova-compute[73104]:   </metadata>
Aug 26 09:02:20 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 09:02:20 user nova-compute[73104]:     <system>
Aug 26 09:02:20 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 09:02:20 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 09:02:20 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 09:02:20 user nova-compute[73104]:       <entry name="serial">56e8f70f-f077-41a7-9cbd-749c40ec0a23</entry>
Aug 26 09:02:20 user nova-compute[73104]:       <entry name="uuid">56e8f70f-f077-41a7-9cbd-749c40ec0a23</entry>
Aug 26 09:02:20 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 09:02:20 user nova-compute[73104]:     </system>
Aug 26 09:02:20 user nova-compute[73104]:   </sysinfo>
Aug 26 09:02:20 user nova-compute[73104]:   <os>
Aug 26 09:02:20 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 09:02:20 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 09:02:20 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 09:02:20 user nova-compute[73104]:   </os>
Aug 26 09:02:20 user nova-compute[73104]:   <features>
Aug 26 09:02:20 user nova-compute[73104]:     <acpi/>
Aug 26 09:02:20 user nova-compute[73104]:     <apic/>
Aug 26 09:02:20 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 09:02:20 user nova-compute[73104]:   </features>
Aug 26 09:02:20 user nova-compute[73104]:   <clock offset="utc">
Aug 26 09:02:20 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 09:02:20 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 09:02:20 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 09:02:20 user nova-compute[73104]:   </clock>
Aug 26 09:02:20 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 09:02:20 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 09:02:20 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 09:02:20 user nova-compute[73104]:   </cpu>
Aug 26 09:02:20 user nova-compute[73104]:   <devices>
Aug 26 09:02:20 user nova-compute[73104]:     <disk type="block" device="disk">
Aug 26 09:02:20 user nova-compute[73104]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:02:20 user nova-compute[73104]:       <source dev="/dev/sdc"/>
Aug 26 09:02:20 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 09:02:20 user nova-compute[73104]:       <serial>2bb579eb-a354-482f-93fd-8a500f30d57e</serial>
Aug 26 09:02:20 user nova-compute[73104]:     </disk>
Aug 26 09:02:20 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 09:02:20 user nova-compute[73104]:       <mac address="fa:16:3e:6a:35:ce"/>
Aug 26 09:02:20 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:02:20 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 09:02:20 user nova-compute[73104]:       <target dev="tap7dbed8ca-cc"/>
Aug 26 09:02:20 user nova-compute[73104]:     </interface>
Aug 26 09:02:20 user nova-compute[73104]:     <serial type="pty">
Aug 26 09:02:20 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/56e8f70f-f077-41a7-9cbd-749c40ec0a23/console.log" append="off"/>
Aug 26 09:02:20 user nova-compute[73104]:     </serial>
Aug 26 09:02:20 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 09:02:20 user nova-compute[73104]:     <video>
Aug 26 09:02:20 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:02:20 user nova-compute[73104]:     </video>
Aug 26 09:02:20 user nova-compute[73104]:     <rng model="virtio">
Aug 26 09:02:20 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 09:02:20 user nova-compute[73104]:     </rng>
Aug 26 09:02:20 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 09:02:20 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 09:02:20 user nova-compute[73104]:       <stats period="10"/>
Aug 26 09:02:20 user nova-compute[73104]:     </memballoon>
Aug 26 09:02:20 user nova-compute[73104]:   </devices>
Aug 26 09:02:20 user nova-compute[73104]: </domain>
Aug 26 09:02:20 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 09:02:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:02:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1991857493',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1991857493',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1991857493',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPEQWXOPX4GJR2SwUUbvPmB8y/rgY1wN6ELjP7tBluOT610x8Gq5t/UH38fHqrIDxRNj9+nrBXIDox4qwcjnMQyVEXhOgj1hovUE7Ta2xcMsojoFMeytCQBM9VWC+1rVA==',key_name='tempest-keypair-1751671084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52518aa77344432385cfc2b73c63aebe',ramdisk_id='',reservation_id='r-x53p0pir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1466837638',owner_user_name='tempest-TestVolumeBootPattern-1466837638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:02:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bae03c9c8a9a40b2af6bd1fefb3561d0',uuid=56e8f70f-f077-41a7-9cbd-749c40ec0a23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7dbed8ca-ccd9-491a-9abe-c0a71f17e2af", "address": "fa:16:3e:6a:35:ce", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dbed8ca-cc", "ovs_interfaceid": "7dbed8ca-ccd9-491a-9abe-c0a71f17e2af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 09:02:20 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converting VIF {"id": "7dbed8ca-ccd9-491a-9abe-c0a71f17e2af", "address": "fa:16:3e:6a:35:ce", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dbed8ca-cc", "ovs_interfaceid": "7dbed8ca-ccd9-491a-9abe-c0a71f17e2af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:02:20 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:35:ce,bridge_name='br-int',has_traffic_filtering=True,id=7dbed8ca-ccd9-491a-9abe-c0a71f17e2af,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dbed8ca-cc') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:02:20 user nova-compute[73104]: DEBUG os_vif [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:35:ce,bridge_name='br-int',has_traffic_filtering=True,id=7dbed8ca-ccd9-491a-9abe-c0a71f17e2af,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dbed8ca-cc') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 09:02:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:02:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 09:02:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7dbed8ca-cc, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:02:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7dbed8ca-cc, col_values=(('external_ids', {'iface-id': '7dbed8ca-ccd9-491a-9abe-c0a71f17e2af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:35:ce', 'vm-uuid': '56e8f70f-f077-41a7-9cbd-749c40ec0a23'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:02:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:02:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:20 user nova-compute[73104]: INFO os_vif [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:35:ce,bridge_name='br-int',has_traffic_filtering=True,id=7dbed8ca-ccd9-491a-9abe-c0a71f17e2af,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dbed8ca-cc')
Aug 26 09:02:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:02:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] No VIF found with MAC fa:16:3e:6a:35:ce, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 09:02:20 user nova-compute[73104]: DEBUG nova.compute.manager [req-1866e8c7-67b5-4a27-b525-b2494a5f6891 req-95b8b6ff-d074-4ae7-8b99-034f0eba1706 service nova] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Received event network-vif-plugged-ffb99eae-6874-4496-9694-5f2aaae75465 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:02:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1866e8c7-67b5-4a27-b525-b2494a5f6891 req-95b8b6ff-d074-4ae7-8b99-034f0eba1706 service nova] Acquiring lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1866e8c7-67b5-4a27-b525-b2494a5f6891 req-95b8b6ff-d074-4ae7-8b99-034f0eba1706 service nova] Lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1866e8c7-67b5-4a27-b525-b2494a5f6891 req-95b8b6ff-d074-4ae7-8b99-034f0eba1706 service nova] Lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:20 user nova-compute[73104]: DEBUG nova.compute.manager [req-1866e8c7-67b5-4a27-b525-b2494a5f6891 req-95b8b6ff-d074-4ae7-8b99-034f0eba1706 service nova] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] No waiting events found dispatching network-vif-plugged-ffb99eae-6874-4496-9694-5f2aaae75465 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:02:20 user nova-compute[73104]: WARNING nova.compute.manager [req-1866e8c7-67b5-4a27-b525-b2494a5f6891 req-95b8b6ff-d074-4ae7-8b99-034f0eba1706 service nova] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Received unexpected event network-vif-plugged-ffb99eae-6874-4496-9694-5f2aaae75465 for instance with vm_state active and task_state None.
Aug 26 09:02:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:22 user nova-compute[73104]: DEBUG nova.compute.manager [req-f4680c35-e932-4a0a-8b1c-c9d445bf76eb req-991c8ca6-8259-45e3-9a9a-4579009bae54 service nova] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Received event network-vif-plugged-ffb99eae-6874-4496-9694-5f2aaae75465 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:02:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f4680c35-e932-4a0a-8b1c-c9d445bf76eb req-991c8ca6-8259-45e3-9a9a-4579009bae54 service nova] Acquiring lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f4680c35-e932-4a0a-8b1c-c9d445bf76eb req-991c8ca6-8259-45e3-9a9a-4579009bae54 service nova] Lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f4680c35-e932-4a0a-8b1c-c9d445bf76eb req-991c8ca6-8259-45e3-9a9a-4579009bae54 service nova] Lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:22 user nova-compute[73104]: DEBUG nova.compute.manager [req-f4680c35-e932-4a0a-8b1c-c9d445bf76eb req-991c8ca6-8259-45e3-9a9a-4579009bae54 service nova] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] No waiting events found dispatching network-vif-plugged-ffb99eae-6874-4496-9694-5f2aaae75465 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:02:22 user nova-compute[73104]: WARNING nova.compute.manager [req-f4680c35-e932-4a0a-8b1c-c9d445bf76eb req-991c8ca6-8259-45e3-9a9a-4579009bae54 service nova] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Received unexpected event network-vif-plugged-ffb99eae-6874-4496-9694-5f2aaae75465 for instance with vm_state active and task_state None.
Aug 26 09:02:24 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040544.120403, 56e8f70f-f077-41a7-9cbd-749c40ec0a23 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:02:24 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] VM Resumed (Lifecycle Event)
Aug 26 09:02:24 user nova-compute[73104]: DEBUG nova.compute.manager [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 09:02:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 09:02:24 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Instance spawned successfully.
Aug 26 09:02:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 09:02:24 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:02:24 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:02:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:02:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:02:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:02:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:02:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:02:24 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:02:24 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 09:02:24 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040544.12317, 56e8f70f-f077-41a7-9cbd-749c40ec0a23 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:02:24 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] VM Started (Lifecycle Event)
Aug 26 09:02:24 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:02:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:24 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:02:24 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 09:02:24 user nova-compute[73104]: INFO nova.compute.manager [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Took 6.27 seconds to spawn the instance on the hypervisor.
Aug 26 09:02:24 user nova-compute[73104]: DEBUG nova.compute.manager [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:02:24 user nova-compute[73104]: INFO nova.compute.manager [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Took 18.33 seconds to build instance.
Aug 26 09:02:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-80ed3fa9-7f24-4421-aa23-13d16aa24c6a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "56e8f70f-f077-41a7-9cbd-749c40ec0a23" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.444s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:25 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Acquiring lock "093c5d6f-c4ab-470e-86f6-7434295555aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "093c5d6f-c4ab-470e-86f6-7434295555aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:26 user nova-compute[73104]: DEBUG nova.compute.manager [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 09:02:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:26 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 09:02:26 user nova-compute[73104]: INFO nova.compute.claims [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Claim successful on node user
Aug 26 09:02:27 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:02:27 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:02:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:27 user nova-compute[73104]: DEBUG nova.compute.manager [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 09:02:27 user nova-compute[73104]: DEBUG nova.compute.manager [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 09:02:27 user nova-compute[73104]: DEBUG nova.network.neutron [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 09:02:27 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 09:02:27 user nova-compute[73104]: DEBUG nova.compute.manager [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 09:02:27 user nova-compute[73104]: DEBUG nova.compute.manager [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 09:02:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 09:02:27 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Creating image(s)
Aug 26 09:02:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Acquiring lock "/opt/stack/data/nova/instances/093c5d6f-c4ab-470e-86f6-7434295555aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "/opt/stack/data/nova/instances/093c5d6f-c4ab-470e-86f6-7434295555aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "/opt/stack/data/nova/instances/093c5d6f-c4ab-470e-86f6-7434295555aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:27 user nova-compute[73104]: DEBUG nova.policy [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f7bd92a0b9b84a3388267f59332b254c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10314719d1a4b6ba0d23fbd05f8378e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 09:02:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.210s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.218s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/093c5d6f-c4ab-470e-86f6-7434295555aa/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/093c5d6f-c4ab-470e-86f6-7434295555aa/disk 1073741824" returned: 0 in 0.060s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:28 user nova-compute[73104]: DEBUG nova.compute.manager [req-df2add2e-496d-46c6-9769-bdfab02d07ee req-06810db0-776d-407c-ad05-42e66c0a18d0 service nova] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Received event network-vif-plugged-7dbed8ca-ccd9-491a-9abe-c0a71f17e2af {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:02:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-df2add2e-496d-46c6-9769-bdfab02d07ee req-06810db0-776d-407c-ad05-42e66c0a18d0 service nova] Acquiring lock "56e8f70f-f077-41a7-9cbd-749c40ec0a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-df2add2e-496d-46c6-9769-bdfab02d07ee req-06810db0-776d-407c-ad05-42e66c0a18d0 service nova] Lock "56e8f70f-f077-41a7-9cbd-749c40ec0a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-df2add2e-496d-46c6-9769-bdfab02d07ee req-06810db0-776d-407c-ad05-42e66c0a18d0 service nova] Lock "56e8f70f-f077-41a7-9cbd-749c40ec0a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:28 user nova-compute[73104]: DEBUG nova.compute.manager [req-df2add2e-496d-46c6-9769-bdfab02d07ee req-06810db0-776d-407c-ad05-42e66c0a18d0 service nova] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] No waiting events found dispatching network-vif-plugged-7dbed8ca-ccd9-491a-9abe-c0a71f17e2af {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:02:28 user nova-compute[73104]: WARNING nova.compute.manager [req-df2add2e-496d-46c6-9769-bdfab02d07ee req-06810db0-776d-407c-ad05-42e66c0a18d0 service nova] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Received unexpected event network-vif-plugged-7dbed8ca-ccd9-491a-9abe-c0a71f17e2af for instance with vm_state active and task_state None.
Aug 26 09:02:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.221s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:28 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Checking if we can resize image /opt/stack/data/nova/instances/093c5d6f-c4ab-470e-86f6-7434295555aa/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 09:02:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/093c5d6f-c4ab-470e-86f6-7434295555aa/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/093c5d6f-c4ab-470e-86f6-7434295555aa/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:28 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Cannot resize image /opt/stack/data/nova/instances/093c5d6f-c4ab-470e-86f6-7434295555aa/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 09:02:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 09:02:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Ensure instance console log exists: /opt/stack/data/nova/instances/093c5d6f-c4ab-470e-86f6-7434295555aa/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 09:02:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:29 user nova-compute[73104]: DEBUG nova.network.neutron [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Successfully created port: 4cc3052a-4671-4201-b0c3-6f7f634a12cc {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 09:02:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.compute.manager [req-4e9b3f10-f5b5-4ede-ba5e-d4aa6f40fd6f req-af909274-5104-4470-9709-6af24b576993 service nova] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Received event network-vif-plugged-7dbed8ca-ccd9-491a-9abe-c0a71f17e2af {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4e9b3f10-f5b5-4ede-ba5e-d4aa6f40fd6f req-af909274-5104-4470-9709-6af24b576993 service nova] Acquiring lock "56e8f70f-f077-41a7-9cbd-749c40ec0a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4e9b3f10-f5b5-4ede-ba5e-d4aa6f40fd6f req-af909274-5104-4470-9709-6af24b576993 service nova] Lock "56e8f70f-f077-41a7-9cbd-749c40ec0a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4e9b3f10-f5b5-4ede-ba5e-d4aa6f40fd6f req-af909274-5104-4470-9709-6af24b576993 service nova] Lock "56e8f70f-f077-41a7-9cbd-749c40ec0a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.compute.manager [req-4e9b3f10-f5b5-4ede-ba5e-d4aa6f40fd6f req-af909274-5104-4470-9709-6af24b576993 service nova] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] No waiting events found dispatching network-vif-plugged-7dbed8ca-ccd9-491a-9abe-c0a71f17e2af {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:02:30 user nova-compute[73104]: WARNING nova.compute.manager [req-4e9b3f10-f5b5-4ede-ba5e-d4aa6f40fd6f req-af909274-5104-4470-9709-6af24b576993 service nova] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Received unexpected event network-vif-plugged-7dbed8ca-ccd9-491a-9abe-c0a71f17e2af for instance with vm_state active and task_state None.
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.network.neutron [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Successfully updated port: 4cc3052a-4671-4201-b0c3-6f7f634a12cc {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Acquiring lock "refresh_cache-093c5d6f-c4ab-470e-86f6-7434295555aa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Acquired lock "refresh_cache-093c5d6f-c4ab-470e-86f6-7434295555aa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.network.neutron [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.compute.manager [req-6f29e4d3-5f85-4f25-b148-d3d5d8c20fa9 req-1b1037b1-9289-4148-82b1-0aa6edca1dcb service nova] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Received event network-changed-4cc3052a-4671-4201-b0c3-6f7f634a12cc {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.compute.manager [req-6f29e4d3-5f85-4f25-b148-d3d5d8c20fa9 req-1b1037b1-9289-4148-82b1-0aa6edca1dcb service nova] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Refreshing instance network info cache due to event network-changed-4cc3052a-4671-4201-b0c3-6f7f634a12cc. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6f29e4d3-5f85-4f25-b148-d3d5d8c20fa9 req-1b1037b1-9289-4148-82b1-0aa6edca1dcb service nova] Acquiring lock "refresh_cache-093c5d6f-c4ab-470e-86f6-7434295555aa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.network.neutron [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.network.neutron [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Updating instance_info_cache with network_info: [{"id": "4cc3052a-4671-4201-b0c3-6f7f634a12cc", "address": "fa:16:3e:3c:ee:dd", "network": {"id": "e7648e7b-2516-4dda-8315-40a01975b663", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-350226034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f10314719d1a4b6ba0d23fbd05f8378e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc3052a-46", "ovs_interfaceid": "4cc3052a-4671-4201-b0c3-6f7f634a12cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Releasing lock "refresh_cache-093c5d6f-c4ab-470e-86f6-7434295555aa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Instance network_info: |[{"id": "4cc3052a-4671-4201-b0c3-6f7f634a12cc", "address": "fa:16:3e:3c:ee:dd", "network": {"id": "e7648e7b-2516-4dda-8315-40a01975b663", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-350226034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f10314719d1a4b6ba0d23fbd05f8378e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc3052a-46", "ovs_interfaceid": "4cc3052a-4671-4201-b0c3-6f7f634a12cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6f29e4d3-5f85-4f25-b148-d3d5d8c20fa9 req-1b1037b1-9289-4148-82b1-0aa6edca1dcb service nova] Acquired lock "refresh_cache-093c5d6f-c4ab-470e-86f6-7434295555aa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.network.neutron [req-6f29e4d3-5f85-4f25-b148-d3d5d8c20fa9 req-1b1037b1-9289-4148-82b1-0aa6edca1dcb service nova] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Refreshing network info cache for port 4cc3052a-4671-4201-b0c3-6f7f634a12cc {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Start _get_guest_xml network_info=[{"id": "4cc3052a-4671-4201-b0c3-6f7f634a12cc", "address": "fa:16:3e:3c:ee:dd", "network": {"id": "e7648e7b-2516-4dda-8315-40a01975b663", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-350226034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f10314719d1a4b6ba0d23fbd05f8378e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc3052a-46", "ovs_interfaceid": "4cc3052a-4671-4201-b0c3-6f7f634a12cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 09:02:30 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:02:30 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:02:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-379130076',display_name='tempest-TestServerVolumeAttachmentScenario-server-379130076',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-379130076',id=40,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcvJ9UvOKzeiXSG8HzoOUBbI1R0ct1He/ei9rB0XSMCdOP/xPClTW57v/bJ0kyWStyPBZB7CVTPQq+8YOgDPQfBuiUavun9yDUP9hAT2hCMJcLzRmFORtHIFi9owx0kOw==',key_name='tempest-keypair-1109707204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f10314719d1a4b6ba0d23fbd05f8378e',ramdisk_id='',reservation_id='r-38fjusim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1886190242',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1886190242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:02:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7bd92a0b9b84a3388267f59332b254c',uuid=093c5d6f-c4ab-470e-86f6-7434295555aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cc3052a-4671-4201-b0c3-6f7f634a12cc", "address": "fa:16:3e:3c:ee:dd", "network": {"id": "e7648e7b-2516-4dda-8315-40a01975b663", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-350226034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f10314719d1a4b6ba0d23fbd05f8378e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc3052a-46", "ovs_interfaceid": "4cc3052a-4671-4201-b0c3-6f7f634a12cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Converting VIF {"id": "4cc3052a-4671-4201-b0c3-6f7f634a12cc", "address": "fa:16:3e:3c:ee:dd", "network": {"id": "e7648e7b-2516-4dda-8315-40a01975b663", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-350226034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f10314719d1a4b6ba0d23fbd05f8378e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc3052a-46", "ovs_interfaceid": "4cc3052a-4671-4201-b0c3-6f7f634a12cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:ee:dd,bridge_name='br-int',has_traffic_filtering=True,id=4cc3052a-4671-4201-b0c3-6f7f634a12cc,network=Network(e7648e7b-2516-4dda-8315-40a01975b663),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc3052a-46') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.objects.instance [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lazy-loading 'pci_devices' on Instance uuid 093c5d6f-c4ab-470e-86f6-7434295555aa {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] End _get_guest_xml xml=<domain type="kvm">
Aug 26 09:02:30 user nova-compute[73104]:   <uuid>093c5d6f-c4ab-470e-86f6-7434295555aa</uuid>
Aug 26 09:02:30 user nova-compute[73104]:   <name>instance-00000028</name>
Aug 26 09:02:30 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 09:02:30 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 09:02:30 user nova-compute[73104]:   <metadata>
Aug 26 09:02:30 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 09:02:30 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 09:02:30 user nova-compute[73104]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-379130076</nova:name>
Aug 26 09:02:30 user nova-compute[73104]:       <nova:creationTime>2023-08-26 09:02:30</nova:creationTime>
Aug 26 09:02:30 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 09:02:30 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 09:02:30 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 09:02:30 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 09:02:30 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 09:02:30 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 09:02:30 user nova-compute[73104]:       </nova:flavor>
Aug 26 09:02:30 user nova-compute[73104]:       <nova:owner>
Aug 26 09:02:30 user nova-compute[73104]:         <nova:user uuid="f7bd92a0b9b84a3388267f59332b254c">tempest-TestServerVolumeAttachmentScenario-1886190242-project-member</nova:user>
Aug 26 09:02:30 user nova-compute[73104]:         <nova:project uuid="f10314719d1a4b6ba0d23fbd05f8378e">tempest-TestServerVolumeAttachmentScenario-1886190242</nova:project>
Aug 26 09:02:30 user nova-compute[73104]:       </nova:owner>
Aug 26 09:02:30 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 09:02:30 user nova-compute[73104]:       <nova:ports>
Aug 26 09:02:30 user nova-compute[73104]:         <nova:port uuid="4cc3052a-4671-4201-b0c3-6f7f634a12cc">
Aug 26 09:02:30 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 09:02:30 user nova-compute[73104]:         </nova:port>
Aug 26 09:02:30 user nova-compute[73104]:       </nova:ports>
Aug 26 09:02:30 user nova-compute[73104]:     </nova:instance>
Aug 26 09:02:30 user nova-compute[73104]:   </metadata>
Aug 26 09:02:30 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 09:02:30 user nova-compute[73104]:     <system>
Aug 26 09:02:30 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 09:02:30 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 09:02:30 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 09:02:30 user nova-compute[73104]:       <entry name="serial">093c5d6f-c4ab-470e-86f6-7434295555aa</entry>
Aug 26 09:02:30 user nova-compute[73104]:       <entry name="uuid">093c5d6f-c4ab-470e-86f6-7434295555aa</entry>
Aug 26 09:02:30 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 09:02:30 user nova-compute[73104]:     </system>
Aug 26 09:02:30 user nova-compute[73104]:   </sysinfo>
Aug 26 09:02:30 user nova-compute[73104]:   <os>
Aug 26 09:02:30 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 09:02:30 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 09:02:30 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 09:02:30 user nova-compute[73104]:   </os>
Aug 26 09:02:30 user nova-compute[73104]:   <features>
Aug 26 09:02:30 user nova-compute[73104]:     <acpi/>
Aug 26 09:02:30 user nova-compute[73104]:     <apic/>
Aug 26 09:02:30 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 09:02:30 user nova-compute[73104]:   </features>
Aug 26 09:02:30 user nova-compute[73104]:   <clock offset="utc">
Aug 26 09:02:30 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 09:02:30 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 09:02:30 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 09:02:30 user nova-compute[73104]:   </clock>
Aug 26 09:02:30 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 09:02:30 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 09:02:30 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 09:02:30 user nova-compute[73104]:   </cpu>
Aug 26 09:02:30 user nova-compute[73104]:   <devices>
Aug 26 09:02:30 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 09:02:30 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 09:02:30 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/093c5d6f-c4ab-470e-86f6-7434295555aa/disk"/>
Aug 26 09:02:30 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 09:02:30 user nova-compute[73104]:     </disk>
Aug 26 09:02:30 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 09:02:30 user nova-compute[73104]:       <mac address="fa:16:3e:3c:ee:dd"/>
Aug 26 09:02:30 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:02:30 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 09:02:30 user nova-compute[73104]:       <target dev="tap4cc3052a-46"/>
Aug 26 09:02:30 user nova-compute[73104]:     </interface>
Aug 26 09:02:30 user nova-compute[73104]:     <serial type="pty">
Aug 26 09:02:30 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/093c5d6f-c4ab-470e-86f6-7434295555aa/console.log" append="off"/>
Aug 26 09:02:30 user nova-compute[73104]:     </serial>
Aug 26 09:02:30 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 09:02:30 user nova-compute[73104]:     <video>
Aug 26 09:02:30 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:02:30 user nova-compute[73104]:     </video>
Aug 26 09:02:30 user nova-compute[73104]:     <rng model="virtio">
Aug 26 09:02:30 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 09:02:30 user nova-compute[73104]:     </rng>
Aug 26 09:02:30 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 09:02:30 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 09:02:30 user nova-compute[73104]:       <stats period="10"/>
Aug 26 09:02:30 user nova-compute[73104]:     </memballoon>
Aug 26 09:02:30 user nova-compute[73104]:   </devices>
Aug 26 09:02:30 user nova-compute[73104]: </domain>
Aug 26 09:02:30 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:02:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-379130076',display_name='tempest-TestServerVolumeAttachmentScenario-server-379130076',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-379130076',id=40,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcvJ9UvOKzeiXSG8HzoOUBbI1R0ct1He/ei9rB0XSMCdOP/xPClTW57v/bJ0kyWStyPBZB7CVTPQq+8YOgDPQfBuiUavun9yDUP9hAT2hCMJcLzRmFORtHIFi9owx0kOw==',key_name='tempest-keypair-1109707204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f10314719d1a4b6ba0d23fbd05f8378e',ramdisk_id='',reservation_id='r-38fjusim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1886190242',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1886190242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:02:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7bd92a0b9b84a3388267f59332b254c',uuid=093c5d6f-c4ab-470e-86f6-7434295555aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cc3052a-4671-4201-b0c3-6f7f634a12cc", "address": "fa:16:3e:3c:ee:dd", "network": {"id": "e7648e7b-2516-4dda-8315-40a01975b663", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-350226034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f10314719d1a4b6ba0d23fbd05f8378e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc3052a-46", "ovs_interfaceid": "4cc3052a-4671-4201-b0c3-6f7f634a12cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Converting VIF {"id": "4cc3052a-4671-4201-b0c3-6f7f634a12cc", "address": "fa:16:3e:3c:ee:dd", "network": {"id": "e7648e7b-2516-4dda-8315-40a01975b663", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-350226034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f10314719d1a4b6ba0d23fbd05f8378e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc3052a-46", "ovs_interfaceid": "4cc3052a-4671-4201-b0c3-6f7f634a12cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:ee:dd,bridge_name='br-int',has_traffic_filtering=True,id=4cc3052a-4671-4201-b0c3-6f7f634a12cc,network=Network(e7648e7b-2516-4dda-8315-40a01975b663),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc3052a-46') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG os_vif [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:ee:dd,bridge_name='br-int',has_traffic_filtering=True,id=4cc3052a-4671-4201-b0c3-6f7f634a12cc,network=Network(e7648e7b-2516-4dda-8315-40a01975b663),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc3052a-46') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4cc3052a-46, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4cc3052a-46, col_values=(('external_ids', {'iface-id': '4cc3052a-4671-4201-b0c3-6f7f634a12cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:ee:dd', 'vm-uuid': '093c5d6f-c4ab-470e-86f6-7434295555aa'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:02:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:30 user nova-compute[73104]: INFO os_vif [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:ee:dd,bridge_name='br-int',has_traffic_filtering=True,id=4cc3052a-4671-4201-b0c3-6f7f634a12cc,network=Network(e7648e7b-2516-4dda-8315-40a01975b663),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc3052a-46')
Aug 26 09:02:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:02:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] No VIF found with MAC fa:16:3e:3c:ee:dd, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 09:02:31 user nova-compute[73104]: DEBUG nova.network.neutron [req-6f29e4d3-5f85-4f25-b148-d3d5d8c20fa9 req-1b1037b1-9289-4148-82b1-0aa6edca1dcb service nova] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Updated VIF entry in instance network info cache for port 4cc3052a-4671-4201-b0c3-6f7f634a12cc. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:02:31 user nova-compute[73104]: DEBUG nova.network.neutron [req-6f29e4d3-5f85-4f25-b148-d3d5d8c20fa9 req-1b1037b1-9289-4148-82b1-0aa6edca1dcb service nova] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Updating instance_info_cache with network_info: [{"id": "4cc3052a-4671-4201-b0c3-6f7f634a12cc", "address": "fa:16:3e:3c:ee:dd", "network": {"id": "e7648e7b-2516-4dda-8315-40a01975b663", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-350226034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f10314719d1a4b6ba0d23fbd05f8378e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc3052a-46", "ovs_interfaceid": "4cc3052a-4671-4201-b0c3-6f7f634a12cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:02:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6f29e4d3-5f85-4f25-b148-d3d5d8c20fa9 req-1b1037b1-9289-4148-82b1-0aa6edca1dcb service nova] Releasing lock "refresh_cache-093c5d6f-c4ab-470e-86f6-7434295555aa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:02:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:32 user nova-compute[73104]: DEBUG nova.compute.manager [req-42b27d4b-9a9c-40c5-8de1-3a2ce56d8c92 req-64f32e73-c564-47d6-9011-ef9fc5d3e06f service nova] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Received event network-vif-plugged-4cc3052a-4671-4201-b0c3-6f7f634a12cc {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:02:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-42b27d4b-9a9c-40c5-8de1-3a2ce56d8c92 req-64f32e73-c564-47d6-9011-ef9fc5d3e06f service nova] Acquiring lock "093c5d6f-c4ab-470e-86f6-7434295555aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-42b27d4b-9a9c-40c5-8de1-3a2ce56d8c92 req-64f32e73-c564-47d6-9011-ef9fc5d3e06f service nova] Lock "093c5d6f-c4ab-470e-86f6-7434295555aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-42b27d4b-9a9c-40c5-8de1-3a2ce56d8c92 req-64f32e73-c564-47d6-9011-ef9fc5d3e06f service nova] Lock "093c5d6f-c4ab-470e-86f6-7434295555aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:32 user nova-compute[73104]: DEBUG nova.compute.manager [req-42b27d4b-9a9c-40c5-8de1-3a2ce56d8c92 req-64f32e73-c564-47d6-9011-ef9fc5d3e06f service nova] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] No waiting events found dispatching network-vif-plugged-4cc3052a-4671-4201-b0c3-6f7f634a12cc {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:02:32 user nova-compute[73104]: WARNING nova.compute.manager [req-42b27d4b-9a9c-40c5-8de1-3a2ce56d8c92 req-64f32e73-c564-47d6-9011-ef9fc5d3e06f service nova] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Received unexpected event network-vif-plugged-4cc3052a-4671-4201-b0c3-6f7f634a12cc for instance with vm_state building and task_state spawning.
Aug 26 09:02:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:34 user nova-compute[73104]: DEBUG nova.compute.manager [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 09:02:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 09:02:34 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040554.5629156, 093c5d6f-c4ab-470e-86f6-7434295555aa => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:02:34 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] VM Resumed (Lifecycle Event)
Aug 26 09:02:34 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Instance spawned successfully.
Aug 26 09:02:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 09:02:34 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:02:34 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:02:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:02:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:02:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:02:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:02:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:02:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:02:34 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 09:02:34 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040554.5664623, 093c5d6f-c4ab-470e-86f6-7434295555aa => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:02:34 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] VM Started (Lifecycle Event)
Aug 26 09:02:34 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:02:34 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:02:34 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 09:02:34 user nova-compute[73104]: INFO nova.compute.manager [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Took 7.21 seconds to spawn the instance on the hypervisor.
Aug 26 09:02:34 user nova-compute[73104]: DEBUG nova.compute.manager [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:02:34 user nova-compute[73104]: INFO nova.compute.manager [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Took 7.96 seconds to build instance.
Aug 26 09:02:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-47401594-dc27-481a-ba37-6e66fa21c710 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "093c5d6f-c4ab-470e-86f6-7434295555aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.139s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:34 user nova-compute[73104]: DEBUG nova.compute.manager [req-3ea340de-6e29-4aa0-8ab3-bf4d9c089d6a req-f78f1470-11c7-4eec-b9e9-4ead09c31ba5 service nova] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Received event network-vif-plugged-4cc3052a-4671-4201-b0c3-6f7f634a12cc {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:02:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3ea340de-6e29-4aa0-8ab3-bf4d9c089d6a req-f78f1470-11c7-4eec-b9e9-4ead09c31ba5 service nova] Acquiring lock "093c5d6f-c4ab-470e-86f6-7434295555aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3ea340de-6e29-4aa0-8ab3-bf4d9c089d6a req-f78f1470-11c7-4eec-b9e9-4ead09c31ba5 service nova] Lock "093c5d6f-c4ab-470e-86f6-7434295555aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3ea340de-6e29-4aa0-8ab3-bf4d9c089d6a req-f78f1470-11c7-4eec-b9e9-4ead09c31ba5 service nova] Lock "093c5d6f-c4ab-470e-86f6-7434295555aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:34 user nova-compute[73104]: DEBUG nova.compute.manager [req-3ea340de-6e29-4aa0-8ab3-bf4d9c089d6a req-f78f1470-11c7-4eec-b9e9-4ead09c31ba5 service nova] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] No waiting events found dispatching network-vif-plugged-4cc3052a-4671-4201-b0c3-6f7f634a12cc {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:02:34 user nova-compute[73104]: WARNING nova.compute.manager [req-3ea340de-6e29-4aa0-8ab3-bf4d9c089d6a req-f78f1470-11c7-4eec-b9e9-4ead09c31ba5 service nova] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Received unexpected event network-vif-plugged-4cc3052a-4671-4201-b0c3-6f7f634a12cc for instance with vm_state active and task_state None.
Aug 26 09:02:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 09:02:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:35 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 09:02:35 user nova-compute[73104]: INFO nova.compute.claims [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Claim successful on node user
Aug 26 09:02:35 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:02:35 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:02:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.372s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 09:02:35 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:36 user nova-compute[73104]: DEBUG nova.compute.manager [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 09:02:36 user nova-compute[73104]: DEBUG nova.network.neutron [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 09:02:36 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 09:02:36 user nova-compute[73104]: DEBUG nova.compute.manager [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 09:02:36 user nova-compute[73104]: DEBUG nova.policy [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da4b6574d165418eaf2b8c8b84d6151f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7642d165474defadde34dabc11f842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 09:02:36 user nova-compute[73104]: DEBUG nova.compute.manager [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 09:02:36 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 09:02:36 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Creating image(s)
Aug 26 09:02:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "/opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "/opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "/opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.195s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.185s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk 1073741824" returned: 0 in 0.056s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "432a66be-853d-42d7-8622-0417ef36045c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "432a66be-853d-42d7-8622-0417ef36045c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:36 user nova-compute[73104]: DEBUG nova.compute.manager [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 09:02:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.214s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:36 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 09:02:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:36 user nova-compute[73104]: DEBUG nova.network.neutron [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Successfully created port: 5e91d018-838e-4b87-bd5f-1b5f31c22d5f {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 09:02:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:37 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 09:02:37 user nova-compute[73104]: INFO nova.compute.claims [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Claim successful on node user
Aug 26 09:02:37 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:37 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Cannot resize image /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 09:02:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 09:02:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Ensure instance console log exists: /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 09:02:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:37 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:02:37 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:02:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:37 user nova-compute[73104]: DEBUG nova.compute.manager [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 09:02:37 user nova-compute[73104]: DEBUG nova.compute.manager [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 09:02:37 user nova-compute[73104]: DEBUG nova.network.neutron [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 09:02:37 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 09:02:37 user nova-compute[73104]: DEBUG nova.compute.manager [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 09:02:37 user nova-compute[73104]: DEBUG nova.policy [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da4b6574d165418eaf2b8c8b84d6151f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7642d165474defadde34dabc11f842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 09:02:37 user nova-compute[73104]: DEBUG nova.compute.manager [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 09:02:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 09:02:37 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Creating image(s)
Aug 26 09:02:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "/opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "/opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "/opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:37 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:37 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.202s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:37 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:37 user nova-compute[73104]: DEBUG nova.network.neutron [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Successfully updated port: 5e91d018-838e-4b87-bd5f-1b5f31c22d5f {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 09:02:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "refresh_cache-2c10f0ac-f63d-462d-a999-aa98eb6d91f2" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:02:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquired lock "refresh_cache-2c10f0ac-f63d-462d-a999-aa98eb6d91f2" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:02:37 user nova-compute[73104]: DEBUG nova.network.neutron [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 09:02:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.231s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:38 user nova-compute[73104]: DEBUG nova.network.neutron [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 09:02:38 user nova-compute[73104]: DEBUG nova.compute.manager [req-5e934d88-99a1-4996-997d-5067af26d598 req-68109383-f436-4fb7-ad53-d59f2709752a service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Received event network-changed-5e91d018-838e-4b87-bd5f-1b5f31c22d5f {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:02:38 user nova-compute[73104]: DEBUG nova.compute.manager [req-5e934d88-99a1-4996-997d-5067af26d598 req-68109383-f436-4fb7-ad53-d59f2709752a service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Refreshing instance network info cache due to event network-changed-5e91d018-838e-4b87-bd5f-1b5f31c22d5f. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:02:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5e934d88-99a1-4996-997d-5067af26d598 req-68109383-f436-4fb7-ad53-d59f2709752a service nova] Acquiring lock "refresh_cache-2c10f0ac-f63d-462d-a999-aa98eb6d91f2" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:02:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk 1073741824" returned: 0 in 0.373s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.610s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:38 user nova-compute[73104]: DEBUG nova.network.neutron [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Successfully created port: 52b25498-8470-454f-9cf5-4989ec64751a {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 09:02:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.215s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:38 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Checking if we can resize image /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 09:02:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:38 user nova-compute[73104]: DEBUG nova.network.neutron [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Updating instance_info_cache with network_info: [{"id": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "address": "fa:16:3e:f0:cc:d7", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e91d018-83", "ovs_interfaceid": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:02:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:38 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Cannot resize image /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 09:02:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 09:02:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Ensure instance console log exists: /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 09:02:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Releasing lock "refresh_cache-2c10f0ac-f63d-462d-a999-aa98eb6d91f2" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:02:38 user nova-compute[73104]: DEBUG nova.compute.manager [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Instance network_info: |[{"id": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "address": "fa:16:3e:f0:cc:d7", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e91d018-83", "ovs_interfaceid": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 09:02:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5e934d88-99a1-4996-997d-5067af26d598 req-68109383-f436-4fb7-ad53-d59f2709752a service nova] Acquired lock "refresh_cache-2c10f0ac-f63d-462d-a999-aa98eb6d91f2" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:02:38 user nova-compute[73104]: DEBUG nova.network.neutron [req-5e934d88-99a1-4996-997d-5067af26d598 req-68109383-f436-4fb7-ad53-d59f2709752a service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Refreshing network info cache for port 5e91d018-838e-4b87-bd5f-1b5f31c22d5f {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:02:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Start _get_guest_xml network_info=[{"id": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "address": "fa:16:3e:f0:cc:d7", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e91d018-83", "ovs_interfaceid": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 09:02:38 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:02:38 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:02:39 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-636224961',display_name='tempest-ServerRescueNegativeTestJSON-server-636224961',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-636224961',id=41,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b7642d165474defadde34dabc11f842',ramdisk_id='',reservation_id='r-dt3wsa96',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-901062798',owner_user_name='tempest-ServerRescueNegativeTestJSON-901062798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:02:36Z,user_data=None,user_id='da4b6574d165418eaf2b8c8b84d6151f',uuid=2c10f0ac-f63d-462d-a999-aa98eb6d91f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "address": "fa:16:3e:f0:cc:d7", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e91d018-83", "ovs_interfaceid": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Converting VIF {"id": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "address": "fa:16:3e:f0:cc:d7", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e91d018-83", "ovs_interfaceid": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:cc:d7,bridge_name='br-int',has_traffic_filtering=True,id=5e91d018-838e-4b87-bd5f-1b5f31c22d5f,network=Network(fb2d19ab-1c79-4529-b058-e1b8c4fc8276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e91d018-83') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG nova.objects.instance [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] End _get_guest_xml xml=<domain type="kvm">
Aug 26 09:02:39 user nova-compute[73104]:   <uuid>2c10f0ac-f63d-462d-a999-aa98eb6d91f2</uuid>
Aug 26 09:02:39 user nova-compute[73104]:   <name>instance-00000029</name>
Aug 26 09:02:39 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 09:02:39 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 09:02:39 user nova-compute[73104]:   <metadata>
Aug 26 09:02:39 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 09:02:39 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 09:02:39 user nova-compute[73104]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-636224961</nova:name>
Aug 26 09:02:39 user nova-compute[73104]:       <nova:creationTime>2023-08-26 09:02:38</nova:creationTime>
Aug 26 09:02:39 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 09:02:39 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 09:02:39 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 09:02:39 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 09:02:39 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 09:02:39 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 09:02:39 user nova-compute[73104]:       </nova:flavor>
Aug 26 09:02:39 user nova-compute[73104]:       <nova:owner>
Aug 26 09:02:39 user nova-compute[73104]:         <nova:user uuid="da4b6574d165418eaf2b8c8b84d6151f">tempest-ServerRescueNegativeTestJSON-901062798-project-member</nova:user>
Aug 26 09:02:39 user nova-compute[73104]:         <nova:project uuid="0b7642d165474defadde34dabc11f842">tempest-ServerRescueNegativeTestJSON-901062798</nova:project>
Aug 26 09:02:39 user nova-compute[73104]:       </nova:owner>
Aug 26 09:02:39 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 09:02:39 user nova-compute[73104]:       <nova:ports>
Aug 26 09:02:39 user nova-compute[73104]:         <nova:port uuid="5e91d018-838e-4b87-bd5f-1b5f31c22d5f">
Aug 26 09:02:39 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 09:02:39 user nova-compute[73104]:         </nova:port>
Aug 26 09:02:39 user nova-compute[73104]:       </nova:ports>
Aug 26 09:02:39 user nova-compute[73104]:     </nova:instance>
Aug 26 09:02:39 user nova-compute[73104]:   </metadata>
Aug 26 09:02:39 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 09:02:39 user nova-compute[73104]:     <system>
Aug 26 09:02:39 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 09:02:39 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 09:02:39 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 09:02:39 user nova-compute[73104]:       <entry name="serial">2c10f0ac-f63d-462d-a999-aa98eb6d91f2</entry>
Aug 26 09:02:39 user nova-compute[73104]:       <entry name="uuid">2c10f0ac-f63d-462d-a999-aa98eb6d91f2</entry>
Aug 26 09:02:39 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 09:02:39 user nova-compute[73104]:     </system>
Aug 26 09:02:39 user nova-compute[73104]:   </sysinfo>
Aug 26 09:02:39 user nova-compute[73104]:   <os>
Aug 26 09:02:39 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 09:02:39 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 09:02:39 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 09:02:39 user nova-compute[73104]:   </os>
Aug 26 09:02:39 user nova-compute[73104]:   <features>
Aug 26 09:02:39 user nova-compute[73104]:     <acpi/>
Aug 26 09:02:39 user nova-compute[73104]:     <apic/>
Aug 26 09:02:39 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 09:02:39 user nova-compute[73104]:   </features>
Aug 26 09:02:39 user nova-compute[73104]:   <clock offset="utc">
Aug 26 09:02:39 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 09:02:39 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 09:02:39 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 09:02:39 user nova-compute[73104]:   </clock>
Aug 26 09:02:39 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 09:02:39 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 09:02:39 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 09:02:39 user nova-compute[73104]:   </cpu>
Aug 26 09:02:39 user nova-compute[73104]:   <devices>
Aug 26 09:02:39 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 09:02:39 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 09:02:39 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk"/>
Aug 26 09:02:39 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 09:02:39 user nova-compute[73104]:     </disk>
Aug 26 09:02:39 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 09:02:39 user nova-compute[73104]:       <mac address="fa:16:3e:f0:cc:d7"/>
Aug 26 09:02:39 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:02:39 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 09:02:39 user nova-compute[73104]:       <target dev="tap5e91d018-83"/>
Aug 26 09:02:39 user nova-compute[73104]:     </interface>
Aug 26 09:02:39 user nova-compute[73104]:     <serial type="pty">
Aug 26 09:02:39 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/console.log" append="off"/>
Aug 26 09:02:39 user nova-compute[73104]:     </serial>
Aug 26 09:02:39 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 09:02:39 user nova-compute[73104]:     <video>
Aug 26 09:02:39 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:02:39 user nova-compute[73104]:     </video>
Aug 26 09:02:39 user nova-compute[73104]:     <rng model="virtio">
Aug 26 09:02:39 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 09:02:39 user nova-compute[73104]:     </rng>
Aug 26 09:02:39 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 09:02:39 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 09:02:39 user nova-compute[73104]:       <stats period="10"/>
Aug 26 09:02:39 user nova-compute[73104]:     </memballoon>
Aug 26 09:02:39 user nova-compute[73104]:   </devices>
Aug 26 09:02:39 user nova-compute[73104]: </domain>
Aug 26 09:02:39 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-636224961',display_name='tempest-ServerRescueNegativeTestJSON-server-636224961',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-636224961',id=41,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b7642d165474defadde34dabc11f842',ramdisk_id='',reservation_id='r-dt3wsa96',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-901062798',owner_user_name='tempest-ServerRescueNegativeTestJSON-901062798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:02:36Z,user_data=None,user_id='da4b6574d165418eaf2b8c8b84d6151f',uuid=2c10f0ac-f63d-462d-a999-aa98eb6d91f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "address": "fa:16:3e:f0:cc:d7", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e91d018-83", "ovs_interfaceid": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Converting VIF {"id": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "address": "fa:16:3e:f0:cc:d7", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e91d018-83", "ovs_interfaceid": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:cc:d7,bridge_name='br-int',has_traffic_filtering=True,id=5e91d018-838e-4b87-bd5f-1b5f31c22d5f,network=Network(fb2d19ab-1c79-4529-b058-e1b8c4fc8276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e91d018-83') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG os_vif [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:cc:d7,bridge_name='br-int',has_traffic_filtering=True,id=5e91d018-838e-4b87-bd5f-1b5f31c22d5f,network=Network(fb2d19ab-1c79-4529-b058-e1b8c4fc8276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e91d018-83') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e91d018-83, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5e91d018-83, col_values=(('external_ids', {'iface-id': '5e91d018-838e-4b87-bd5f-1b5f31c22d5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:cc:d7', 'vm-uuid': '2c10f0ac-f63d-462d-a999-aa98eb6d91f2'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:39 user nova-compute[73104]: INFO os_vif [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:cc:d7,bridge_name='br-int',has_traffic_filtering=True,id=5e91d018-838e-4b87-bd5f-1b5f31c22d5f,network=Network(fb2d19ab-1c79-4529-b058-e1b8c4fc8276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e91d018-83')
Aug 26 09:02:39 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] No VIF found with MAC fa:16:3e:f0:cc:d7, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG nova.network.neutron [req-5e934d88-99a1-4996-997d-5067af26d598 req-68109383-f436-4fb7-ad53-d59f2709752a service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Updated VIF entry in instance network info cache for port 5e91d018-838e-4b87-bd5f-1b5f31c22d5f. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG nova.network.neutron [req-5e934d88-99a1-4996-997d-5067af26d598 req-68109383-f436-4fb7-ad53-d59f2709752a service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Updating instance_info_cache with network_info: [{"id": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "address": "fa:16:3e:f0:cc:d7", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e91d018-83", "ovs_interfaceid": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5e934d88-99a1-4996-997d-5067af26d598 req-68109383-f436-4fb7-ad53-d59f2709752a service nova] Releasing lock "refresh_cache-2c10f0ac-f63d-462d-a999-aa98eb6d91f2" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG nova.network.neutron [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Successfully updated port: 52b25498-8470-454f-9cf5-4989ec64751a {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "refresh_cache-432a66be-853d-42d7-8622-0417ef36045c" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquired lock "refresh_cache-432a66be-853d-42d7-8622-0417ef36045c" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG nova.network.neutron [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG nova.compute.manager [req-f096b238-f225-4f88-a655-40bcd396dd90 req-d9c6dccd-8dc2-4607-a27c-a39edd24bd98 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Received event network-changed-52b25498-8470-454f-9cf5-4989ec64751a {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG nova.compute.manager [req-f096b238-f225-4f88-a655-40bcd396dd90 req-d9c6dccd-8dc2-4607-a27c-a39edd24bd98 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Refreshing instance network info cache due to event network-changed-52b25498-8470-454f-9cf5-4989ec64751a. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f096b238-f225-4f88-a655-40bcd396dd90 req-d9c6dccd-8dc2-4607-a27c-a39edd24bd98 service nova] Acquiring lock "refresh_cache-432a66be-853d-42d7-8622-0417ef36045c" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG nova.network.neutron [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 09:02:39 user nova-compute[73104]: DEBUG nova.network.neutron [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Updating instance_info_cache with network_info: [{"id": "52b25498-8470-454f-9cf5-4989ec64751a", "address": "fa:16:3e:76:d4:93", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b25498-84", "ovs_interfaceid": "52b25498-8470-454f-9cf5-4989ec64751a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Releasing lock "refresh_cache-432a66be-853d-42d7-8622-0417ef36045c" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG nova.compute.manager [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Instance network_info: |[{"id": "52b25498-8470-454f-9cf5-4989ec64751a", "address": "fa:16:3e:76:d4:93", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b25498-84", "ovs_interfaceid": "52b25498-8470-454f-9cf5-4989ec64751a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f096b238-f225-4f88-a655-40bcd396dd90 req-d9c6dccd-8dc2-4607-a27c-a39edd24bd98 service nova] Acquired lock "refresh_cache-432a66be-853d-42d7-8622-0417ef36045c" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG nova.network.neutron [req-f096b238-f225-4f88-a655-40bcd396dd90 req-d9c6dccd-8dc2-4607-a27c-a39edd24bd98 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Refreshing network info cache for port 52b25498-8470-454f-9cf5-4989ec64751a {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Start _get_guest_xml network_info=[{"id": "52b25498-8470-454f-9cf5-4989ec64751a", "address": "fa:16:3e:76:d4:93", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b25498-84", "ovs_interfaceid": "52b25498-8470-454f-9cf5-4989ec64751a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 09:02:40 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:02:40 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:02:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:02:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-735563407',display_name='tempest-ServerRescueNegativeTestJSON-server-735563407',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-735563407',id=42,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b7642d165474defadde34dabc11f842',ramdisk_id='',reservation_id='r-xran4wdf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-901062798',owner_user_name='tempest-ServerRescueNegativeTestJSON-901062798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:02:38Z,user_data=None,user_id='da4b6574d165418eaf2b8c8b84d6151f',uuid=432a66be-853d-42d7-8622-0417ef36045c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52b25498-8470-454f-9cf5-4989ec64751a", "address": "fa:16:3e:76:d4:93", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b25498-84", "ovs_interfaceid": "52b25498-8470-454f-9cf5-4989ec64751a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Converting VIF {"id": "52b25498-8470-454f-9cf5-4989ec64751a", "address": "fa:16:3e:76:d4:93", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b25498-84", "ovs_interfaceid": "52b25498-8470-454f-9cf5-4989ec64751a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:d4:93,bridge_name='br-int',has_traffic_filtering=True,id=52b25498-8470-454f-9cf5-4989ec64751a,network=Network(fb2d19ab-1c79-4529-b058-e1b8c4fc8276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52b25498-84') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG nova.objects.instance [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lazy-loading 'pci_devices' on Instance uuid 432a66be-853d-42d7-8622-0417ef36045c {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] End _get_guest_xml xml=<domain type="kvm">
Aug 26 09:02:40 user nova-compute[73104]:   <uuid>432a66be-853d-42d7-8622-0417ef36045c</uuid>
Aug 26 09:02:40 user nova-compute[73104]:   <name>instance-0000002a</name>
Aug 26 09:02:40 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 09:02:40 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 09:02:40 user nova-compute[73104]:   <metadata>
Aug 26 09:02:40 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 09:02:40 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 09:02:40 user nova-compute[73104]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-735563407</nova:name>
Aug 26 09:02:40 user nova-compute[73104]:       <nova:creationTime>2023-08-26 09:02:40</nova:creationTime>
Aug 26 09:02:40 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 09:02:40 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 09:02:40 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 09:02:40 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 09:02:40 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 09:02:40 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 09:02:40 user nova-compute[73104]:       </nova:flavor>
Aug 26 09:02:40 user nova-compute[73104]:       <nova:owner>
Aug 26 09:02:40 user nova-compute[73104]:         <nova:user uuid="da4b6574d165418eaf2b8c8b84d6151f">tempest-ServerRescueNegativeTestJSON-901062798-project-member</nova:user>
Aug 26 09:02:40 user nova-compute[73104]:         <nova:project uuid="0b7642d165474defadde34dabc11f842">tempest-ServerRescueNegativeTestJSON-901062798</nova:project>
Aug 26 09:02:40 user nova-compute[73104]:       </nova:owner>
Aug 26 09:02:40 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 09:02:40 user nova-compute[73104]:       <nova:ports>
Aug 26 09:02:40 user nova-compute[73104]:         <nova:port uuid="52b25498-8470-454f-9cf5-4989ec64751a">
Aug 26 09:02:40 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 09:02:40 user nova-compute[73104]:         </nova:port>
Aug 26 09:02:40 user nova-compute[73104]:       </nova:ports>
Aug 26 09:02:40 user nova-compute[73104]:     </nova:instance>
Aug 26 09:02:40 user nova-compute[73104]:   </metadata>
Aug 26 09:02:40 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 09:02:40 user nova-compute[73104]:     <system>
Aug 26 09:02:40 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 09:02:40 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 09:02:40 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 09:02:40 user nova-compute[73104]:       <entry name="serial">432a66be-853d-42d7-8622-0417ef36045c</entry>
Aug 26 09:02:40 user nova-compute[73104]:       <entry name="uuid">432a66be-853d-42d7-8622-0417ef36045c</entry>
Aug 26 09:02:40 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 09:02:40 user nova-compute[73104]:     </system>
Aug 26 09:02:40 user nova-compute[73104]:   </sysinfo>
Aug 26 09:02:40 user nova-compute[73104]:   <os>
Aug 26 09:02:40 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 09:02:40 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 09:02:40 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 09:02:40 user nova-compute[73104]:   </os>
Aug 26 09:02:40 user nova-compute[73104]:   <features>
Aug 26 09:02:40 user nova-compute[73104]:     <acpi/>
Aug 26 09:02:40 user nova-compute[73104]:     <apic/>
Aug 26 09:02:40 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 09:02:40 user nova-compute[73104]:   </features>
Aug 26 09:02:40 user nova-compute[73104]:   <clock offset="utc">
Aug 26 09:02:40 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 09:02:40 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 09:02:40 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 09:02:40 user nova-compute[73104]:   </clock>
Aug 26 09:02:40 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 09:02:40 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 09:02:40 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 09:02:40 user nova-compute[73104]:   </cpu>
Aug 26 09:02:40 user nova-compute[73104]:   <devices>
Aug 26 09:02:40 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 09:02:40 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 09:02:40 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk"/>
Aug 26 09:02:40 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 09:02:40 user nova-compute[73104]:     </disk>
Aug 26 09:02:40 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 09:02:40 user nova-compute[73104]:       <mac address="fa:16:3e:76:d4:93"/>
Aug 26 09:02:40 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:02:40 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 09:02:40 user nova-compute[73104]:       <target dev="tap52b25498-84"/>
Aug 26 09:02:40 user nova-compute[73104]:     </interface>
Aug 26 09:02:40 user nova-compute[73104]:     <serial type="pty">
Aug 26 09:02:40 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/console.log" append="off"/>
Aug 26 09:02:40 user nova-compute[73104]:     </serial>
Aug 26 09:02:40 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 09:02:40 user nova-compute[73104]:     <video>
Aug 26 09:02:40 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:02:40 user nova-compute[73104]:     </video>
Aug 26 09:02:40 user nova-compute[73104]:     <rng model="virtio">
Aug 26 09:02:40 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 09:02:40 user nova-compute[73104]:     </rng>
Aug 26 09:02:40 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 09:02:40 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 09:02:40 user nova-compute[73104]:       <stats period="10"/>
Aug 26 09:02:40 user nova-compute[73104]:     </memballoon>
Aug 26 09:02:40 user nova-compute[73104]:   </devices>
Aug 26 09:02:40 user nova-compute[73104]: </domain>
Aug 26 09:02:40 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:02:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-735563407',display_name='tempest-ServerRescueNegativeTestJSON-server-735563407',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-735563407',id=42,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b7642d165474defadde34dabc11f842',ramdisk_id='',reservation_id='r-xran4wdf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-901062798',owner_user_name='tempest-ServerRescueNegativeTestJSON-901062798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:02:38Z,user_data=None,user_id='da4b6574d165418eaf2b8c8b84d6151f',uuid=432a66be-853d-42d7-8622-0417ef36045c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52b25498-8470-454f-9cf5-4989ec64751a", "address": "fa:16:3e:76:d4:93", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b25498-84", "ovs_interfaceid": "52b25498-8470-454f-9cf5-4989ec64751a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Converting VIF {"id": "52b25498-8470-454f-9cf5-4989ec64751a", "address": "fa:16:3e:76:d4:93", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b25498-84", "ovs_interfaceid": "52b25498-8470-454f-9cf5-4989ec64751a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:d4:93,bridge_name='br-int',has_traffic_filtering=True,id=52b25498-8470-454f-9cf5-4989ec64751a,network=Network(fb2d19ab-1c79-4529-b058-e1b8c4fc8276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52b25498-84') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG os_vif [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:d4:93,bridge_name='br-int',has_traffic_filtering=True,id=52b25498-8470-454f-9cf5-4989ec64751a,network=Network(fb2d19ab-1c79-4529-b058-e1b8c4fc8276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52b25498-84') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52b25498-84, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap52b25498-84, col_values=(('external_ids', {'iface-id': '52b25498-8470-454f-9cf5-4989ec64751a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:d4:93', 'vm-uuid': '432a66be-853d-42d7-8622-0417ef36045c'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:40 user nova-compute[73104]: INFO os_vif [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:d4:93,bridge_name='br-int',has_traffic_filtering=True,id=52b25498-8470-454f-9cf5-4989ec64751a,network=Network(fb2d19ab-1c79-4529-b058-e1b8c4fc8276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52b25498-84')
Aug 26 09:02:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] No VIF found with MAC fa:16:3e:76:d4:93, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG nova.network.neutron [req-f096b238-f225-4f88-a655-40bcd396dd90 req-d9c6dccd-8dc2-4607-a27c-a39edd24bd98 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Updated VIF entry in instance network info cache for port 52b25498-8470-454f-9cf5-4989ec64751a. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG nova.network.neutron [req-f096b238-f225-4f88-a655-40bcd396dd90 req-d9c6dccd-8dc2-4607-a27c-a39edd24bd98 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Updating instance_info_cache with network_info: [{"id": "52b25498-8470-454f-9cf5-4989ec64751a", "address": "fa:16:3e:76:d4:93", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b25498-84", "ovs_interfaceid": "52b25498-8470-454f-9cf5-4989ec64751a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f096b238-f225-4f88-a655-40bcd396dd90 req-d9c6dccd-8dc2-4607-a27c-a39edd24bd98 service nova] Releasing lock "refresh_cache-432a66be-853d-42d7-8622-0417ef36045c" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:41 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:41 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:41 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:41 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:41 user nova-compute[73104]: DEBUG nova.compute.manager [req-cdf18cc2-152e-4532-8357-af4f014dc062 req-a9e12294-e39f-4fe6-ab25-2cc613592fd8 service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Received event network-vif-plugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:02:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-cdf18cc2-152e-4532-8357-af4f014dc062 req-a9e12294-e39f-4fe6-ab25-2cc613592fd8 service nova] Acquiring lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-cdf18cc2-152e-4532-8357-af4f014dc062 req-a9e12294-e39f-4fe6-ab25-2cc613592fd8 service nova] Lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-cdf18cc2-152e-4532-8357-af4f014dc062 req-a9e12294-e39f-4fe6-ab25-2cc613592fd8 service nova] Lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:41 user nova-compute[73104]: DEBUG nova.compute.manager [req-cdf18cc2-152e-4532-8357-af4f014dc062 req-a9e12294-e39f-4fe6-ab25-2cc613592fd8 service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] No waiting events found dispatching network-vif-plugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:02:41 user nova-compute[73104]: WARNING nova.compute.manager [req-cdf18cc2-152e-4532-8357-af4f014dc062 req-a9e12294-e39f-4fe6-ab25-2cc613592fd8 service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Received unexpected event network-vif-plugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f for instance with vm_state building and task_state spawning.
Aug 26 09:02:41 user nova-compute[73104]: DEBUG nova.compute.manager [req-cdf18cc2-152e-4532-8357-af4f014dc062 req-a9e12294-e39f-4fe6-ab25-2cc613592fd8 service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Received event network-vif-plugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:02:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-cdf18cc2-152e-4532-8357-af4f014dc062 req-a9e12294-e39f-4fe6-ab25-2cc613592fd8 service nova] Acquiring lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-cdf18cc2-152e-4532-8357-af4f014dc062 req-a9e12294-e39f-4fe6-ab25-2cc613592fd8 service nova] Lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-cdf18cc2-152e-4532-8357-af4f014dc062 req-a9e12294-e39f-4fe6-ab25-2cc613592fd8 service nova] Lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:41 user nova-compute[73104]: DEBUG nova.compute.manager [req-cdf18cc2-152e-4532-8357-af4f014dc062 req-a9e12294-e39f-4fe6-ab25-2cc613592fd8 service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] No waiting events found dispatching network-vif-plugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:02:41 user nova-compute[73104]: WARNING nova.compute.manager [req-cdf18cc2-152e-4532-8357-af4f014dc062 req-a9e12294-e39f-4fe6-ab25-2cc613592fd8 service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Received unexpected event network-vif-plugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f for instance with vm_state building and task_state spawning.
Aug 26 09:02:41 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:42 user nova-compute[73104]: DEBUG nova.compute.manager [req-820d71ed-8959-4ead-bc24-c1c01dd93076 req-c2ede6a1-7495-4b12-9f30-d4327b31ff75 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Received event network-vif-plugged-52b25498-8470-454f-9cf5-4989ec64751a {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:02:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-820d71ed-8959-4ead-bc24-c1c01dd93076 req-c2ede6a1-7495-4b12-9f30-d4327b31ff75 service nova] Acquiring lock "432a66be-853d-42d7-8622-0417ef36045c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-820d71ed-8959-4ead-bc24-c1c01dd93076 req-c2ede6a1-7495-4b12-9f30-d4327b31ff75 service nova] Lock "432a66be-853d-42d7-8622-0417ef36045c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-820d71ed-8959-4ead-bc24-c1c01dd93076 req-c2ede6a1-7495-4b12-9f30-d4327b31ff75 service nova] Lock "432a66be-853d-42d7-8622-0417ef36045c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:42 user nova-compute[73104]: DEBUG nova.compute.manager [req-820d71ed-8959-4ead-bc24-c1c01dd93076 req-c2ede6a1-7495-4b12-9f30-d4327b31ff75 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] No waiting events found dispatching network-vif-plugged-52b25498-8470-454f-9cf5-4989ec64751a {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:02:42 user nova-compute[73104]: WARNING nova.compute.manager [req-820d71ed-8959-4ead-bc24-c1c01dd93076 req-c2ede6a1-7495-4b12-9f30-d4327b31ff75 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Received unexpected event network-vif-plugged-52b25498-8470-454f-9cf5-4989ec64751a for instance with vm_state building and task_state spawning.
Aug 26 09:02:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:44 user nova-compute[73104]: DEBUG nova.compute.manager [req-f5ba30bb-eb4f-4498-b7e4-a055c7176e42 req-be4c0f4b-1631-494f-aaf6-2aaa6bb95236 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Received event network-vif-plugged-52b25498-8470-454f-9cf5-4989ec64751a {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:02:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f5ba30bb-eb4f-4498-b7e4-a055c7176e42 req-be4c0f4b-1631-494f-aaf6-2aaa6bb95236 service nova] Acquiring lock "432a66be-853d-42d7-8622-0417ef36045c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f5ba30bb-eb4f-4498-b7e4-a055c7176e42 req-be4c0f4b-1631-494f-aaf6-2aaa6bb95236 service nova] Lock "432a66be-853d-42d7-8622-0417ef36045c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f5ba30bb-eb4f-4498-b7e4-a055c7176e42 req-be4c0f4b-1631-494f-aaf6-2aaa6bb95236 service nova] Lock "432a66be-853d-42d7-8622-0417ef36045c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:44 user nova-compute[73104]: DEBUG nova.compute.manager [req-f5ba30bb-eb4f-4498-b7e4-a055c7176e42 req-be4c0f4b-1631-494f-aaf6-2aaa6bb95236 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] No waiting events found dispatching network-vif-plugged-52b25498-8470-454f-9cf5-4989ec64751a {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:02:44 user nova-compute[73104]: WARNING nova.compute.manager [req-f5ba30bb-eb4f-4498-b7e4-a055c7176e42 req-be4c0f4b-1631-494f-aaf6-2aaa6bb95236 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Received unexpected event network-vif-plugged-52b25498-8470-454f-9cf5-4989ec64751a for instance with vm_state building and task_state spawning.
Aug 26 09:02:44 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040564.748458, 432a66be-853d-42d7-8622-0417ef36045c => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:02:44 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 432a66be-853d-42d7-8622-0417ef36045c] VM Resumed (Lifecycle Event)
Aug 26 09:02:44 user nova-compute[73104]: DEBUG nova.compute.manager [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 09:02:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 09:02:44 user nova-compute[73104]: DEBUG nova.compute.manager [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 09:02:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 09:02:44 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Instance spawned successfully.
Aug 26 09:02:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 09:02:44 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Instance spawned successfully.
Aug 26 09:02:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 09:02:44 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:02:44 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:02:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:02:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:02:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:02:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:02:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:02:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:02:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:02:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:02:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:02:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:02:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:02:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:02:44 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 432a66be-853d-42d7-8622-0417ef36045c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 09:02:44 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040564.749527, 432a66be-853d-42d7-8622-0417ef36045c => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:02:44 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 432a66be-853d-42d7-8622-0417ef36045c] VM Started (Lifecycle Event)
Aug 26 09:02:44 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:02:44 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:02:44 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 432a66be-853d-42d7-8622-0417ef36045c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 09:02:44 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040564.7531168, 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:02:44 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] VM Resumed (Lifecycle Event)
Aug 26 09:02:44 user nova-compute[73104]: INFO nova.compute.manager [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Took 8.68 seconds to spawn the instance on the hypervisor.
Aug 26 09:02:44 user nova-compute[73104]: DEBUG nova.compute.manager [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:02:44 user nova-compute[73104]: INFO nova.compute.manager [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Took 7.24 seconds to spawn the instance on the hypervisor.
Aug 26 09:02:44 user nova-compute[73104]: DEBUG nova.compute.manager [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:02:44 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:02:44 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:02:44 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 09:02:44 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040564.754862, 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:02:44 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] VM Started (Lifecycle Event)
Aug 26 09:02:44 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:02:44 user nova-compute[73104]: INFO nova.compute.manager [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Took 8.03 seconds to build instance.
Aug 26 09:02:44 user nova-compute[73104]: INFO nova.compute.manager [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Took 9.44 seconds to build instance.
Aug 26 09:02:44 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:02:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-df540c0e-e205-4444-a586-6e382bec7919 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "432a66be-853d-42d7-8622-0417ef36045c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.186s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5aff970f-49ff-4c11-a445-5ec8a357dfae tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.599s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "bef1e493-6b2c-4688-98c2-647261feb571" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "bef1e493-6b2c-4688-98c2-647261feb571" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "bef1e493-6b2c-4688-98c2-647261feb571-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "bef1e493-6b2c-4688-98c2-647261feb571-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "bef1e493-6b2c-4688-98c2-647261feb571-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:46 user nova-compute[73104]: INFO nova.compute.manager [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Terminating instance
Aug 26 09:02:46 user nova-compute[73104]: DEBUG nova.compute.manager [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 09:02:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG nova.compute.manager [req-03f9a217-b6d5-4b23-b5d1-3ec469cabab4 req-f244b996-d370-4a95-a201-e9bda236cec3 service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Received event network-vif-unplugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-03f9a217-b6d5-4b23-b5d1-3ec469cabab4 req-f244b996-d370-4a95-a201-e9bda236cec3 service nova] Acquiring lock "bef1e493-6b2c-4688-98c2-647261feb571-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-03f9a217-b6d5-4b23-b5d1-3ec469cabab4 req-f244b996-d370-4a95-a201-e9bda236cec3 service nova] Lock "bef1e493-6b2c-4688-98c2-647261feb571-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-03f9a217-b6d5-4b23-b5d1-3ec469cabab4 req-f244b996-d370-4a95-a201-e9bda236cec3 service nova] Lock "bef1e493-6b2c-4688-98c2-647261feb571-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG nova.compute.manager [req-03f9a217-b6d5-4b23-b5d1-3ec469cabab4 req-f244b996-d370-4a95-a201-e9bda236cec3 service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] No waiting events found dispatching network-vif-unplugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG nova.compute.manager [req-03f9a217-b6d5-4b23-b5d1-3ec469cabab4 req-f244b996-d370-4a95-a201-e9bda236cec3 service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Received event network-vif-unplugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:02:47 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Instance destroyed successfully.
Aug 26 09:02:47 user nova-compute[73104]: DEBUG nova.objects.instance [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lazy-loading 'resources' on Instance uuid bef1e493-6b2c-4688-98c2-647261feb571 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1620831996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1620831996',id=24,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:48:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a37356203d547c2abf0aa634c2ad548',ramdisk_id='',reservation_id='r-4p9y2cyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1111216102',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:50:46Z,user_data=None,user_id='bcd11beb7046440f814cbf4a13ab0272',uuid=bef1e493-6b2c-4688-98c2-647261feb571,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ddebd25-cfe6-4b0e-8b2d-746fae9f8685", "address": "fa:16:3e:03:fd:b2", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddebd25-cf", "ovs_interfaceid": "6ddebd25-cfe6-4b0e-8b2d-746fae9f8685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Converting VIF {"id": "6ddebd25-cfe6-4b0e-8b2d-746fae9f8685", "address": "fa:16:3e:03:fd:b2", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddebd25-cf", "ovs_interfaceid": "6ddebd25-cfe6-4b0e-8b2d-746fae9f8685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:fd:b2,bridge_name='br-int',has_traffic_filtering=True,id=6ddebd25-cfe6-4b0e-8b2d-746fae9f8685,network=Network(ce0a529c-2119-4b2a-a08f-567e3671c3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddebd25-cf') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG os_vif [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:fd:b2,bridge_name='br-int',has_traffic_filtering=True,id=6ddebd25-cfe6-4b0e-8b2d-746fae9f8685,network=Network(ce0a529c-2119-4b2a-a08f-567e3671c3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddebd25-cf') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ddebd25-cf, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:02:47 user nova-compute[73104]: INFO os_vif [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:fd:b2,bridge_name='br-int',has_traffic_filtering=True,id=6ddebd25-cfe6-4b0e-8b2d-746fae9f8685,network=Network(ce0a529c-2119-4b2a-a08f-567e3671c3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddebd25-cf')
Aug 26 09:02:47 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Anmyhrti', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:02:47 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:02:47 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88cd060-8be6-439c-9f83-f968df15d07d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[386a6415-c135-47c1-8165-6262edfd591d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 09:02:47 user nova-compute[73104]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:02:47 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 (non-flash)
Aug 26 09:02:47 user nova-compute[73104]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:02:47 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b4796710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372'): ({'sdb'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Removing single pathed devices sdb {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7ee8aa-fea8-4e47-8868-e8f73813165a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff40f0c3-dda0-4244-919d-bfc0541a7cc9]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Flushing IO for device /dev/sdb {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d08dd7a-fb88-48ed-96d7-68c83f3350fa]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a11c3e-dcda-409e-9057-acc619c47bce]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d6619f-efcb-4a7c-9191-13cd939c7d5e]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:02:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:48 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[12676c8f-21f2-4f9b-89c5-1563eef1cef2]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:02:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372, portal: 172.16.0.220,3260]
Aug 26 09:02:48 user nova-compute[73104]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372, portal: 172.16.0.220,3260] successful.
Aug 26 09:02:48 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:02:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:02:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad797845-bc66-4e30-a209-353015b67372 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:02:48 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f54df5-9197-4b6f-9172-afc3e8637eaa]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:02:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:02:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:02:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] <== disconnect_volume: return (321ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:02:48 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 09:02:48 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Deleting instance files /opt/stack/data/nova/instances/bef1e493-6b2c-4688-98c2-647261feb571_del
Aug 26 09:02:48 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Deletion of /opt/stack/data/nova/instances/bef1e493-6b2c-4688-98c2-647261feb571_del complete
Aug 26 09:02:48 user nova-compute[73104]: INFO nova.compute.manager [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Took 1.27 seconds to destroy the instance on the hypervisor.
Aug 26 09:02:48 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 09:02:48 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 09:02:48 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: bef1e493-6b2c-4688-98c2-647261feb571] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 09:02:48 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:02:48 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Took 0.54 seconds to deallocate network for instance.
Aug 26 09:02:48 user nova-compute[73104]: DEBUG nova.compute.manager [req-3caaa288-74e8-4b91-b215-dc4141f225b6 req-db87a3c0-cd45-4bdd-9466-11778756bcc6 service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Received event network-vif-deleted-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:02:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-641aa3e7-7759-4760-b014-324b16175a29 req-0887d15c-39a1-40c4-a391-5f6b8adca022 service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Received event network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:02:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-641aa3e7-7759-4760-b014-324b16175a29 req-0887d15c-39a1-40c4-a391-5f6b8adca022 service nova] Acquiring lock "bef1e493-6b2c-4688-98c2-647261feb571-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-641aa3e7-7759-4760-b014-324b16175a29 req-0887d15c-39a1-40c4-a391-5f6b8adca022 service nova] Lock "bef1e493-6b2c-4688-98c2-647261feb571-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-641aa3e7-7759-4760-b014-324b16175a29 req-0887d15c-39a1-40c4-a391-5f6b8adca022 service nova] Lock "bef1e493-6b2c-4688-98c2-647261feb571-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-641aa3e7-7759-4760-b014-324b16175a29 req-0887d15c-39a1-40c4-a391-5f6b8adca022 service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] No waiting events found dispatching network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:02:49 user nova-compute[73104]: WARNING nova.compute.manager [req-641aa3e7-7759-4760-b014-324b16175a29 req-0887d15c-39a1-40c4-a391-5f6b8adca022 service nova] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Received unexpected event network-vif-plugged-6ddebd25-cfe6-4b0e-8b2d-746fae9f8685 for instance with vm_state active and task_state deleting.
Aug 26 09:02:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:49 user nova-compute[73104]: INFO nova.compute.manager [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Took 1.22 seconds to detach 1 volumes for instance.
Aug 26 09:02:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:02:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:02:50 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:02:50 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:02:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:50 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Deleted allocations for instance bef1e493-6b2c-4688-98c2-647261feb571
Aug 26 09:02:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ed84184b-8af1-4914-bdc0-d441d963a930 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "bef1e493-6b2c-4688-98c2-647261feb571" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.522s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:02:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:02:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:03:02 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693040567.6308146, bef1e493-6b2c-4688-98c2-647261feb571 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:03:02 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: bef1e493-6b2c-4688-98c2-647261feb571] VM Stopped (Lifecycle Event)
Aug 26 09:03:02 user nova-compute[73104]: DEBUG nova.compute.manager [None req-9bb4155e-9c17-4085-873e-8023bf6a71c6 None None] [instance: bef1e493-6b2c-4688-98c2-647261feb571] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:03:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:03:04 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:03:04 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:03:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:03:05 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:03:05 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:03:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:03:08 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:03:08 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:03:08 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73104) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 09:03:09 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:03:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:03:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:03:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:03:09 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:03:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:03:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:03:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:03:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:03:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:03:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:03:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:03:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:03:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:03:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:03:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:03:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:03:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:03:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e259e21c-3a8b-4ffd-880d-1fb29a2ef64f/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:03:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e259e21c-3a8b-4ffd-880d-1fb29a2ef64f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:03:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e259e21c-3a8b-4ffd-880d-1fb29a2ef64f/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:03:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e259e21c-3a8b-4ffd-880d-1fb29a2ef64f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:03:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/093c5d6f-c4ab-470e-86f6-7434295555aa/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:03:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/093c5d6f-c4ab-470e-86f6-7434295555aa/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:03:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/093c5d6f-c4ab-470e-86f6-7434295555aa/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:03:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/093c5d6f-c4ab-470e-86f6-7434295555aa/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:03:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 09:03:11 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:03:11 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:03:11 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=7841MB free_disk=23.990089416503906GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:03:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:03:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:03:12 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 3cf85d2f-de0d-4e9b-a534-98c799ae8db9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:03:12 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 56e8f70f-f077-41a7-9cbd-749c40ec0a23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:03:12 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance e259e21c-3a8b-4ffd-880d-1fb29a2ef64f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:03:12 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 093c5d6f-c4ab-470e-86f6-7434295555aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:03:12 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:03:12 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 432a66be-853d-42d7-8622-0417ef36045c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:03:12 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:03:12 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:03:12 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Refreshing inventories for resource provider 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 09:03:12 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Updating ProviderTree inventory for provider 8a2a2397-4d47-4524-8146-84db4225a812 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 09:03:12 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Updating inventory in ProviderTree for provider 8a2a2397-4d47-4524-8146-84db4225a812 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 09:03:12 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Refreshing aggregate associations for resource provider 8a2a2397-4d47-4524-8146-84db4225a812, aggregates: None {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 09:03:12 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Refreshing trait associations for resource provider 8a2a2397-4d47-4524-8146-84db4225a812, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 09:03:12 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:03:12 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:03:12 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:03:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.566s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:03:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:03:13 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:03:13 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:03:13 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:03:13 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Didn't find any instances for network info cache update. {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 09:03:13 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:03:13 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:03:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:03:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:03:18 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:03:18 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:03:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:03:22 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:03:22 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Cleaning up deleted instances {{(pid=73104) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 09:03:22 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] There are 0 instances to clean {{(pid=73104) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 09:03:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:03:27 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:03:27 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Triggering sync for uuid 3cf85d2f-de0d-4e9b-a534-98c799ae8db9 {{(pid=73104) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 09:03:27 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Triggering sync for uuid 56e8f70f-f077-41a7-9cbd-749c40ec0a23 {{(pid=73104) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 09:03:27 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Triggering sync for uuid e259e21c-3a8b-4ffd-880d-1fb29a2ef64f {{(pid=73104) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 09:03:27 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Triggering sync for uuid 093c5d6f-c4ab-470e-86f6-7434295555aa {{(pid=73104) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 09:03:27 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Triggering sync for uuid 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 {{(pid=73104) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 09:03:27 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Triggering sync for uuid 432a66be-853d-42d7-8622-0417ef36045c {{(pid=73104) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 09:03:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:03:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:03:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "56e8f70f-f077-41a7-9cbd-749c40ec0a23" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:03:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "56e8f70f-f077-41a7-9cbd-749c40ec0a23" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:03:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:03:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:03:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "093c5d6f-c4ab-470e-86f6-7434295555aa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:03:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "093c5d6f-c4ab-470e-86f6-7434295555aa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:03:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:03:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:03:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "432a66be-853d-42d7-8622-0417ef36045c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:03:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "432a66be-853d-42d7-8622-0417ef36045c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:03:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "56e8f70f-f077-41a7-9cbd-749c40ec0a23" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:03:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:03:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:03:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:03:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "093c5d6f-c4ab-470e-86f6-7434295555aa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:03:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "432a66be-853d-42d7-8622-0417ef36045c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:03:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:03:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:03:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c6a9f6ac-4999-4aa7-b2f4-6a71ee4f2ba8 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:03:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c6a9f6ac-4999-4aa7-b2f4-6a71ee4f2ba8 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:03:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c6a9f6ac-4999-4aa7-b2f4-6a71ee4f2ba8 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:03:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c6a9f6ac-4999-4aa7-b2f4-6a71ee4f2ba8 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:03:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c6a9f6ac-4999-4aa7-b2f4-6a71ee4f2ba8 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:03:37 user nova-compute[73104]: INFO nova.compute.manager [None req-c6a9f6ac-4999-4aa7-b2f4-6a71ee4f2ba8 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Terminating instance
Aug 26 09:03:37 user nova-compute[73104]: DEBUG nova.compute.manager [None req-c6a9f6ac-4999-4aa7-b2f4-6a71ee4f2ba8 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 09:03:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:03:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:03:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:03:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:03:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:03:37 user nova-compute[73104]: DEBUG nova.compute.manager [req-224dab97-057d-4e74-b16b-6b812ee6dcae req-a1adcb9b-1090-4fb4-81ba-859779e4e063 service nova] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Received event network-vif-unplugged-1ff011d7-db1c-4bac-a2d3-ecf253085265 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:03:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-224dab97-057d-4e74-b16b-6b812ee6dcae req-a1adcb9b-1090-4fb4-81ba-859779e4e063 service nova] Acquiring lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:03:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-224dab97-057d-4e74-b16b-6b812ee6dcae req-a1adcb9b-1090-4fb4-81ba-859779e4e063 service nova] Lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:03:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-224dab97-057d-4e74-b16b-6b812ee6dcae req-a1adcb9b-1090-4fb4-81ba-859779e4e063 service nova] Lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:03:37 user nova-compute[73104]: DEBUG nova.compute.manager [req-224dab97-057d-4e74-b16b-6b812ee6dcae req-a1adcb9b-1090-4fb4-81ba-859779e4e063 service nova] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] No waiting events found dispatching network-vif-unplugged-1ff011d7-db1c-4bac-a2d3-ecf253085265 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:03:37 user nova-compute[73104]: DEBUG nova.compute.manager [req-224dab97-057d-4e74-b16b-6b812ee6dcae req-a1adcb9b-1090-4fb4-81ba-859779e4e063 service nova] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Received event network-vif-unplugged-1ff011d7-db1c-4bac-a2d3-ecf253085265 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 09:03:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:03:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:03:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:03:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:03:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:03:38 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Instance destroyed successfully.
Aug 26 09:03:38 user nova-compute[73104]: DEBUG nova.objects.instance [None req-c6a9f6ac-4999-4aa7-b2f4-6a71ee4f2ba8 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lazy-loading 'resources' on Instance uuid 3cf85d2f-de0d-4e9b-a534-98c799ae8db9 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:03:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-c6a9f6ac-4999-4aa7-b2f4-6a71ee4f2ba8 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T08:43:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1255899903',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1255899903',id=19,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T08:43:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a37356203d547c2abf0aa634c2ad548',ramdisk_id='',reservation_id='r-540hullf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1111216102',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T08:45:05Z,user_data=None,user_id='bcd11beb7046440f814cbf4a13ab0272',uuid=3cf85d2f-de0d-4e9b-a534-98c799ae8db9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ff011d7-db1c-4bac-a2d3-ecf253085265", "address": "fa:16:3e:72:e3:65", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff011d7-db", "ovs_interfaceid": "1ff011d7-db1c-4bac-a2d3-ecf253085265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 09:03:38 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-c6a9f6ac-4999-4aa7-b2f4-6a71ee4f2ba8 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Converting VIF {"id": "1ff011d7-db1c-4bac-a2d3-ecf253085265", "address": "fa:16:3e:72:e3:65", "network": {"id": "ce0a529c-2119-4b2a-a08f-567e3671c3b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-434940547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a37356203d547c2abf0aa634c2ad548", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff011d7-db", "ovs_interfaceid": "1ff011d7-db1c-4bac-a2d3-ecf253085265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:03:38 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-c6a9f6ac-4999-4aa7-b2f4-6a71ee4f2ba8 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:e3:65,bridge_name='br-int',has_traffic_filtering=True,id=1ff011d7-db1c-4bac-a2d3-ecf253085265,network=Network(ce0a529c-2119-4b2a-a08f-567e3671c3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ff011d7-db') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:03:38 user nova-compute[73104]: DEBUG os_vif [None req-c6a9f6ac-4999-4aa7-b2f4-6a71ee4f2ba8 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:e3:65,bridge_name='br-int',has_traffic_filtering=True,id=1ff011d7-db1c-4bac-a2d3-ecf253085265,network=Network(ce0a529c-2119-4b2a-a08f-567e3671c3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ff011d7-db') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 09:03:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:03:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ff011d7-db, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:03:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:03:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:03:38 user nova-compute[73104]: INFO os_vif [None req-c6a9f6ac-4999-4aa7-b2f4-6a71ee4f2ba8 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:e3:65,bridge_name='br-int',has_traffic_filtering=True,id=1ff011d7-db1c-4bac-a2d3-ecf253085265,network=Network(ce0a529c-2119-4b2a-a08f-567e3671c3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ff011d7-db')
Aug 26 09:03:38 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-c6a9f6ac-4999-4aa7-b2f4-6a71ee4f2ba8 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Deleting instance files /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9_del
Aug 26 09:03:38 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-c6a9f6ac-4999-4aa7-b2f4-6a71ee4f2ba8 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Deletion of /opt/stack/data/nova/instances/3cf85d2f-de0d-4e9b-a534-98c799ae8db9_del complete
Aug 26 09:03:38 user nova-compute[73104]: INFO nova.compute.manager [None req-c6a9f6ac-4999-4aa7-b2f4-6a71ee4f2ba8 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 26 09:03:38 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-c6a9f6ac-4999-4aa7-b2f4-6a71ee4f2ba8 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 09:03:38 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 09:03:38 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 09:03:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:03:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:03:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:03:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:03:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:03:39 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:03:39 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Took 0.83 seconds to deallocate network for instance.
Aug 26 09:03:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c6a9f6ac-4999-4aa7-b2f4-6a71ee4f2ba8 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:03:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c6a9f6ac-4999-4aa7-b2f4-6a71ee4f2ba8 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:03:39 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-c6a9f6ac-4999-4aa7-b2f4-6a71ee4f2ba8 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:03:39 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-c6a9f6ac-4999-4aa7-b2f4-6a71ee4f2ba8 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:03:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c6a9f6ac-4999-4aa7-b2f4-6a71ee4f2ba8 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.256s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:03:39 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-c6a9f6ac-4999-4aa7-b2f4-6a71ee4f2ba8 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Deleted allocations for instance 3cf85d2f-de0d-4e9b-a534-98c799ae8db9
Aug 26 09:03:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c6a9f6ac-4999-4aa7-b2f4-6a71ee4f2ba8 tempest-ServerBootFromVolumeStableRescueTest-1111216102 tempest-ServerBootFromVolumeStableRescueTest-1111216102-project-member] Lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.199s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:03:40 user nova-compute[73104]: DEBUG nova.compute.manager [req-5824794e-1c4d-4f8a-96c5-099cc08020e9 req-f4b4734f-1eb3-467a-bef7-45b93fc4d416 service nova] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Received event network-vif-plugged-1ff011d7-db1c-4bac-a2d3-ecf253085265 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:03:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5824794e-1c4d-4f8a-96c5-099cc08020e9 req-f4b4734f-1eb3-467a-bef7-45b93fc4d416 service nova] Acquiring lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:03:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5824794e-1c4d-4f8a-96c5-099cc08020e9 req-f4b4734f-1eb3-467a-bef7-45b93fc4d416 service nova] Lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:03:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5824794e-1c4d-4f8a-96c5-099cc08020e9 req-f4b4734f-1eb3-467a-bef7-45b93fc4d416 service nova] Lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:03:40 user nova-compute[73104]: DEBUG nova.compute.manager [req-5824794e-1c4d-4f8a-96c5-099cc08020e9 req-f4b4734f-1eb3-467a-bef7-45b93fc4d416 service nova] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] No waiting events found dispatching network-vif-plugged-1ff011d7-db1c-4bac-a2d3-ecf253085265 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:03:40 user nova-compute[73104]: WARNING nova.compute.manager [req-5824794e-1c4d-4f8a-96c5-099cc08020e9 req-f4b4734f-1eb3-467a-bef7-45b93fc4d416 service nova] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Received unexpected event network-vif-plugged-1ff011d7-db1c-4bac-a2d3-ecf253085265 for instance with vm_state deleted and task_state None.
Aug 26 09:03:40 user nova-compute[73104]: DEBUG nova.compute.manager [req-5824794e-1c4d-4f8a-96c5-099cc08020e9 req-f4b4734f-1eb3-467a-bef7-45b93fc4d416 service nova] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Received event network-vif-plugged-1ff011d7-db1c-4bac-a2d3-ecf253085265 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:03:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5824794e-1c4d-4f8a-96c5-099cc08020e9 req-f4b4734f-1eb3-467a-bef7-45b93fc4d416 service nova] Acquiring lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:03:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5824794e-1c4d-4f8a-96c5-099cc08020e9 req-f4b4734f-1eb3-467a-bef7-45b93fc4d416 service nova] Lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:03:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5824794e-1c4d-4f8a-96c5-099cc08020e9 req-f4b4734f-1eb3-467a-bef7-45b93fc4d416 service nova] Lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:03:40 user nova-compute[73104]: DEBUG nova.compute.manager [req-5824794e-1c4d-4f8a-96c5-099cc08020e9 req-f4b4734f-1eb3-467a-bef7-45b93fc4d416 service nova] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] No waiting events found dispatching network-vif-plugged-1ff011d7-db1c-4bac-a2d3-ecf253085265 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:03:40 user nova-compute[73104]: WARNING nova.compute.manager [req-5824794e-1c4d-4f8a-96c5-099cc08020e9 req-f4b4734f-1eb3-467a-bef7-45b93fc4d416 service nova] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Received unexpected event network-vif-plugged-1ff011d7-db1c-4bac-a2d3-ecf253085265 for instance with vm_state deleted and task_state None.
Aug 26 09:03:40 user nova-compute[73104]: DEBUG nova.compute.manager [req-5824794e-1c4d-4f8a-96c5-099cc08020e9 req-f4b4734f-1eb3-467a-bef7-45b93fc4d416 service nova] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Received event network-vif-plugged-1ff011d7-db1c-4bac-a2d3-ecf253085265 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:03:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5824794e-1c4d-4f8a-96c5-099cc08020e9 req-f4b4734f-1eb3-467a-bef7-45b93fc4d416 service nova] Acquiring lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:03:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5824794e-1c4d-4f8a-96c5-099cc08020e9 req-f4b4734f-1eb3-467a-bef7-45b93fc4d416 service nova] Lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:03:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5824794e-1c4d-4f8a-96c5-099cc08020e9 req-f4b4734f-1eb3-467a-bef7-45b93fc4d416 service nova] Lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:03:40 user nova-compute[73104]: DEBUG nova.compute.manager [req-5824794e-1c4d-4f8a-96c5-099cc08020e9 req-f4b4734f-1eb3-467a-bef7-45b93fc4d416 service nova] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] No waiting events found dispatching network-vif-plugged-1ff011d7-db1c-4bac-a2d3-ecf253085265 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:03:40 user nova-compute[73104]: WARNING nova.compute.manager [req-5824794e-1c4d-4f8a-96c5-099cc08020e9 req-f4b4734f-1eb3-467a-bef7-45b93fc4d416 service nova] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Received unexpected event network-vif-plugged-1ff011d7-db1c-4bac-a2d3-ecf253085265 for instance with vm_state deleted and task_state None.
Aug 26 09:03:40 user nova-compute[73104]: DEBUG nova.compute.manager [req-5824794e-1c4d-4f8a-96c5-099cc08020e9 req-f4b4734f-1eb3-467a-bef7-45b93fc4d416 service nova] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Received event network-vif-plugged-1ff011d7-db1c-4bac-a2d3-ecf253085265 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:03:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5824794e-1c4d-4f8a-96c5-099cc08020e9 req-f4b4734f-1eb3-467a-bef7-45b93fc4d416 service nova] Acquiring lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:03:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5824794e-1c4d-4f8a-96c5-099cc08020e9 req-f4b4734f-1eb3-467a-bef7-45b93fc4d416 service nova] Lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:03:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5824794e-1c4d-4f8a-96c5-099cc08020e9 req-f4b4734f-1eb3-467a-bef7-45b93fc4d416 service nova] Lock "3cf85d2f-de0d-4e9b-a534-98c799ae8db9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:03:40 user nova-compute[73104]: DEBUG nova.compute.manager [req-5824794e-1c4d-4f8a-96c5-099cc08020e9 req-f4b4734f-1eb3-467a-bef7-45b93fc4d416 service nova] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] No waiting events found dispatching network-vif-plugged-1ff011d7-db1c-4bac-a2d3-ecf253085265 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:03:40 user nova-compute[73104]: WARNING nova.compute.manager [req-5824794e-1c4d-4f8a-96c5-099cc08020e9 req-f4b4734f-1eb3-467a-bef7-45b93fc4d416 service nova] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Received unexpected event network-vif-plugged-1ff011d7-db1c-4bac-a2d3-ecf253085265 for instance with vm_state deleted and task_state None.
Aug 26 09:03:40 user nova-compute[73104]: DEBUG nova.compute.manager [req-5824794e-1c4d-4f8a-96c5-099cc08020e9 req-f4b4734f-1eb3-467a-bef7-45b93fc4d416 service nova] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Received event network-vif-deleted-1ff011d7-db1c-4bac-a2d3-ecf253085265 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:03:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:03:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:03:53 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693040618.512976, 3cf85d2f-de0d-4e9b-a534-98c799ae8db9 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:03:53 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] VM Stopped (Lifecycle Event)
Aug 26 09:03:53 user nova-compute[73104]: DEBUG nova.compute.manager [None req-dd1d22a4-c3d0-40ff-ac63-10be44229e9f None None] [instance: 3cf85d2f-de0d-4e9b-a534-98c799ae8db9] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:03:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:03:57 user nova-compute[73104]: DEBUG nova.compute.manager [req-e7fb9299-59d4-43ea-b36c-54f7ec375066 req-5e6cf8b7-1499-400c-bf2b-e80aa30f4008 service nova] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Received event network-changed-7dbed8ca-ccd9-491a-9abe-c0a71f17e2af {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:03:57 user nova-compute[73104]: DEBUG nova.compute.manager [req-e7fb9299-59d4-43ea-b36c-54f7ec375066 req-5e6cf8b7-1499-400c-bf2b-e80aa30f4008 service nova] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Refreshing instance network info cache due to event network-changed-7dbed8ca-ccd9-491a-9abe-c0a71f17e2af. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:03:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e7fb9299-59d4-43ea-b36c-54f7ec375066 req-5e6cf8b7-1499-400c-bf2b-e80aa30f4008 service nova] Acquiring lock "refresh_cache-56e8f70f-f077-41a7-9cbd-749c40ec0a23" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:03:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e7fb9299-59d4-43ea-b36c-54f7ec375066 req-5e6cf8b7-1499-400c-bf2b-e80aa30f4008 service nova] Acquired lock "refresh_cache-56e8f70f-f077-41a7-9cbd-749c40ec0a23" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:03:57 user nova-compute[73104]: DEBUG nova.network.neutron [req-e7fb9299-59d4-43ea-b36c-54f7ec375066 req-5e6cf8b7-1499-400c-bf2b-e80aa30f4008 service nova] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Refreshing network info cache for port 7dbed8ca-ccd9-491a-9abe-c0a71f17e2af {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:03:57 user nova-compute[73104]: DEBUG nova.network.neutron [req-e7fb9299-59d4-43ea-b36c-54f7ec375066 req-5e6cf8b7-1499-400c-bf2b-e80aa30f4008 service nova] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Updated VIF entry in instance network info cache for port 7dbed8ca-ccd9-491a-9abe-c0a71f17e2af. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:03:57 user nova-compute[73104]: DEBUG nova.network.neutron [req-e7fb9299-59d4-43ea-b36c-54f7ec375066 req-5e6cf8b7-1499-400c-bf2b-e80aa30f4008 service nova] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Updating instance_info_cache with network_info: [{"id": "7dbed8ca-ccd9-491a-9abe-c0a71f17e2af", "address": "fa:16:3e:6a:35:ce", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dbed8ca-cc", "ovs_interfaceid": "7dbed8ca-ccd9-491a-9abe-c0a71f17e2af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:03:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e7fb9299-59d4-43ea-b36c-54f7ec375066 req-5e6cf8b7-1499-400c-bf2b-e80aa30f4008 service nova] Releasing lock "refresh_cache-56e8f70f-f077-41a7-9cbd-749c40ec0a23" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:03:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:03:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:02 user nova-compute[73104]: DEBUG nova.compute.manager [req-ad25e43d-1010-4546-a42d-54560e427d42 req-dc803972-2b7a-4e31-ac1b-b9edcc504cb6 service nova] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Received event network-changed-ffb99eae-6874-4496-9694-5f2aaae75465 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:04:02 user nova-compute[73104]: DEBUG nova.compute.manager [req-ad25e43d-1010-4546-a42d-54560e427d42 req-dc803972-2b7a-4e31-ac1b-b9edcc504cb6 service nova] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Refreshing instance network info cache due to event network-changed-ffb99eae-6874-4496-9694-5f2aaae75465. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:04:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ad25e43d-1010-4546-a42d-54560e427d42 req-dc803972-2b7a-4e31-ac1b-b9edcc504cb6 service nova] Acquiring lock "refresh_cache-e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:04:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ad25e43d-1010-4546-a42d-54560e427d42 req-dc803972-2b7a-4e31-ac1b-b9edcc504cb6 service nova] Acquired lock "refresh_cache-e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:04:02 user nova-compute[73104]: DEBUG nova.network.neutron [req-ad25e43d-1010-4546-a42d-54560e427d42 req-dc803972-2b7a-4e31-ac1b-b9edcc504cb6 service nova] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Refreshing network info cache for port ffb99eae-6874-4496-9694-5f2aaae75465 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:04:03 user nova-compute[73104]: DEBUG nova.network.neutron [req-ad25e43d-1010-4546-a42d-54560e427d42 req-dc803972-2b7a-4e31-ac1b-b9edcc504cb6 service nova] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Updated VIF entry in instance network info cache for port ffb99eae-6874-4496-9694-5f2aaae75465. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:04:03 user nova-compute[73104]: DEBUG nova.network.neutron [req-ad25e43d-1010-4546-a42d-54560e427d42 req-dc803972-2b7a-4e31-ac1b-b9edcc504cb6 service nova] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Updating instance_info_cache with network_info: [{"id": "ffb99eae-6874-4496-9694-5f2aaae75465", "address": "fa:16:3e:a8:fd:bc", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb99eae-68", "ovs_interfaceid": "ffb99eae-6874-4496-9694-5f2aaae75465", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:04:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ad25e43d-1010-4546-a42d-54560e427d42 req-dc803972-2b7a-4e31-ac1b-b9edcc504cb6 service nova] Releasing lock "refresh_cache-e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:04:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:06 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:04:06 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:04:07 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:04:07 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:04:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:04:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:04:07 user nova-compute[73104]: DEBUG nova.objects.instance [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lazy-loading 'flavor' on Instance uuid e259e21c-3a8b-4ffd-880d-1fb29a2ef64f {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:04:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:04:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:04:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:04:07 user nova-compute[73104]: INFO nova.compute.manager [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Attaching volume a3f89c17-9f0d-4fd4-9727-01b9026da6b1 to /dev/vdb
Aug 26 09:04:08 user nova-compute[73104]: DEBUG os_brick.utils [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:04:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50a1856-1791-4ad8-bc63-eb237a0135a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e810f0a8-2cba-4a09-a038-d4bc022e3c1e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[31726d8c-4e22-4bab-95a0-e749bf902240]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f31343-245d-40cc-b3a8-2f68d9d01987]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:04:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 09:04:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:04:08 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 09:04:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[66909396-8e9f-4543-b43e-d553f51fa4a0]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 09:04:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 09:04:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 09:04:08 user nova-compute[73104]: DEBUG os_brick.utils [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:04:08 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Updating existing volume attachment record: 56a28bf4-781d-47fe-bb46-847da010a4c7 {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 09:04:08 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:04:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:09 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:04:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:04:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:04:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:04:09 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:04:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "33175333-7cb3-46d7-bebe-ab8ce3fc2e3a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:04:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "33175333-7cb3-46d7-bebe-ab8ce3fc2e3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:04:10 user nova-compute[73104]: DEBUG nova.compute.manager [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 09:04:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:04:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:04:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 09:04:10 user nova-compute[73104]: INFO nova.compute.claims [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Claim successful on node user
Aug 26 09:04:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e259e21c-3a8b-4ffd-880d-1fb29a2ef64f/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e259e21c-3a8b-4ffd-880d-1fb29a2ef64f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e259e21c-3a8b-4ffd-880d-1fb29a2ef64f/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:10 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:04:10 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:04:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.372s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:04:10 user nova-compute[73104]: DEBUG nova.compute.manager [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 09:04:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e259e21c-3a8b-4ffd-880d-1fb29a2ef64f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/093c5d6f-c4ab-470e-86f6-7434295555aa/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:10 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 09:04:10 user nova-compute[73104]: DEBUG nova.compute.manager [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 09:04:10 user nova-compute[73104]: DEBUG nova.network.neutron [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 09:04:10 user nova-compute[73104]: DEBUG nova.compute.manager [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 09:04:10 user nova-compute[73104]: INFO nova.virt.block_device [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Booting with volume snapshot 1c4c1b40-6914-4b26-9c6a-5f062cc55413 at /dev/vda
Aug 26 09:04:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/093c5d6f-c4ab-470e-86f6-7434295555aa/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/093c5d6f-c4ab-470e-86f6-7434295555aa/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:10 user nova-compute[73104]: DEBUG nova.policy [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bae03c9c8a9a40b2af6bd1fefb3561d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52518aa77344432385cfc2b73c63aebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 09:04:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/093c5d6f-c4ab-470e-86f6-7434295555aa/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 09:04:11 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:04:11 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:04:11 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8104MB free_disk=24.11343002319336GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:04:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:04:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:04:11 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 56e8f70f-f077-41a7-9cbd-749c40ec0a23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:04:11 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance e259e21c-3a8b-4ffd-880d-1fb29a2ef64f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:04:11 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 093c5d6f-c4ab-470e-86f6-7434295555aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:04:11 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:04:11 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 432a66be-853d-42d7-8622-0417ef36045c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:04:11 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:04:11 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:04:11 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:04:11 user nova-compute[73104]: DEBUG nova.network.neutron [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Successfully created port: 0cd045f6-28c7-4bc5-b274-5c8b2bbeb799 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 09:04:11 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:04:11 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:04:11 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:04:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.374s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:04:12 user nova-compute[73104]: DEBUG nova.network.neutron [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Successfully updated port: 0cd045f6-28c7-4bc5-b274-5c8b2bbeb799 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 09:04:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "refresh_cache-33175333-7cb3-46d7-bebe-ab8ce3fc2e3a" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:04:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquired lock "refresh_cache-33175333-7cb3-46d7-bebe-ab8ce3fc2e3a" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:04:12 user nova-compute[73104]: DEBUG nova.network.neutron [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 09:04:12 user nova-compute[73104]: DEBUG nova.network.neutron [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 09:04:12 user nova-compute[73104]: DEBUG nova.compute.manager [req-ae020baf-61fd-4185-aaf7-97fc5d7497f3 req-768a2bdb-8c1e-4672-a0f7-1dfe29475dcc service nova] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Received event network-changed-0cd045f6-28c7-4bc5-b274-5c8b2bbeb799 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:04:12 user nova-compute[73104]: DEBUG nova.compute.manager [req-ae020baf-61fd-4185-aaf7-97fc5d7497f3 req-768a2bdb-8c1e-4672-a0f7-1dfe29475dcc service nova] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Refreshing instance network info cache due to event network-changed-0cd045f6-28c7-4bc5-b274-5c8b2bbeb799. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:04:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ae020baf-61fd-4185-aaf7-97fc5d7497f3 req-768a2bdb-8c1e-4672-a0f7-1dfe29475dcc service nova] Acquiring lock "refresh_cache-33175333-7cb3-46d7-bebe-ab8ce3fc2e3a" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:04:12 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:04:12 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:04:12 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:04:12 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Rebuilding the list of instances to heal {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 09:04:12 user nova-compute[73104]: DEBUG nova.network.neutron [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Updating instance_info_cache with network_info: [{"id": "0cd045f6-28c7-4bc5-b274-5c8b2bbeb799", "address": "fa:16:3e:ba:5e:a9", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd045f6-28", "ovs_interfaceid": "0cd045f6-28c7-4bc5-b274-5c8b2bbeb799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:04:12 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Skipping network cache update for instance because it is Building. {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 26 09:04:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Releasing lock "refresh_cache-33175333-7cb3-46d7-bebe-ab8ce3fc2e3a" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:04:12 user nova-compute[73104]: DEBUG nova.compute.manager [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Instance network_info: |[{"id": "0cd045f6-28c7-4bc5-b274-5c8b2bbeb799", "address": "fa:16:3e:ba:5e:a9", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd045f6-28", "ovs_interfaceid": "0cd045f6-28c7-4bc5-b274-5c8b2bbeb799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 09:04:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ae020baf-61fd-4185-aaf7-97fc5d7497f3 req-768a2bdb-8c1e-4672-a0f7-1dfe29475dcc service nova] Acquired lock "refresh_cache-33175333-7cb3-46d7-bebe-ab8ce3fc2e3a" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:04:12 user nova-compute[73104]: DEBUG nova.network.neutron [req-ae020baf-61fd-4185-aaf7-97fc5d7497f3 req-768a2bdb-8c1e-4672-a0f7-1dfe29475dcc service nova] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Refreshing network info cache for port 0cd045f6-28c7-4bc5-b274-5c8b2bbeb799 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:04:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-56e8f70f-f077-41a7-9cbd-749c40ec0a23" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:04:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-56e8f70f-f077-41a7-9cbd-749c40ec0a23" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:04:12 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 09:04:12 user nova-compute[73104]: DEBUG nova.objects.instance [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lazy-loading 'info_cache' on Instance uuid 56e8f70f-f077-41a7-9cbd-749c40ec0a23 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:04:13 user nova-compute[73104]: DEBUG nova.network.neutron [req-ae020baf-61fd-4185-aaf7-97fc5d7497f3 req-768a2bdb-8c1e-4672-a0f7-1dfe29475dcc service nova] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Updated VIF entry in instance network info cache for port 0cd045f6-28c7-4bc5-b274-5c8b2bbeb799. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:04:13 user nova-compute[73104]: DEBUG nova.network.neutron [req-ae020baf-61fd-4185-aaf7-97fc5d7497f3 req-768a2bdb-8c1e-4672-a0f7-1dfe29475dcc service nova] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Updating instance_info_cache with network_info: [{"id": "0cd045f6-28c7-4bc5-b274-5c8b2bbeb799", "address": "fa:16:3e:ba:5e:a9", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd045f6-28", "ovs_interfaceid": "0cd045f6-28c7-4bc5-b274-5c8b2bbeb799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:04:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ae020baf-61fd-4185-aaf7-97fc5d7497f3 req-768a2bdb-8c1e-4672-a0f7-1dfe29475dcc service nova] Releasing lock "refresh_cache-33175333-7cb3-46d7-bebe-ab8ce3fc2e3a" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:04:13 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Updating instance_info_cache with network_info: [{"id": "7dbed8ca-ccd9-491a-9abe-c0a71f17e2af", "address": "fa:16:3e:6a:35:ce", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dbed8ca-cc", "ovs_interfaceid": "7dbed8ca-ccd9-491a-9abe-c0a71f17e2af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:04:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-56e8f70f-f077-41a7-9cbd-749c40ec0a23" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:04:13 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 09:04:13 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:04:13 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:04:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:16 user nova-compute[73104]: DEBUG os_brick.utils [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:04:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a1f794-f550-4885-9107-58dda73506d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8004fd-2753-434f-98d1-8bad398fc0ef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[11272ed2-21e2-4177-9c75-9ce81d788ece]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bc0454-5627-4cc1-8349-1dea8b2d86ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:04:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 09:04:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:04:16 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 09:04:16 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2da6e17-5c8e-4872-9b0e-c30e557a3064]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 09:04:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 09:04:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 09:04:16 user nova-compute[73104]: DEBUG os_brick.utils [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:04:16 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Updating existing volume attachment record: 9f3d4a24-8783-4db7-b5b0-fb83c9cbcb56 {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 09:04:17 user nova-compute[73104]: DEBUG nova.compute.manager [req-f91c8812-4717-43e3-92ca-3c56e3ef580d req-208b16fe-9ce0-48dd-b6ff-03b4252ee102 service nova] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Received event network-changed-4cc3052a-4671-4201-b0c3-6f7f634a12cc {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:04:17 user nova-compute[73104]: DEBUG nova.compute.manager [req-f91c8812-4717-43e3-92ca-3c56e3ef580d req-208b16fe-9ce0-48dd-b6ff-03b4252ee102 service nova] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Refreshing instance network info cache due to event network-changed-4cc3052a-4671-4201-b0c3-6f7f634a12cc. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:04:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f91c8812-4717-43e3-92ca-3c56e3ef580d req-208b16fe-9ce0-48dd-b6ff-03b4252ee102 service nova] Acquiring lock "refresh_cache-093c5d6f-c4ab-470e-86f6-7434295555aa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:04:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f91c8812-4717-43e3-92ca-3c56e3ef580d req-208b16fe-9ce0-48dd-b6ff-03b4252ee102 service nova] Acquired lock "refresh_cache-093c5d6f-c4ab-470e-86f6-7434295555aa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:04:17 user nova-compute[73104]: DEBUG nova.network.neutron [req-f91c8812-4717-43e3-92ca-3c56e3ef580d req-208b16fe-9ce0-48dd-b6ff-03b4252ee102 service nova] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Refreshing network info cache for port 4cc3052a-4671-4201-b0c3-6f7f634a12cc {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:04:18 user nova-compute[73104]: DEBUG nova.network.neutron [req-f91c8812-4717-43e3-92ca-3c56e3ef580d req-208b16fe-9ce0-48dd-b6ff-03b4252ee102 service nova] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Updated VIF entry in instance network info cache for port 4cc3052a-4671-4201-b0c3-6f7f634a12cc. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:04:18 user nova-compute[73104]: DEBUG nova.network.neutron [req-f91c8812-4717-43e3-92ca-3c56e3ef580d req-208b16fe-9ce0-48dd-b6ff-03b4252ee102 service nova] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Updating instance_info_cache with network_info: [{"id": "4cc3052a-4671-4201-b0c3-6f7f634a12cc", "address": "fa:16:3e:3c:ee:dd", "network": {"id": "e7648e7b-2516-4dda-8315-40a01975b663", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-350226034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f10314719d1a4b6ba0d23fbd05f8378e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc3052a-46", "ovs_interfaceid": "4cc3052a-4671-4201-b0c3-6f7f634a12cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:04:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f91c8812-4717-43e3-92ca-3c56e3ef580d req-208b16fe-9ce0-48dd-b6ff-03b4252ee102 service nova] Releasing lock "refresh_cache-093c5d6f-c4ab-470e-86f6-7434295555aa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:04:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Acquiring lock "093c5d6f-c4ab-470e-86f6-7434295555aa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:04:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "093c5d6f-c4ab-470e-86f6-7434295555aa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:04:18 user nova-compute[73104]: DEBUG nova.objects.instance [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lazy-loading 'flavor' on Instance uuid 093c5d6f-c4ab-470e-86f6-7434295555aa {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:04:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "093c5d6f-c4ab-470e-86f6-7434295555aa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:04:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Acquiring lock "093c5d6f-c4ab-470e-86f6-7434295555aa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:04:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "093c5d6f-c4ab-470e-86f6-7434295555aa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:04:18 user nova-compute[73104]: INFO nova.compute.manager [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Attaching volume 0019704f-68d1-4e03-a722-9cfde686dc20 to /dev/vdb
Aug 26 09:04:18 user nova-compute[73104]: DEBUG os_brick.utils [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:04:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7748c516-86e9-44ab-867e-97a3ab6c2a73]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b267662-96f2-4ae0-a688-0782c5fd5976]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e0f998-4c73-43ac-9296-b51847f3172e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[66280180-68e6-41bc-b2f1-b595af0f63c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:04:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 09:04:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:04:18 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 09:04:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8845b9f1-4194-4b3c-a87a-2bbc2062d1bd]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 09:04:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 09:04:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 09:04:18 user nova-compute[73104]: DEBUG os_brick.utils [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:04:18 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Updating existing volume attachment record: 2765e845-fbf8-4691-9b84-222847109c61 {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NYSLyivm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:04:19 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:04:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:04:19 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:04:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:04:19 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 09:04:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a888c5a5-10a4-4f2a-82e0-ae4add27ed32]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 09:04:19 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7731c8-ddf9-4dfd-a839-70f93a739559]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1] added
Aug 26 09:04:19 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92845eb-dccb-4845-a96d-97911fc705ee]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a9e3b5-5cbd-4128-a8b0-0ad544a84bda]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NYSLyivm {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NYSLyivm" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9095d2-087d-4199-9d58-38570fe67ae3]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NYSLyivm'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd68fce-a4f9-48f4-90c9-cbd14359e7d3]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dba0f3c-b35c-4575-8b95-cf87cc44f7af]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:04:19 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:04:19 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a5e19d-7632-406f-9e94-99e77273e731]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1, portal: 172.16.0.220,3260]
Aug 26 09:04:19 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1, portal: 172.16.0.220,3260] successful.
Aug 26 09:04:19 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7809a6b3-9061-4e94-87ac-0ffeb9392e32]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10c4345-297a-4976-8888-12fef32e9a78]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:04:19 user nova-compute[73104]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 (non-flash)
Aug 26 09:04:19 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:04:19 user nova-compute[73104]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 (non-flash)
Aug 26 09:04:19 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ba4ad1-430c-4685-9341-396ca03b0aae]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NYSLyivm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 09:04:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:20 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:04:20 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23839646666653733', 'path': '/dev/sdb'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:04:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839646666653733', 'path': '/dev/sdb'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 09:04:20 user nova-compute[73104]: DEBUG nova.objects.instance [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lazy-loading 'flavor' on Instance uuid e259e21c-3a8b-4ffd-880d-1fb29a2ef64f {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:04:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 09:04:20 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:04:20 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 09:04:20 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:04:20 user nova-compute[73104]:   <serial>a3f89c17-9f0d-4fd4-9727-01b9026da6b1</serial>
Aug 26 09:04:20 user nova-compute[73104]: </disk>
Aug 26 09:04:20 user nova-compute[73104]:  {{(pid=73104) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 09:04:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:04:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:04:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] No VIF found with MAC fa:16:3e:a8:fd:bc, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 09:04:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a260816b-7faf-458a-944f-2ee3e442dc90 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.106s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:04:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:04:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:04:25 user nova-compute[73104]: DEBUG nova.objects.instance [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lazy-loading 'flavor' on Instance uuid e259e21c-3a8b-4ffd-880d-1fb29a2ef64f {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:04:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:04:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:04:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:04:25 user nova-compute[73104]: INFO nova.compute.manager [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Attaching volume fa9b0958-573b-4d92-8b5b-4d4b10de37d6 to /dev/vdc
Aug 26 09:04:26 user nova-compute[73104]: DEBUG os_brick.utils [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:04:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a79a98-a0c0-4d1f-a971-549a6a4abb67]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7e93ea-eadd-4aeb-b78e-718e0e0f7cfa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ff5879-8bf7-4779-9299-76556e1fb291]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[155d9b5b-ad33-4106-b1b1-80552e338973]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:04:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 09:04:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:04:26 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 09:04:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6684c7-86c7-4759-ba24-7486091f9120]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 09:04:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 09:04:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 09:04:26 user nova-compute[73104]: DEBUG os_brick.utils [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:04:26 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Updating existing volume attachment record: cd497368-8fa5-41e7-87b1-134233b57cf4 {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 09:04:26 user nova-compute[73104]: INFO nova.compute.manager [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Rescuing
Aug 26 09:04:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "refresh_cache-432a66be-853d-42d7-8622-0417ef36045c" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:04:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquired lock "refresh_cache-432a66be-853d-42d7-8622-0417ef36045c" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:04:26 user nova-compute[73104]: DEBUG nova.network.neutron [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 09:04:27 user nova-compute[73104]: DEBUG nova.network.neutron [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Updating instance_info_cache with network_info: [{"id": "52b25498-8470-454f-9cf5-4989ec64751a", "address": "fa:16:3e:76:d4:93", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b25498-84", "ovs_interfaceid": "52b25498-8470-454f-9cf5-4989ec64751a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:04:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Releasing lock "refresh_cache-432a66be-853d-42d7-8622-0417ef36045c" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:04:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:27 user nova-compute[73104]: DEBUG nova.compute.manager [req-48aa4c35-a18c-433f-bc71-914263a3a7e5 req-49207584-b500-4e42-bc0b-d82490306071 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Received event network-vif-unplugged-52b25498-8470-454f-9cf5-4989ec64751a {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:04:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-48aa4c35-a18c-433f-bc71-914263a3a7e5 req-49207584-b500-4e42-bc0b-d82490306071 service nova] Acquiring lock "432a66be-853d-42d7-8622-0417ef36045c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:04:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-48aa4c35-a18c-433f-bc71-914263a3a7e5 req-49207584-b500-4e42-bc0b-d82490306071 service nova] Lock "432a66be-853d-42d7-8622-0417ef36045c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:04:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-48aa4c35-a18c-433f-bc71-914263a3a7e5 req-49207584-b500-4e42-bc0b-d82490306071 service nova] Lock "432a66be-853d-42d7-8622-0417ef36045c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:04:27 user nova-compute[73104]: DEBUG nova.compute.manager [req-48aa4c35-a18c-433f-bc71-914263a3a7e5 req-49207584-b500-4e42-bc0b-d82490306071 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] No waiting events found dispatching network-vif-unplugged-52b25498-8470-454f-9cf5-4989ec64751a {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:04:27 user nova-compute[73104]: WARNING nova.compute.manager [req-48aa4c35-a18c-433f-bc71-914263a3a7e5 req-49207584-b500-4e42-bc0b-d82490306071 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Received unexpected event network-vif-unplugged-52b25498-8470-454f-9cf5-4989ec64751a for instance with vm_state active and task_state rescuing.
Aug 26 09:04:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.compute.manager [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 09:04:28 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Creating image(s)
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Did not create local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Ensure instance console log exists: /opt/stack/data/nova/instances/33175333-7cb3-46d7-bebe-ab8ce3fc2e3a/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Start _get_guest_xml network_info=[{"id": "0cd045f6-28c7-4bc5-b274-5c8b2bbeb799", "address": "fa:16:3e:ba:5e:a9", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd045f6-28", "ovs_interfaceid": "0cd045f6-28c7-4bc5-b274-5c8b2bbeb799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-26T09:03:59Z,direct_url=<?>,disk_format='qcow2',id=29e73ec4-5dee-4f73-82ab-4efec8ed17c9,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1480461978',owner='52518aa77344432385cfc2b73c63aebe',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-26T09:04:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '9f3d4a24-8783-4db7-b5b0-fb83c9cbcb56', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pZOiDPmf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '33175333-7cb3-46d7-bebe-ab8ce3fc2e3a', 'attached_at': '', 'detached_at': '', 'volume_id': '58a69286-5aa2-4d90-9aa2-ba764d3d074a', 'serial': '58a69286-5aa2-4d90-9aa2-ba764d3d074a'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 09:04:28 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Instance destroyed successfully.
Aug 26 09:04:28 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Attempting rescue
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73104) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:28 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:04:28 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Instance directory exists: not creating {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 09:04:28 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Creating image(s)
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "/opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "/opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "/opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.objects.instance [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lazy-loading 'trusted_certs' on Instance uuid 432a66be-853d-42d7-8622-0417ef36045c {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-26T09:03:59Z,direct_url=<?>,disk_format='qcow2',id=29e73ec4-5dee-4f73-82ab-4efec8ed17c9,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1480461978',owner='52518aa77344432385cfc2b73c63aebe',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-26T09:04:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pZOiDPmf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:04:28 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:04:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:04:28 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:04:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:04:28 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 09:04:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1456a5-2f64-4487-a19d-2c2c146fe5d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 09:04:28 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[98175121-03a0-41b8-a357-3c6def7f138d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a] added
Aug 26 09:04:28 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c4c583-e8ad-418e-b71a-91d679c6fd04]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca5bf15-7a07-495d-ae3d-3d648e1a4fe5]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pZOiDPmf {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pZOiDPmf" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40869aa-cfe2-4021-9180-a814de2e0e6f]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pZOiDPmf'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[11634778-e780-4697-b253-aa1e7d58e4da]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[57617ed7-0dc3-4579-8309-4bbc917842cd]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:04:28 user nova-compute[73104]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 (non-flash)
Aug 26 09:04:28 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:04:28 user nova-compute[73104]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 (non-flash)
Aug 26 09:04:28 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.219s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[953d0ce7-26a7-4633-844f-c5dbf50c9401]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a, portal: 172.16.0.220,3260]
Aug 26 09:04:28 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a, portal: 172.16.0.220,3260] successful.
Aug 26 09:04:28 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue" returned: 0 in 0.066s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.objects.instance [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lazy-loading 'migration_context' on Instance uuid 432a66be-853d-42d7-8622-0417ef36045c {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.objects.base [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Object Instance<432a66be-853d-42d7-8622-0417ef36045c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Start _get_guest_xml network_info=[{"id": "52b25498-8470-454f-9cf5-4989ec64751a", "address": "fa:16:3e:76:d4:93", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "vif_mac": "fa:16:3e:76:d4:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b25498-84", "ovs_interfaceid": "52b25498-8470-454f-9cf5-4989ec64751a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.objects.instance [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lazy-loading 'resources' on Instance uuid 432a66be-853d-42d7-8622-0417ef36045c {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0b0a4c-a874-4674-be5f-b4679ad489d6]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.objects.base [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Object Instance<432a66be-853d-42d7-8622-0417ef36045c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.objects.instance [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lazy-loading 'numa_topology' on Instance uuid 432a66be-853d-42d7-8622-0417ef36045c {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.objects.base [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Object Instance<432a66be-853d-42d7-8622-0417ef36045c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4415ae48-cd3a-4687-ac0c-4e139808c25e]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:04:28 user nova-compute[73104]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 (non-flash)
Aug 26 09:04:28 user nova-compute[73104]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)
Aug 26 09:04:28 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:04:28 user nova-compute[73104]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 (non-flash)
Aug 26 09:04:28 user nova-compute[73104]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)
Aug 26 09:04:28 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:28 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:04:28 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.objects.instance [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lazy-loading 'vcpu_model' on Instance uuid 432a66be-853d-42d7-8622-0417ef36045c {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1394dd4-1895-475e-8f7f-ae636143cd1d]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pZOiDPmf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.objects.base [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Object Instance<432a66be-853d-42d7-8622-0417ef36045c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:02:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-735563407',display_name='tempest-ServerRescueNegativeTestJSON-server-735563407',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-735563407',id=42,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T09:02:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b7642d165474defadde34dabc11f842',ramdisk_id='',reservation_id='r-xran4wdf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-901062798',owner_user_name='tempest-ServerRescueNegativeTestJSON-901062798-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:02:45Z,user_data=None,user_id='da4b6574d165418eaf2b8c8b84d6151f',uuid=432a66be-853d-42d7-8622-0417ef36045c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52b25498-8470-454f-9cf5-4989ec64751a", "address": "fa:16:3e:76:d4:93", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "vif_mac": "fa:16:3e:76:d4:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b25498-84", "ovs_interfaceid": "52b25498-8470-454f-9cf5-4989ec64751a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Converting VIF {"id": "52b25498-8470-454f-9cf5-4989ec64751a", "address": "fa:16:3e:76:d4:93", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "vif_mac": "fa:16:3e:76:d4:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b25498-84", "ovs_interfaceid": "52b25498-8470-454f-9cf5-4989ec64751a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:d4:93,bridge_name='br-int',has_traffic_filtering=True,id=52b25498-8470-454f-9cf5-4989ec64751a,network=Network(fb2d19ab-1c79-4529-b058-e1b8c4fc8276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52b25498-84') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.objects.instance [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lazy-loading 'pci_devices' on Instance uuid 432a66be-853d-42d7-8622-0417ef36045c {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.objects.base [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Object Instance<432a66be-853d-42d7-8622-0417ef36045c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] End _get_guest_xml xml=<domain type="kvm">
Aug 26 09:04:28 user nova-compute[73104]:   <uuid>432a66be-853d-42d7-8622-0417ef36045c</uuid>
Aug 26 09:04:28 user nova-compute[73104]:   <name>instance-0000002a</name>
Aug 26 09:04:28 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 09:04:28 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 09:04:28 user nova-compute[73104]:   <metadata>
Aug 26 09:04:28 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 09:04:28 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 09:04:28 user nova-compute[73104]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-735563407</nova:name>
Aug 26 09:04:28 user nova-compute[73104]:       <nova:creationTime>2023-08-26 09:04:28</nova:creationTime>
Aug 26 09:04:28 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 09:04:28 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 09:04:28 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 09:04:28 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 09:04:28 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 09:04:28 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 09:04:28 user nova-compute[73104]:       </nova:flavor>
Aug 26 09:04:28 user nova-compute[73104]:       <nova:owner>
Aug 26 09:04:28 user nova-compute[73104]:         <nova:user uuid="da4b6574d165418eaf2b8c8b84d6151f">tempest-ServerRescueNegativeTestJSON-901062798-project-member</nova:user>
Aug 26 09:04:28 user nova-compute[73104]:         <nova:project uuid="0b7642d165474defadde34dabc11f842">tempest-ServerRescueNegativeTestJSON-901062798</nova:project>
Aug 26 09:04:28 user nova-compute[73104]:       </nova:owner>
Aug 26 09:04:28 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 09:04:28 user nova-compute[73104]:       <nova:ports>
Aug 26 09:04:28 user nova-compute[73104]:         <nova:port uuid="52b25498-8470-454f-9cf5-4989ec64751a">
Aug 26 09:04:28 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 09:04:28 user nova-compute[73104]:         </nova:port>
Aug 26 09:04:28 user nova-compute[73104]:       </nova:ports>
Aug 26 09:04:28 user nova-compute[73104]:     </nova:instance>
Aug 26 09:04:28 user nova-compute[73104]:   </metadata>
Aug 26 09:04:28 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 09:04:28 user nova-compute[73104]:     <system>
Aug 26 09:04:28 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 09:04:28 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 09:04:28 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 09:04:28 user nova-compute[73104]:       <entry name="serial">432a66be-853d-42d7-8622-0417ef36045c</entry>
Aug 26 09:04:28 user nova-compute[73104]:       <entry name="uuid">432a66be-853d-42d7-8622-0417ef36045c</entry>
Aug 26 09:04:28 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 09:04:28 user nova-compute[73104]:     </system>
Aug 26 09:04:28 user nova-compute[73104]:   </sysinfo>
Aug 26 09:04:28 user nova-compute[73104]:   <os>
Aug 26 09:04:28 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 09:04:28 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 09:04:28 user nova-compute[73104]:   </os>
Aug 26 09:04:28 user nova-compute[73104]:   <features>
Aug 26 09:04:28 user nova-compute[73104]:     <acpi/>
Aug 26 09:04:28 user nova-compute[73104]:     <apic/>
Aug 26 09:04:28 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 09:04:28 user nova-compute[73104]:   </features>
Aug 26 09:04:28 user nova-compute[73104]:   <clock offset="utc">
Aug 26 09:04:28 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 09:04:28 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 09:04:28 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 09:04:28 user nova-compute[73104]:   </clock>
Aug 26 09:04:28 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 09:04:28 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 09:04:28 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 09:04:28 user nova-compute[73104]:   </cpu>
Aug 26 09:04:28 user nova-compute[73104]:   <devices>
Aug 26 09:04:28 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 09:04:28 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 09:04:28 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue"/>
Aug 26 09:04:28 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 09:04:28 user nova-compute[73104]:     </disk>
Aug 26 09:04:28 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 09:04:28 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 09:04:28 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk"/>
Aug 26 09:04:28 user nova-compute[73104]:       <target dev="vdb" bus="virtio"/>
Aug 26 09:04:28 user nova-compute[73104]:     </disk>
Aug 26 09:04:28 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 09:04:28 user nova-compute[73104]:       <mac address="fa:16:3e:76:d4:93"/>
Aug 26 09:04:28 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:04:28 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 09:04:28 user nova-compute[73104]:       <target dev="tap52b25498-84"/>
Aug 26 09:04:28 user nova-compute[73104]:     </interface>
Aug 26 09:04:28 user nova-compute[73104]:     <serial type="pty">
Aug 26 09:04:28 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/console.log" append="off"/>
Aug 26 09:04:28 user nova-compute[73104]:     </serial>
Aug 26 09:04:28 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 09:04:28 user nova-compute[73104]:     <video>
Aug 26 09:04:28 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:04:28 user nova-compute[73104]:     </video>
Aug 26 09:04:28 user nova-compute[73104]:     <rng model="virtio">
Aug 26 09:04:28 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 09:04:28 user nova-compute[73104]:     </rng>
Aug 26 09:04:28 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 09:04:28 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 09:04:28 user nova-compute[73104]:       <stats period="10"/>
Aug 26 09:04:28 user nova-compute[73104]:     </memballoon>
Aug 26 09:04:28 user nova-compute[73104]:   </devices>
Aug 26 09:04:28 user nova-compute[73104]: </domain>
Aug 26 09:04:28 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 09:04:28 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Instance destroyed successfully.
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:04:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] No VIF found with MAC fa:16:3e:76:d4:93, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '23230363064626135', 'path': '/dev/sdd'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230363064626135', 'path': '/dev/sdd'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1998354261',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1998354261',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1998354261',id=43,image_ref='29e73ec4-5dee-4f73-82ab-4efec8ed17c9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlG1AZLEnRk41Sv0GplU4nia/QBRvuBQEc2fQaBlPwcQrpo2AjyqONodzbBQ32yokE/Jt+k/s66DTkz7XLeGOFsFraKpr09Wg1ishTUzNq0vmGKAtq7LIgE1fLhF9plHg==',key_name='tempest-keypair-47684490',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52518aa77344432385cfc2b73c63aebe',ramdisk_id='',reservation_id='r-a7dgn2bb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1466837638',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1466837638-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1466837638',owner_user_name='tempest-TestVolumeBootPattern-1466837638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:04:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bae03c9c8a9a40b2af6bd1fefb3561d0',uuid=33175333-7cb3-46d7-bebe-ab8ce3fc2e3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0cd045f6-28c7-4bc5-b274-5c8b2bbeb799", "address": "fa:16:3e:ba:5e:a9", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd045f6-28", "ovs_interfaceid": "0cd045f6-28c7-4bc5-b274-5c8b2bbeb799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converting VIF {"id": "0cd045f6-28c7-4bc5-b274-5c8b2bbeb799", "address": "fa:16:3e:ba:5e:a9", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd045f6-28", "ovs_interfaceid": "0cd045f6-28c7-4bc5-b274-5c8b2bbeb799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:5e:a9,bridge_name='br-int',has_traffic_filtering=True,id=0cd045f6-28c7-4bc5-b274-5c8b2bbeb799,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd045f6-28') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG nova.objects.instance [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lazy-loading 'pci_devices' on Instance uuid 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] End _get_guest_xml xml=<domain type="kvm">
Aug 26 09:04:29 user nova-compute[73104]:   <uuid>33175333-7cb3-46d7-bebe-ab8ce3fc2e3a</uuid>
Aug 26 09:04:29 user nova-compute[73104]:   <name>instance-0000002b</name>
Aug 26 09:04:29 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 09:04:29 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 09:04:29 user nova-compute[73104]:   <metadata>
Aug 26 09:04:29 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 09:04:29 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 09:04:29 user nova-compute[73104]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1998354261</nova:name>
Aug 26 09:04:29 user nova-compute[73104]:       <nova:creationTime>2023-08-26 09:04:28</nova:creationTime>
Aug 26 09:04:29 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 09:04:29 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 09:04:29 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 09:04:29 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 09:04:29 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 09:04:29 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 09:04:29 user nova-compute[73104]:       </nova:flavor>
Aug 26 09:04:29 user nova-compute[73104]:       <nova:owner>
Aug 26 09:04:29 user nova-compute[73104]:         <nova:user uuid="bae03c9c8a9a40b2af6bd1fefb3561d0">tempest-TestVolumeBootPattern-1466837638-project-member</nova:user>
Aug 26 09:04:29 user nova-compute[73104]:         <nova:project uuid="52518aa77344432385cfc2b73c63aebe">tempest-TestVolumeBootPattern-1466837638</nova:project>
Aug 26 09:04:29 user nova-compute[73104]:       </nova:owner>
Aug 26 09:04:29 user nova-compute[73104]:       <nova:root type="image" uuid="29e73ec4-5dee-4f73-82ab-4efec8ed17c9"/>
Aug 26 09:04:29 user nova-compute[73104]:       <nova:ports>
Aug 26 09:04:29 user nova-compute[73104]:         <nova:port uuid="0cd045f6-28c7-4bc5-b274-5c8b2bbeb799">
Aug 26 09:04:29 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 09:04:29 user nova-compute[73104]:         </nova:port>
Aug 26 09:04:29 user nova-compute[73104]:       </nova:ports>
Aug 26 09:04:29 user nova-compute[73104]:     </nova:instance>
Aug 26 09:04:29 user nova-compute[73104]:   </metadata>
Aug 26 09:04:29 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 09:04:29 user nova-compute[73104]:     <system>
Aug 26 09:04:29 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 09:04:29 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 09:04:29 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 09:04:29 user nova-compute[73104]:       <entry name="serial">33175333-7cb3-46d7-bebe-ab8ce3fc2e3a</entry>
Aug 26 09:04:29 user nova-compute[73104]:       <entry name="uuid">33175333-7cb3-46d7-bebe-ab8ce3fc2e3a</entry>
Aug 26 09:04:29 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 09:04:29 user nova-compute[73104]:     </system>
Aug 26 09:04:29 user nova-compute[73104]:   </sysinfo>
Aug 26 09:04:29 user nova-compute[73104]:   <os>
Aug 26 09:04:29 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 09:04:29 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 09:04:29 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 09:04:29 user nova-compute[73104]:   </os>
Aug 26 09:04:29 user nova-compute[73104]:   <features>
Aug 26 09:04:29 user nova-compute[73104]:     <acpi/>
Aug 26 09:04:29 user nova-compute[73104]:     <apic/>
Aug 26 09:04:29 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 09:04:29 user nova-compute[73104]:   </features>
Aug 26 09:04:29 user nova-compute[73104]:   <clock offset="utc">
Aug 26 09:04:29 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 09:04:29 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 09:04:29 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 09:04:29 user nova-compute[73104]:   </clock>
Aug 26 09:04:29 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 09:04:29 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 09:04:29 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 09:04:29 user nova-compute[73104]:   </cpu>
Aug 26 09:04:29 user nova-compute[73104]:   <devices>
Aug 26 09:04:29 user nova-compute[73104]:     <disk type="block" device="disk">
Aug 26 09:04:29 user nova-compute[73104]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:04:29 user nova-compute[73104]:       <source dev="/dev/sdd"/>
Aug 26 09:04:29 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 09:04:29 user nova-compute[73104]:       <serial>58a69286-5aa2-4d90-9aa2-ba764d3d074a</serial>
Aug 26 09:04:29 user nova-compute[73104]:     </disk>
Aug 26 09:04:29 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 09:04:29 user nova-compute[73104]:       <mac address="fa:16:3e:ba:5e:a9"/>
Aug 26 09:04:29 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:04:29 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 09:04:29 user nova-compute[73104]:       <target dev="tap0cd045f6-28"/>
Aug 26 09:04:29 user nova-compute[73104]:     </interface>
Aug 26 09:04:29 user nova-compute[73104]:     <serial type="pty">
Aug 26 09:04:29 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/33175333-7cb3-46d7-bebe-ab8ce3fc2e3a/console.log" append="off"/>
Aug 26 09:04:29 user nova-compute[73104]:     </serial>
Aug 26 09:04:29 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 09:04:29 user nova-compute[73104]:     <video>
Aug 26 09:04:29 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:04:29 user nova-compute[73104]:     </video>
Aug 26 09:04:29 user nova-compute[73104]:     <rng model="virtio">
Aug 26 09:04:29 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 09:04:29 user nova-compute[73104]:     </rng>
Aug 26 09:04:29 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 09:04:29 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 09:04:29 user nova-compute[73104]:       <stats period="10"/>
Aug 26 09:04:29 user nova-compute[73104]:     </memballoon>
Aug 26 09:04:29 user nova-compute[73104]:   </devices>
Aug 26 09:04:29 user nova-compute[73104]: </domain>
Aug 26 09:04:29 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1998354261',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1998354261',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1998354261',id=43,image_ref='29e73ec4-5dee-4f73-82ab-4efec8ed17c9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlG1AZLEnRk41Sv0GplU4nia/QBRvuBQEc2fQaBlPwcQrpo2AjyqONodzbBQ32yokE/Jt+k/s66DTkz7XLeGOFsFraKpr09Wg1ishTUzNq0vmGKAtq7LIgE1fLhF9plHg==',key_name='tempest-keypair-47684490',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52518aa77344432385cfc2b73c63aebe',ramdisk_id='',reservation_id='r-a7dgn2bb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1466837638',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1466837638-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1466837638',owner_user_name='tempest-TestVolumeBootPattern-1466837638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:04:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bae03c9c8a9a40b2af6bd1fefb3561d0',uuid=33175333-7cb3-46d7-bebe-ab8ce3fc2e3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0cd045f6-28c7-4bc5-b274-5c8b2bbeb799", "address": "fa:16:3e:ba:5e:a9", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd045f6-28", "ovs_interfaceid": "0cd045f6-28c7-4bc5-b274-5c8b2bbeb799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converting VIF {"id": "0cd045f6-28c7-4bc5-b274-5c8b2bbeb799", "address": "fa:16:3e:ba:5e:a9", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd045f6-28", "ovs_interfaceid": "0cd045f6-28c7-4bc5-b274-5c8b2bbeb799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:5e:a9,bridge_name='br-int',has_traffic_filtering=True,id=0cd045f6-28c7-4bc5-b274-5c8b2bbeb799,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd045f6-28') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG os_vif [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:5e:a9,bridge_name='br-int',has_traffic_filtering=True,id=0cd045f6-28c7-4bc5-b274-5c8b2bbeb799,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd045f6-28') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0cd045f6-28, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0cd045f6-28, col_values=(('external_ids', {'iface-id': '0cd045f6-28c7-4bc5-b274-5c8b2bbeb799', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:5e:a9', 'vm-uuid': '33175333-7cb3-46d7-bebe-ab8ce3fc2e3a'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:29 user nova-compute[73104]: INFO os_vif [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:5e:a9,bridge_name='br-int',has_traffic_filtering=True,id=0cd045f6-28c7-4bc5-b274-5c8b2bbeb799,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd045f6-28')
Aug 26 09:04:29 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] No VIF found with MAC fa:16:3e:ba:5e:a9, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG nova.compute.manager [req-eac84926-5caf-4c3a-94d0-1f5bebafe20c req-20ebf670-364b-4970-8697-607000be58e0 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Received event network-vif-plugged-52b25498-8470-454f-9cf5-4989ec64751a {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-eac84926-5caf-4c3a-94d0-1f5bebafe20c req-20ebf670-364b-4970-8697-607000be58e0 service nova] Acquiring lock "432a66be-853d-42d7-8622-0417ef36045c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-eac84926-5caf-4c3a-94d0-1f5bebafe20c req-20ebf670-364b-4970-8697-607000be58e0 service nova] Lock "432a66be-853d-42d7-8622-0417ef36045c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-eac84926-5caf-4c3a-94d0-1f5bebafe20c req-20ebf670-364b-4970-8697-607000be58e0 service nova] Lock "432a66be-853d-42d7-8622-0417ef36045c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG nova.compute.manager [req-eac84926-5caf-4c3a-94d0-1f5bebafe20c req-20ebf670-364b-4970-8697-607000be58e0 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] No waiting events found dispatching network-vif-plugged-52b25498-8470-454f-9cf5-4989ec64751a {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:04:29 user nova-compute[73104]: WARNING nova.compute.manager [req-eac84926-5caf-4c3a-94d0-1f5bebafe20c req-20ebf670-364b-4970-8697-607000be58e0 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Received unexpected event network-vif-plugged-52b25498-8470-454f-9cf5-4989ec64751a for instance with vm_state active and task_state rescuing.
Aug 26 09:04:29 user nova-compute[73104]: DEBUG nova.compute.manager [req-eac84926-5caf-4c3a-94d0-1f5bebafe20c req-20ebf670-364b-4970-8697-607000be58e0 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Received event network-vif-plugged-52b25498-8470-454f-9cf5-4989ec64751a {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-eac84926-5caf-4c3a-94d0-1f5bebafe20c req-20ebf670-364b-4970-8697-607000be58e0 service nova] Acquiring lock "432a66be-853d-42d7-8622-0417ef36045c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-eac84926-5caf-4c3a-94d0-1f5bebafe20c req-20ebf670-364b-4970-8697-607000be58e0 service nova] Lock "432a66be-853d-42d7-8622-0417ef36045c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-eac84926-5caf-4c3a-94d0-1f5bebafe20c req-20ebf670-364b-4970-8697-607000be58e0 service nova] Lock "432a66be-853d-42d7-8622-0417ef36045c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG nova.compute.manager [req-eac84926-5caf-4c3a-94d0-1f5bebafe20c req-20ebf670-364b-4970-8697-607000be58e0 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] No waiting events found dispatching network-vif-plugged-52b25498-8470-454f-9cf5-4989ec64751a {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:04:29 user nova-compute[73104]: WARNING nova.compute.manager [req-eac84926-5caf-4c3a-94d0-1f5bebafe20c req-20ebf670-364b-4970-8697-607000be58e0 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Received unexpected event network-vif-plugged-52b25498-8470-454f-9cf5-4989ec64751a for instance with vm_state active and task_state rescuing.
Aug 26 09:04:29 user nova-compute[73104]: DEBUG nova.compute.manager [req-eac84926-5caf-4c3a-94d0-1f5bebafe20c req-20ebf670-364b-4970-8697-607000be58e0 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Received event network-vif-plugged-52b25498-8470-454f-9cf5-4989ec64751a {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-eac84926-5caf-4c3a-94d0-1f5bebafe20c req-20ebf670-364b-4970-8697-607000be58e0 service nova] Acquiring lock "432a66be-853d-42d7-8622-0417ef36045c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-eac84926-5caf-4c3a-94d0-1f5bebafe20c req-20ebf670-364b-4970-8697-607000be58e0 service nova] Lock "432a66be-853d-42d7-8622-0417ef36045c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-eac84926-5caf-4c3a-94d0-1f5bebafe20c req-20ebf670-364b-4970-8697-607000be58e0 service nova] Lock "432a66be-853d-42d7-8622-0417ef36045c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG nova.compute.manager [req-eac84926-5caf-4c3a-94d0-1f5bebafe20c req-20ebf670-364b-4970-8697-607000be58e0 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] No waiting events found dispatching network-vif-plugged-52b25498-8470-454f-9cf5-4989ec64751a {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:04:29 user nova-compute[73104]: WARNING nova.compute.manager [req-eac84926-5caf-4c3a-94d0-1f5bebafe20c req-20ebf670-364b-4970-8697-607000be58e0 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Received unexpected event network-vif-plugged-52b25498-8470-454f-9cf5-4989ec64751a for instance with vm_state active and task_state rescuing.
Aug 26 09:04:29 user nova-compute[73104]: DEBUG nova.compute.manager [req-eac84926-5caf-4c3a-94d0-1f5bebafe20c req-20ebf670-364b-4970-8697-607000be58e0 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Received event network-vif-unplugged-52b25498-8470-454f-9cf5-4989ec64751a {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-eac84926-5caf-4c3a-94d0-1f5bebafe20c req-20ebf670-364b-4970-8697-607000be58e0 service nova] Acquiring lock "432a66be-853d-42d7-8622-0417ef36045c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-eac84926-5caf-4c3a-94d0-1f5bebafe20c req-20ebf670-364b-4970-8697-607000be58e0 service nova] Lock "432a66be-853d-42d7-8622-0417ef36045c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-eac84926-5caf-4c3a-94d0-1f5bebafe20c req-20ebf670-364b-4970-8697-607000be58e0 service nova] Lock "432a66be-853d-42d7-8622-0417ef36045c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG nova.compute.manager [req-eac84926-5caf-4c3a-94d0-1f5bebafe20c req-20ebf670-364b-4970-8697-607000be58e0 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] No waiting events found dispatching network-vif-unplugged-52b25498-8470-454f-9cf5-4989ec64751a {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:04:29 user nova-compute[73104]: WARNING nova.compute.manager [req-eac84926-5caf-4c3a-94d0-1f5bebafe20c req-20ebf670-364b-4970-8697-607000be58e0 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Received unexpected event network-vif-unplugged-52b25498-8470-454f-9cf5-4989ec64751a for instance with vm_state active and task_state rescuing.
Aug 26 09:04:29 user nova-compute[73104]: DEBUG nova.compute.manager [req-eac84926-5caf-4c3a-94d0-1f5bebafe20c req-20ebf670-364b-4970-8697-607000be58e0 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Received event network-vif-plugged-52b25498-8470-454f-9cf5-4989ec64751a {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-eac84926-5caf-4c3a-94d0-1f5bebafe20c req-20ebf670-364b-4970-8697-607000be58e0 service nova] Acquiring lock "432a66be-853d-42d7-8622-0417ef36045c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-eac84926-5caf-4c3a-94d0-1f5bebafe20c req-20ebf670-364b-4970-8697-607000be58e0 service nova] Lock "432a66be-853d-42d7-8622-0417ef36045c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-eac84926-5caf-4c3a-94d0-1f5bebafe20c req-20ebf670-364b-4970-8697-607000be58e0 service nova] Lock "432a66be-853d-42d7-8622-0417ef36045c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:04:29 user nova-compute[73104]: DEBUG nova.compute.manager [req-eac84926-5caf-4c3a-94d0-1f5bebafe20c req-20ebf670-364b-4970-8697-607000be58e0 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] No waiting events found dispatching network-vif-plugged-52b25498-8470-454f-9cf5-4989ec64751a {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:04:29 user nova-compute[73104]: WARNING nova.compute.manager [req-eac84926-5caf-4c3a-94d0-1f5bebafe20c req-20ebf670-364b-4970-8697-607000be58e0 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Received unexpected event network-vif-plugged-52b25498-8470-454f-9cf5-4989ec64751a for instance with vm_state active and task_state rescuing.
Aug 26 09:04:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lPUKLZFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:04:30 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:04:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:04:30 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:04:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:04:30 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 09:04:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[29327e29-48b8-4a12-bd3d-e5f4b203b17e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 09:04:30 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e6ed79-356c-4387-a215-93f5f5ecd184]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20] added
Aug 26 09:04:30 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f34477-42a3-4183-b577-d3542b7e4ee8]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4320bafd-a379-42af-92b6-bad6987185c6]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lPUKLZFe {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lPUKLZFe" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b44a85-3c1f-4ea9-b1e7-2e0e962d4452]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lPUKLZFe'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[abeb89ee-2052-4e69-a948-fb12572c6edc]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c83fa8-e8ab-4ff5-b622-e3c6c9368c88]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:04:30 user nova-compute[73104]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 (non-flash)
Aug 26 09:04:30 user nova-compute[73104]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)
Aug 26 09:04:30 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:04:30 user nova-compute[73104]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 (non-flash)
Aug 26 09:04:30 user nova-compute[73104]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)
Aug 26 09:04:30 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0fd517-0524-4582-80d3-d57adfd5bf4d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20, portal: 172.16.0.220,3260]
Aug 26 09:04:30 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20, portal: 172.16.0.220,3260] successful.
Aug 26 09:04:30 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ead7a3-fe30-450f-a7fd-020dea88eb57]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb885c71-ff9e-444b-b9aa-c2357b607489]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:04:30 user nova-compute[73104]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 (non-flash)
Aug 26 09:04:30 user nova-compute[73104]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)
Aug 26 09:04:30 user nova-compute[73104]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 (non-flash)
Aug 26 09:04:30 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:04:30 user nova-compute[73104]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 (non-flash)
Aug 26 09:04:30 user nova-compute[73104]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)
Aug 26 09:04:30 user nova-compute[73104]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 (non-flash)
Aug 26 09:04:30 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] HCTL ('36', '-', '-', 0) found on session 48 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[594baf2e-d39e-4619-9c5f-08f472df0972]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lPUKLZFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 09:04:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:31 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:04:31 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26134303465623963', 'path': '/dev/sde'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:04:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134303465623963', 'path': '/dev/sde'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 09:04:31 user nova-compute[73104]: DEBUG nova.objects.instance [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lazy-loading 'flavor' on Instance uuid 093c5d6f-c4ab-470e-86f6-7434295555aa {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:04:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 09:04:31 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:04:31 user nova-compute[73104]:   <source dev="/dev/sde"/>
Aug 26 09:04:31 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:04:31 user nova-compute[73104]:   <serial>0019704f-68d1-4e03-a722-9cfde686dc20</serial>
Aug 26 09:04:31 user nova-compute[73104]: </disk>
Aug 26 09:04:31 user nova-compute[73104]:  {{(pid=73104) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 09:04:31 user nova-compute[73104]: DEBUG nova.compute.manager [req-f2b7feb1-53b9-4819-8d98-d4a9dd70b0cf req-0fa630e1-8502-44d0-9fd8-22056d8ce911 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Received event network-vif-plugged-52b25498-8470-454f-9cf5-4989ec64751a {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:04:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f2b7feb1-53b9-4819-8d98-d4a9dd70b0cf req-0fa630e1-8502-44d0-9fd8-22056d8ce911 service nova] Acquiring lock "432a66be-853d-42d7-8622-0417ef36045c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:04:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f2b7feb1-53b9-4819-8d98-d4a9dd70b0cf req-0fa630e1-8502-44d0-9fd8-22056d8ce911 service nova] Lock "432a66be-853d-42d7-8622-0417ef36045c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:04:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f2b7feb1-53b9-4819-8d98-d4a9dd70b0cf req-0fa630e1-8502-44d0-9fd8-22056d8ce911 service nova] Lock "432a66be-853d-42d7-8622-0417ef36045c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:04:31 user nova-compute[73104]: DEBUG nova.compute.manager [req-f2b7feb1-53b9-4819-8d98-d4a9dd70b0cf req-0fa630e1-8502-44d0-9fd8-22056d8ce911 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] No waiting events found dispatching network-vif-plugged-52b25498-8470-454f-9cf5-4989ec64751a {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:04:31 user nova-compute[73104]: WARNING nova.compute.manager [req-f2b7feb1-53b9-4819-8d98-d4a9dd70b0cf req-0fa630e1-8502-44d0-9fd8-22056d8ce911 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Received unexpected event network-vif-plugged-52b25498-8470-454f-9cf5-4989ec64751a for instance with vm_state active and task_state rescuing.
Aug 26 09:04:31 user nova-compute[73104]: DEBUG nova.compute.manager [req-f2b7feb1-53b9-4819-8d98-d4a9dd70b0cf req-0fa630e1-8502-44d0-9fd8-22056d8ce911 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Received event network-vif-plugged-52b25498-8470-454f-9cf5-4989ec64751a {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:04:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f2b7feb1-53b9-4819-8d98-d4a9dd70b0cf req-0fa630e1-8502-44d0-9fd8-22056d8ce911 service nova] Acquiring lock "432a66be-853d-42d7-8622-0417ef36045c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:04:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f2b7feb1-53b9-4819-8d98-d4a9dd70b0cf req-0fa630e1-8502-44d0-9fd8-22056d8ce911 service nova] Lock "432a66be-853d-42d7-8622-0417ef36045c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:04:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f2b7feb1-53b9-4819-8d98-d4a9dd70b0cf req-0fa630e1-8502-44d0-9fd8-22056d8ce911 service nova] Lock "432a66be-853d-42d7-8622-0417ef36045c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:04:31 user nova-compute[73104]: DEBUG nova.compute.manager [req-f2b7feb1-53b9-4819-8d98-d4a9dd70b0cf req-0fa630e1-8502-44d0-9fd8-22056d8ce911 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] No waiting events found dispatching network-vif-plugged-52b25498-8470-454f-9cf5-4989ec64751a {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:04:31 user nova-compute[73104]: WARNING nova.compute.manager [req-f2b7feb1-53b9-4819-8d98-d4a9dd70b0cf req-0fa630e1-8502-44d0-9fd8-22056d8ce911 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Received unexpected event network-vif-plugged-52b25498-8470-454f-9cf5-4989ec64751a for instance with vm_state active and task_state rescuing.
Aug 26 09:04:32 user nova-compute[73104]: DEBUG nova.compute.manager [req-1fd3f56d-e534-47de-a04f-db79225f3cee req-4de9979b-5da7-44d7-ad24-91d14ddbd2a3 service nova] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Received event network-vif-plugged-0cd045f6-28c7-4bc5-b274-5c8b2bbeb799 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:04:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1fd3f56d-e534-47de-a04f-db79225f3cee req-4de9979b-5da7-44d7-ad24-91d14ddbd2a3 service nova] Acquiring lock "33175333-7cb3-46d7-bebe-ab8ce3fc2e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:04:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1fd3f56d-e534-47de-a04f-db79225f3cee req-4de9979b-5da7-44d7-ad24-91d14ddbd2a3 service nova] Lock "33175333-7cb3-46d7-bebe-ab8ce3fc2e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:04:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1fd3f56d-e534-47de-a04f-db79225f3cee req-4de9979b-5da7-44d7-ad24-91d14ddbd2a3 service nova] Lock "33175333-7cb3-46d7-bebe-ab8ce3fc2e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:04:32 user nova-compute[73104]: DEBUG nova.compute.manager [req-1fd3f56d-e534-47de-a04f-db79225f3cee req-4de9979b-5da7-44d7-ad24-91d14ddbd2a3 service nova] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] No waiting events found dispatching network-vif-plugged-0cd045f6-28c7-4bc5-b274-5c8b2bbeb799 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:04:32 user nova-compute[73104]: WARNING nova.compute.manager [req-1fd3f56d-e534-47de-a04f-db79225f3cee req-4de9979b-5da7-44d7-ad24-91d14ddbd2a3 service nova] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Received unexpected event network-vif-plugged-0cd045f6-28c7-4bc5-b274-5c8b2bbeb799 for instance with vm_state building and task_state spawning.
Aug 26 09:04:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:32 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:04:32 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:04:32 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] No VIF found with MAC fa:16:3e:3c:ee:dd, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 09:04:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3bdea253-8844-454b-b7f9-a98d4a81ac05 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "093c5d6f-c4ab-470e-86f6-7434295555aa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.252s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:04:34 user nova-compute[73104]: DEBUG nova.compute.manager [req-90b90d1a-ca1e-4e95-aaac-44bef355bdea req-317b878a-ff21-44ea-a542-ee2aa23efa26 service nova] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Received event network-vif-plugged-0cd045f6-28c7-4bc5-b274-5c8b2bbeb799 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:04:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-90b90d1a-ca1e-4e95-aaac-44bef355bdea req-317b878a-ff21-44ea-a542-ee2aa23efa26 service nova] Acquiring lock "33175333-7cb3-46d7-bebe-ab8ce3fc2e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:04:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-90b90d1a-ca1e-4e95-aaac-44bef355bdea req-317b878a-ff21-44ea-a542-ee2aa23efa26 service nova] Lock "33175333-7cb3-46d7-bebe-ab8ce3fc2e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:04:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-90b90d1a-ca1e-4e95-aaac-44bef355bdea req-317b878a-ff21-44ea-a542-ee2aa23efa26 service nova] Lock "33175333-7cb3-46d7-bebe-ab8ce3fc2e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:04:34 user nova-compute[73104]: DEBUG nova.compute.manager [req-90b90d1a-ca1e-4e95-aaac-44bef355bdea req-317b878a-ff21-44ea-a542-ee2aa23efa26 service nova] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] No waiting events found dispatching network-vif-plugged-0cd045f6-28c7-4bc5-b274-5c8b2bbeb799 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:04:34 user nova-compute[73104]: WARNING nova.compute.manager [req-90b90d1a-ca1e-4e95-aaac-44bef355bdea req-317b878a-ff21-44ea-a542-ee2aa23efa26 service nova] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Received unexpected event network-vif-plugged-0cd045f6-28c7-4bc5-b274-5c8b2bbeb799 for instance with vm_state building and task_state spawning.
Aug 26 09:04:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Removed pending event for 432a66be-853d-42d7-8622-0417ef36045c due to event {{(pid=73104) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 09:04:34 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040674.2229767, 432a66be-853d-42d7-8622-0417ef36045c => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:04:34 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 432a66be-853d-42d7-8622-0417ef36045c] VM Resumed (Lifecycle Event)
Aug 26 09:04:34 user nova-compute[73104]: DEBUG nova.compute.manager [None req-d53f1390-4cad-4119-acbc-55c9feb7e618 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:04:34 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:04:34 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:04:34 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 432a66be-853d-42d7-8622-0417ef36045c] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 09:04:34 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040674.2245936, 432a66be-853d-42d7-8622-0417ef36045c => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:04:34 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 432a66be-853d-42d7-8622-0417ef36045c] VM Started (Lifecycle Event)
Aug 26 09:04:34 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:04:34 user nova-compute[73104]: DEBUG nova.compute.manager [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 09:04:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 09:04:34 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:04:34 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Instance spawned successfully.
Aug 26 09:04:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 09:04:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:04:34 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:04:34 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040674.3262963, 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:04:34 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] VM Resumed (Lifecycle Event)
Aug 26 09:04:34 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:04:34 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:04:34 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 09:04:34 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040674.3269067, 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:04:34 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] VM Started (Lifecycle Event)
Aug 26 09:04:34 user nova-compute[73104]: INFO nova.compute.manager [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Took 6.36 seconds to spawn the instance on the hypervisor.
Aug 26 09:04:34 user nova-compute[73104]: DEBUG nova.compute.manager [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:04:34 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:04:34 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:04:34 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 09:04:34 user nova-compute[73104]: INFO nova.compute.manager [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Took 24.41 seconds to build instance.
Aug 26 09:04:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b2d2c810-bf29-4784-a453-a60dd3f57d04 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "33175333-7cb3-46d7-bebe-ab8ce3fc2e3a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.523s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:04:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Acquiring lock "093c5d6f-c4ab-470e-86f6-7434295555aa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:04:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "093c5d6f-c4ab-470e-86f6-7434295555aa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:04:36 user nova-compute[73104]: DEBUG nova.objects.instance [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lazy-loading 'flavor' on Instance uuid 093c5d6f-c4ab-470e-86f6-7434295555aa {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:04:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "093c5d6f-c4ab-470e-86f6-7434295555aa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:04:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Acquiring lock "093c5d6f-c4ab-470e-86f6-7434295555aa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:04:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "093c5d6f-c4ab-470e-86f6-7434295555aa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:04:37 user nova-compute[73104]: INFO nova.compute.manager [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Attaching volume c011027c-b955-4574-989d-6b163601712f to /dev/vdc
Aug 26 09:04:37 user nova-compute[73104]: DEBUG os_brick.utils [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:04:37 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:37 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:37 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d84408f-1395-40b9-9500-55b329e6a1c3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:37 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:37 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:37 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1de55e-7487-4d70-a65e-0ee090a49dc8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:37 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:37 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:37 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7592d282-7539-429a-91c7-07fb8c8ea0d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:37 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1446af49-5e1d-4d20-bafa-bef5a280b51d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:37 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:37 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:04:37 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 09:04:37 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:37 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:04:37 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 09:04:37 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ea8975-abb2-40af-9324-1b81f708f610]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:37 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 09:04:37 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 09:04:37 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 09:04:37 user nova-compute[73104]: DEBUG os_brick.utils [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:04:37 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Updating existing volume attachment record: f621a3ab-6463-4cd9-ac39-76b5f7be4e99 {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOzJAQlR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:04:38 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:04:38 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:04:38 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:04:38 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:04:38 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 09:04:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa8e036-bb88-4a8c-8d57-ee041ab4e961]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 09:04:38 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[789caa27-3371-4f19-a819-b5fe65e1608d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6] added
Aug 26 09:04:38 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[103a10ad-2308-46e4-91fb-7c7806a06e04]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1de39d9-9a99-4ed9-ae91-8f51c33411e9]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YOzJAQlR {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YOzJAQlR" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[397177fa-04c3-4209-a645-ca6f5d75d381]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YOzJAQlR'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f32f376-d8a0-4173-b59c-427a4ab7a4ad]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0ecddb-e109-4f18-9af5-4eef5df3e7cb]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:04:38 user nova-compute[73104]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 (non-flash)
Aug 26 09:04:38 user nova-compute[73104]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)
Aug 26 09:04:38 user nova-compute[73104]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 (non-flash)
Aug 26 09:04:38 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:04:38 user nova-compute[73104]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 (non-flash)
Aug 26 09:04:38 user nova-compute[73104]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)
Aug 26 09:04:38 user nova-compute[73104]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 (non-flash)
Aug 26 09:04:38 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b799671-02c5-40f0-8dc1-e0073d4b407b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6, portal: 172.16.0.220,3260]
Aug 26 09:04:38 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6, portal: 172.16.0.220,3260] successful.
Aug 26 09:04:38 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8fdb05-5f64-43b2-98fa-b58b5bdde75c]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a4c163-c559-455d-8bf8-d5fcf0a96579]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:04:38 user nova-compute[73104]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 (non-flash)
Aug 26 09:04:38 user nova-compute[73104]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)
Aug 26 09:04:38 user nova-compute[73104]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 (non-flash)
Aug 26 09:04:38 user nova-compute[73104]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6 (non-flash)
Aug 26 09:04:38 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:04:38 user nova-compute[73104]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 (non-flash)
Aug 26 09:04:38 user nova-compute[73104]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)
Aug 26 09:04:38 user nova-compute[73104]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 (non-flash)
Aug 26 09:04:38 user nova-compute[73104]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6 (non-flash)
Aug 26 09:04:38 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] HCTL ('37', '-', '-', 0) found on session 49 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3474231a-f124-412f-9594-bec7248dbd35]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Searching for a device in session 49 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 09:04:38 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOzJAQlR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 09:04:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:04:39 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:04:39 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] <== connect_volume: return (1405ms) {'type': 'block', 'scsi_wwn': '26333333462386632', 'path': '/dev/sdf'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:04:39 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333333462386632', 'path': '/dev/sdf'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 09:04:39 user nova-compute[73104]: DEBUG nova.objects.instance [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lazy-loading 'flavor' on Instance uuid e259e21c-3a8b-4ffd-880d-1fb29a2ef64f {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:04:39 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 09:04:39 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:04:39 user nova-compute[73104]:   <source dev="/dev/sdf"/>
Aug 26 09:04:39 user nova-compute[73104]:   <target dev="vdc" bus="virtio"/>
Aug 26 09:04:39 user nova-compute[73104]:   <serial>fa9b0958-573b-4d92-8b5b-4d4b10de37d6</serial>
Aug 26 09:04:39 user nova-compute[73104]: </disk>
Aug 26 09:04:39 user nova-compute[73104]:  {{(pid=73104) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 09:04:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:04:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:04:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:04:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] No VIF found with MAC fa:16:3e:a8:fd:bc, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 09:04:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ffb307d9-662a-405a-b302-b33681e6d18e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.505s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:04:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5dee6e51-50c4-40dd-9a1b-0661b9056f7e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:04:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5dee6e51-50c4-40dd-9a1b-0661b9056f7e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:04:41 user nova-compute[73104]: INFO nova.compute.manager [None req-5dee6e51-50c4-40dd-9a1b-0661b9056f7e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Detaching volume a3f89c17-9f0d-4fd4-9727-01b9026da6b1
Aug 26 09:04:41 user nova-compute[73104]: INFO nova.virt.block_device [None req-5dee6e51-50c4-40dd-9a1b-0661b9056f7e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Attempting to driver detach volume a3f89c17-9f0d-4fd4-9727-01b9026da6b1 from mountpoint /dev/vdb
Aug 26 09:04:41 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5dee6e51-50c4-40dd-9a1b-0661b9056f7e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Attempting to detach device vdb from instance e259e21c-3a8b-4ffd-880d-1fb29a2ef64f from the persistent domain config. {{(pid=73104) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 09:04:41 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-5dee6e51-50c4-40dd-9a1b-0661b9056f7e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 09:04:41 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:04:41 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 09:04:41 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:04:41 user nova-compute[73104]:   <serial>a3f89c17-9f0d-4fd4-9727-01b9026da6b1</serial>
Aug 26 09:04:41 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 09:04:41 user nova-compute[73104]: </disk>
Aug 26 09:04:41 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 09:04:41 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-5dee6e51-50c4-40dd-9a1b-0661b9056f7e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Successfully detached device vdb from instance e259e21c-3a8b-4ffd-880d-1fb29a2ef64f from the persistent domain config.
Aug 26 09:04:41 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5dee6e51-50c4-40dd-9a1b-0661b9056f7e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e259e21c-3a8b-4ffd-880d-1fb29a2ef64f from the live domain config. {{(pid=73104) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 09:04:41 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-5dee6e51-50c4-40dd-9a1b-0661b9056f7e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 09:04:41 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:04:41 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 09:04:41 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:04:41 user nova-compute[73104]:   <serial>a3f89c17-9f0d-4fd4-9727-01b9026da6b1</serial>
Aug 26 09:04:41 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 09:04:41 user nova-compute[73104]: </disk>
Aug 26 09:04:41 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 09:04:41 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Received event <DeviceRemovedEvent: 1693040681.8481994, e259e21c-3a8b-4ffd-880d-1fb29a2ef64f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73104) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 09:04:41 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5dee6e51-50c4-40dd-9a1b-0661b9056f7e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e259e21c-3a8b-4ffd-880d-1fb29a2ef64f {{(pid=73104) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 09:04:41 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-5dee6e51-50c4-40dd-9a1b-0661b9056f7e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Successfully detached device vdb from instance e259e21c-3a8b-4ffd-880d-1fb29a2ef64f from the live domain config.
Aug 26 09:04:41 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dee6e51-50c4-40dd-9a1b-0661b9056f7e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 09:04:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dee6e51-50c4-40dd-9a1b-0661b9056f7e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NYSLyivm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:04:41 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-5dee6e51-50c4-40dd-9a1b-0661b9056f7e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:04:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-5dee6e51-50c4-40dd-9a1b-0661b9056f7e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:04:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-5dee6e51-50c4-40dd-9a1b-0661b9056f7e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:04:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dee6e51-50c4-40dd-9a1b-0661b9056f7e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 09:04:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:41 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d123355-cf9a-48f6-a706-fb6ae8d6bc73]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:41 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bf299e-b016-4a85-88e5-72509996c94d]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dee6e51-50c4-40dd-9a1b-0661b9056f7e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:04:41 user nova-compute[73104]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 (non-flash)
Aug 26 09:04:41 user nova-compute[73104]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)
Aug 26 09:04:41 user nova-compute[73104]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 (non-flash)
Aug 26 09:04:41 user nova-compute[73104]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6 (non-flash)
Aug 26 09:04:41 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:04:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dee6e51-50c4-40dd-9a1b-0661b9056f7e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:04:41 user nova-compute[73104]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 (non-flash)
Aug 26 09:04:41 user nova-compute[73104]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)
Aug 26 09:04:41 user nova-compute[73104]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 (non-flash)
Aug 26 09:04:41 user nova-compute[73104]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6 (non-flash)
Aug 26 09:04:41 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:04:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dee6e51-50c4-40dd-9a1b-0661b9056f7e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0cc172950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1'): ({'sdb'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 09:04:41 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-5dee6e51-50c4-40dd-9a1b-0661b9056f7e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Removing single pathed devices sdb {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 09:04:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:41 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e75888-4cd6-4f87-9283-75ff492f2517]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:41 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9705623f-e862-4189-9611-829eda7e773b]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:41 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-5dee6e51-50c4-40dd-9a1b-0661b9056f7e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Flushing IO for device /dev/sdb {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 09:04:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:42 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79343aa-6dfb-4539-bce4-538d503f8076]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:42 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-5dee6e51-50c4-40dd-9a1b-0661b9056f7e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 09:04:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:42 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce1bb77-d9bb-4034-9fff-bda1dd3242db]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:42 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-5dee6e51-50c4-40dd-9a1b-0661b9056f7e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 09:04:42 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-5dee6e51-50c4-40dd-9a1b-0661b9056f7e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 09:04:42 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dee6e51-50c4-40dd-9a1b-0661b9056f7e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 09:04:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:42 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4271b358-f0ce-4863-ab36-60fa2903c969]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:42 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dee6e51-50c4-40dd-9a1b-0661b9056f7e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:42 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[064ddeb0-9103-4d1f-998b-b186018140c5]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:42 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dee6e51-50c4-40dd-9a1b-0661b9056f7e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1, portal: 172.16.0.220,3260]
Aug 26 09:04:42 user nova-compute[73104]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1, portal: 172.16.0.220,3260] successful.
Aug 26 09:04:42 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3f89c17-9f0d-4fd4-9727-01b9026da6b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:42 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1f079a-6a73-47b1-82a3-04ed5f5a3bb2]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:42 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dee6e51-50c4-40dd-9a1b-0661b9056f7e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:42 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-5dee6e51-50c4-40dd-9a1b-0661b9056f7e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:04:42 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dee6e51-50c4-40dd-9a1b-0661b9056f7e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] <== disconnect_volume: return (329ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:04:42 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dee6e51-50c4-40dd-9a1b-0661b9056f7e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 09:04:42 user nova-compute[73104]: DEBUG nova.objects.instance [None req-5dee6e51-50c4-40dd-9a1b-0661b9056f7e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lazy-loading 'flavor' on Instance uuid e259e21c-3a8b-4ffd-880d-1fb29a2ef64f {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:04:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5dee6e51-50c4-40dd-9a1b-0661b9056f7e tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.737s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:04:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-98dfe491-5567-4238-8770-2dee5108a8e1 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:04:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-98dfe491-5567-4238-8770-2dee5108a8e1 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:04:43 user nova-compute[73104]: INFO nova.compute.manager [None req-98dfe491-5567-4238-8770-2dee5108a8e1 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Detaching volume fa9b0958-573b-4d92-8b5b-4d4b10de37d6
Aug 26 09:04:43 user nova-compute[73104]: INFO nova.virt.block_device [None req-98dfe491-5567-4238-8770-2dee5108a8e1 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Attempting to driver detach volume fa9b0958-573b-4d92-8b5b-4d4b10de37d6 from mountpoint /dev/vdc
Aug 26 09:04:43 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-98dfe491-5567-4238-8770-2dee5108a8e1 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Attempting to detach device vdc from instance e259e21c-3a8b-4ffd-880d-1fb29a2ef64f from the persistent domain config. {{(pid=73104) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 09:04:43 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-98dfe491-5567-4238-8770-2dee5108a8e1 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 09:04:43 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:04:43 user nova-compute[73104]:   <source dev="/dev/sdf"/>
Aug 26 09:04:43 user nova-compute[73104]:   <target dev="vdc" bus="virtio"/>
Aug 26 09:04:43 user nova-compute[73104]:   <serial>fa9b0958-573b-4d92-8b5b-4d4b10de37d6</serial>
Aug 26 09:04:43 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 09:04:43 user nova-compute[73104]: </disk>
Aug 26 09:04:43 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 09:04:43 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-98dfe491-5567-4238-8770-2dee5108a8e1 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Successfully detached device vdc from instance e259e21c-3a8b-4ffd-880d-1fb29a2ef64f from the persistent domain config.
Aug 26 09:04:43 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-98dfe491-5567-4238-8770-2dee5108a8e1 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance e259e21c-3a8b-4ffd-880d-1fb29a2ef64f from the live domain config. {{(pid=73104) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 09:04:43 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-98dfe491-5567-4238-8770-2dee5108a8e1 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 09:04:43 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:04:43 user nova-compute[73104]:   <source dev="/dev/sdf"/>
Aug 26 09:04:43 user nova-compute[73104]:   <target dev="vdc" bus="virtio"/>
Aug 26 09:04:43 user nova-compute[73104]:   <serial>fa9b0958-573b-4d92-8b5b-4d4b10de37d6</serial>
Aug 26 09:04:43 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 09:04:43 user nova-compute[73104]: </disk>
Aug 26 09:04:43 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Received event <DeviceRemovedEvent: 1693040684.2951438, e259e21c-3a8b-4ffd-880d-1fb29a2ef64f => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73104) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-98dfe491-5567-4238-8770-2dee5108a8e1 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance e259e21c-3a8b-4ffd-880d-1fb29a2ef64f {{(pid=73104) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 09:04:44 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-98dfe491-5567-4238-8770-2dee5108a8e1 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Successfully detached device vdc from instance e259e21c-3a8b-4ffd-880d-1fb29a2ef64f from the live domain config.
Aug 26 09:04:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98dfe491-5567-4238-8770-2dee5108a8e1 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dfe491-5567-4238-8770-2dee5108a8e1 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOzJAQlR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:04:44 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-98dfe491-5567-4238-8770-2dee5108a8e1 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:04:44 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-98dfe491-5567-4238-8770-2dee5108a8e1 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-98dfe491-5567-4238-8770-2dee5108a8e1 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dfe491-5567-4238-8770-2dee5108a8e1 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[971b0a5c-21bc-4161-a85d-7a90a4d122ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1524644-0def-4d3f-8814-76c8fc344a4e]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dfe491-5567-4238-8770-2dee5108a8e1 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:04:44 user nova-compute[73104]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)
Aug 26 09:04:44 user nova-compute[73104]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 (non-flash)
Aug 26 09:04:44 user nova-compute[73104]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6 (non-flash)
Aug 26 09:04:44 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dfe491-5567-4238-8770-2dee5108a8e1 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:04:44 user nova-compute[73104]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)
Aug 26 09:04:44 user nova-compute[73104]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 (non-flash)
Aug 26 09:04:44 user nova-compute[73104]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6 (non-flash)
Aug 26 09:04:44 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dfe491-5567-4238-8770-2dee5108a8e1 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0c4514c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6'): ({'sdf'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-98dfe491-5567-4238-8770-2dee5108a8e1 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Removing single pathed devices sdf {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc632d92-21f9-427a-b4d9-e8d0d5cce7b5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6313fe1-4dbe-4a65-949f-a22d2c94946e]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-98dfe491-5567-4238-8770-2dee5108a8e1 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Flushing IO for device /dev/sdf {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3a0f64-29a7-41fd-82d0-7c9b42fbf2f8]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-98dfe491-5567-4238-8770-2dee5108a8e1 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0ea00b-a6ab-4c14-9bfe-f4cd857a823e]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-98dfe491-5567-4238-8770-2dee5108a8e1 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-98dfe491-5567-4238-8770-2dee5108a8e1 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] SCSI volumes sdf have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dfe491-5567-4238-8770-2dee5108a8e1 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9719f6d7-3dba-4e2a-9c70-9a4fb4ac2928]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dfe491-5567-4238-8770-2dee5108a8e1 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6131fe6d-e589-495d-9fb8-e0f53b0e962c]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dfe491-5567-4238-8770-2dee5108a8e1 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6, portal: 172.16.0.220,3260]
Aug 26 09:04:44 user nova-compute[73104]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6, portal: 172.16.0.220,3260] successful.
Aug 26 09:04:44 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa9b0958-573b-4d92-8b5b-4d4b10de37d6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ed46d0-d2af-4543-ba45-90dec43218c3]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dfe491-5567-4238-8770-2dee5108a8e1 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-98dfe491-5567-4238-8770-2dee5108a8e1 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dfe491-5567-4238-8770-2dee5108a8e1 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] <== disconnect_volume: return (302ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98dfe491-5567-4238-8770-2dee5108a8e1 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:45 user nova-compute[73104]: DEBUG nova.objects.instance [None req-98dfe491-5567-4238-8770-2dee5108a8e1 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lazy-loading 'flavor' on Instance uuid e259e21c-3a8b-4ffd-880d-1fb29a2ef64f {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:04:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-98dfe491-5567-4238-8770-2dee5108a8e1 tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.753s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:04:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c43f3aeb-cef5-4399-91eb-bc7616a9bcae tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:04:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c43f3aeb-cef5-4399-91eb-bc7616a9bcae tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:04:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c43f3aeb-cef5-4399-91eb-bc7616a9bcae tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:04:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c43f3aeb-cef5-4399-91eb-bc7616a9bcae tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:04:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c43f3aeb-cef5-4399-91eb-bc7616a9bcae tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:04:46 user nova-compute[73104]: INFO nova.compute.manager [None req-c43f3aeb-cef5-4399-91eb-bc7616a9bcae tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Terminating instance
Aug 26 09:04:46 user nova-compute[73104]: DEBUG nova.compute.manager [None req-c43f3aeb-cef5-4399-91eb-bc7616a9bcae tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 09:04:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:46 user nova-compute[73104]: DEBUG nova.compute.manager [req-55888bb3-d2ee-410c-8fe5-90da00ac8d29 req-36c09d14-0361-4dae-a7df-516613e0079d service nova] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Received event network-vif-unplugged-ffb99eae-6874-4496-9694-5f2aaae75465 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:04:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-55888bb3-d2ee-410c-8fe5-90da00ac8d29 req-36c09d14-0361-4dae-a7df-516613e0079d service nova] Acquiring lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:04:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-55888bb3-d2ee-410c-8fe5-90da00ac8d29 req-36c09d14-0361-4dae-a7df-516613e0079d service nova] Lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:04:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-55888bb3-d2ee-410c-8fe5-90da00ac8d29 req-36c09d14-0361-4dae-a7df-516613e0079d service nova] Lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:04:46 user nova-compute[73104]: DEBUG nova.compute.manager [req-55888bb3-d2ee-410c-8fe5-90da00ac8d29 req-36c09d14-0361-4dae-a7df-516613e0079d service nova] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] No waiting events found dispatching network-vif-unplugged-ffb99eae-6874-4496-9694-5f2aaae75465 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:04:46 user nova-compute[73104]: DEBUG nova.compute.manager [req-55888bb3-d2ee-410c-8fe5-90da00ac8d29 req-36c09d14-0361-4dae-a7df-516613e0079d service nova] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Received event network-vif-unplugged-ffb99eae-6874-4496-9694-5f2aaae75465 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 09:04:47 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Instance destroyed successfully.
Aug 26 09:04:47 user nova-compute[73104]: DEBUG nova.objects.instance [None req-c43f3aeb-cef5-4399-91eb-bc7616a9bcae tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lazy-loading 'resources' on Instance uuid e259e21c-3a8b-4ffd-880d-1fb29a2ef64f {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:04:47 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-c43f3aeb-cef5-4399-91eb-bc7616a9bcae tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:02:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1113605941',display_name='tempest-AttachVolumeTestJSON-server-1113605941',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1113605941',id=39,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHX2rVCUcsMK21h7FAxOfZZ8BaADgRr5T9eZA9Oiveg8YQT/AgIiOKXqdQZSN6RZy9xQqv7Chej6soWaGTL+fc5qP+cvZrw4H82o8hrdNvB+5aaElpVHnHyhngdsTd/hPQ==',key_name='tempest-keypair-259052926',keypairs=<?>,launch_index=0,launched_at=2023-08-26T09:02:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d101cd585e604a1881c981c946f70849',ramdisk_id='',reservation_id='r-qgesbccd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-684994869',owner_user_name='tempest-AttachVolumeTestJSON-684994869-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T09:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4191d8a10ac54389b6b633701f6e6c77',uuid=e259e21c-3a8b-4ffd-880d-1fb29a2ef64f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ffb99eae-6874-4496-9694-5f2aaae75465", "address": "fa:16:3e:a8:fd:bc", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb99eae-68", "ovs_interfaceid": "ffb99eae-6874-4496-9694-5f2aaae75465", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 09:04:47 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-c43f3aeb-cef5-4399-91eb-bc7616a9bcae tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Converting VIF {"id": "ffb99eae-6874-4496-9694-5f2aaae75465", "address": "fa:16:3e:a8:fd:bc", "network": {"id": "e6ddfc91-c02c-429c-90ff-aaad54b98cd9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1886967743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d101cd585e604a1881c981c946f70849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb99eae-68", "ovs_interfaceid": "ffb99eae-6874-4496-9694-5f2aaae75465", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:04:47 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-c43f3aeb-cef5-4399-91eb-bc7616a9bcae tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:fd:bc,bridge_name='br-int',has_traffic_filtering=True,id=ffb99eae-6874-4496-9694-5f2aaae75465,network=Network(e6ddfc91-c02c-429c-90ff-aaad54b98cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb99eae-68') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:04:47 user nova-compute[73104]: DEBUG os_vif [None req-c43f3aeb-cef5-4399-91eb-bc7616a9bcae tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:fd:bc,bridge_name='br-int',has_traffic_filtering=True,id=ffb99eae-6874-4496-9694-5f2aaae75465,network=Network(e6ddfc91-c02c-429c-90ff-aaad54b98cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb99eae-68') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 09:04:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapffb99eae-68, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:04:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:47 user nova-compute[73104]: INFO os_vif [None req-c43f3aeb-cef5-4399-91eb-bc7616a9bcae tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:fd:bc,bridge_name='br-int',has_traffic_filtering=True,id=ffb99eae-6874-4496-9694-5f2aaae75465,network=Network(e6ddfc91-c02c-429c-90ff-aaad54b98cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb99eae-68')
Aug 26 09:04:47 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-c43f3aeb-cef5-4399-91eb-bc7616a9bcae tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Deleting instance files /opt/stack/data/nova/instances/e259e21c-3a8b-4ffd-880d-1fb29a2ef64f_del
Aug 26 09:04:47 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-c43f3aeb-cef5-4399-91eb-bc7616a9bcae tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Deletion of /opt/stack/data/nova/instances/e259e21c-3a8b-4ffd-880d-1fb29a2ef64f_del complete
Aug 26 09:04:47 user nova-compute[73104]: INFO nova.compute.manager [None req-c43f3aeb-cef5-4399-91eb-bc7616a9bcae tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 26 09:04:47 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-c43f3aeb-cef5-4399-91eb-bc7616a9bcae tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 09:04:47 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 09:04:47 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 09:04:48 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:04:48 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Took 1.34 seconds to deallocate network for instance.
Aug 26 09:04:48 user nova-compute[73104]: DEBUG nova.compute.manager [req-744b0e2f-c498-41bb-ba48-5b2d2a6ba8a3 req-6acc27dc-e037-4cc6-89e2-6e5eacd7f7d2 service nova] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Received event network-vif-deleted-ffb99eae-6874-4496-9694-5f2aaae75465 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:04:48 user nova-compute[73104]: INFO nova.compute.manager [req-744b0e2f-c498-41bb-ba48-5b2d2a6ba8a3 req-6acc27dc-e037-4cc6-89e2-6e5eacd7f7d2 service nova] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Neutron deleted interface ffb99eae-6874-4496-9694-5f2aaae75465; detaching it from the instance and deleting it from the info cache
Aug 26 09:04:48 user nova-compute[73104]: DEBUG nova.network.neutron [req-744b0e2f-c498-41bb-ba48-5b2d2a6ba8a3 req-6acc27dc-e037-4cc6-89e2-6e5eacd7f7d2 service nova] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:04:48 user nova-compute[73104]: DEBUG nova.compute.manager [req-744b0e2f-c498-41bb-ba48-5b2d2a6ba8a3 req-6acc27dc-e037-4cc6-89e2-6e5eacd7f7d2 service nova] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Detach interface failed, port_id=ffb99eae-6874-4496-9694-5f2aaae75465, reason: Instance e259e21c-3a8b-4ffd-880d-1fb29a2ef64f could not be found. {{(pid=73104) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 09:04:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c43f3aeb-cef5-4399-91eb-bc7616a9bcae tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:04:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c43f3aeb-cef5-4399-91eb-bc7616a9bcae tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:04:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-8f91a9f7-dc6b-4c9a-af20-ca3085266961 req-2dc48489-0c8d-443c-a6da-c9b8b00fc8cb service nova] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Received event network-vif-plugged-ffb99eae-6874-4496-9694-5f2aaae75465 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:04:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-8f91a9f7-dc6b-4c9a-af20-ca3085266961 req-2dc48489-0c8d-443c-a6da-c9b8b00fc8cb service nova] Acquiring lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:04:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-8f91a9f7-dc6b-4c9a-af20-ca3085266961 req-2dc48489-0c8d-443c-a6da-c9b8b00fc8cb service nova] Lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:04:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-8f91a9f7-dc6b-4c9a-af20-ca3085266961 req-2dc48489-0c8d-443c-a6da-c9b8b00fc8cb service nova] Lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:04:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-8f91a9f7-dc6b-4c9a-af20-ca3085266961 req-2dc48489-0c8d-443c-a6da-c9b8b00fc8cb service nova] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] No waiting events found dispatching network-vif-plugged-ffb99eae-6874-4496-9694-5f2aaae75465 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:04:49 user nova-compute[73104]: WARNING nova.compute.manager [req-8f91a9f7-dc6b-4c9a-af20-ca3085266961 req-2dc48489-0c8d-443c-a6da-c9b8b00fc8cb service nova] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Received unexpected event network-vif-plugged-ffb99eae-6874-4496-9694-5f2aaae75465 for instance with vm_state deleted and task_state None.
Aug 26 09:04:49 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-c43f3aeb-cef5-4399-91eb-bc7616a9bcae tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:04:49 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-c43f3aeb-cef5-4399-91eb-bc7616a9bcae tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:04:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c43f3aeb-cef5-4399-91eb-bc7616a9bcae tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:04:49 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-c43f3aeb-cef5-4399-91eb-bc7616a9bcae tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Deleted allocations for instance e259e21c-3a8b-4ffd-880d-1fb29a2ef64f
Aug 26 09:04:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c43f3aeb-cef5-4399-91eb-bc7616a9bcae tempest-AttachVolumeTestJSON-684994869 tempest-AttachVolumeTestJSON-684994869-project-member] Lock "e259e21c-3a8b-4ffd-880d-1fb29a2ef64f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.766s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:04:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YFKEBuky', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:04:57 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:04:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:04:57 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:04:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:04:57 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 09:04:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eeff016-c136-47d9-be5a-3e724d8cff60]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 09:04:57 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[af13b470-4d0f-4aba-a74e-4c5513619bcd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f] added
Aug 26 09:04:57 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1db5c5d-9fcb-4911-b323-5af1b9cdb6a7]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f21e3ab-2668-42cb-9360-22845fe43dd9]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YFKEBuky {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YFKEBuky" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a181646-0a70-4d58-8f53-7ef8f4db656b]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YFKEBuky'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4eaa7e-13be-4b0e-a08b-2e866409717c]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f344cf9-2239-43a7-b6ea-b1ab69cbc22f]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:04:57 user nova-compute[73104]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)
Aug 26 09:04:57 user nova-compute[73104]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 (non-flash)
Aug 26 09:04:57 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:04:57 user nova-compute[73104]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)
Aug 26 09:04:57 user nova-compute[73104]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 (non-flash)
Aug 26 09:04:57 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[075d5642-7f21-4b5a-8d6c-d10b0fb30b65]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f, portal: 172.16.0.220,3260]
Aug 26 09:04:57 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f, portal: 172.16.0.220,3260] successful.
Aug 26 09:04:57 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75cb0d6-5df3-4d28-8eda-731c2a6ac713]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adc1d08-f3af-4106-ab56-2c49cffdd6e4]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:04:57 user nova-compute[73104]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)
Aug 26 09:04:57 user nova-compute[73104]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 (non-flash)
Aug 26 09:04:57 user nova-compute[73104]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f (non-flash)
Aug 26 09:04:57 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:04:57 user nova-compute[73104]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)
Aug 26 09:04:57 user nova-compute[73104]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 (non-flash)
Aug 26 09:04:57 user nova-compute[73104]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f (non-flash)
Aug 26 09:04:57 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[230c3c09-57a7-4d4d-9f11-5988b06d7930]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 09:04:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YFKEBuky', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 09:04:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:04:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26361363763303163', 'path': '/dev/sdb'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:04:58 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361363763303163', 'path': '/dev/sdb'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 09:04:58 user nova-compute[73104]: DEBUG nova.objects.instance [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lazy-loading 'flavor' on Instance uuid 093c5d6f-c4ab-470e-86f6-7434295555aa {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:04:58 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 09:04:58 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:04:58 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 09:04:58 user nova-compute[73104]:   <target dev="vdc" bus="virtio"/>
Aug 26 09:04:58 user nova-compute[73104]:   <serial>c011027c-b955-4574-989d-6b163601712f</serial>
Aug 26 09:04:58 user nova-compute[73104]: </disk>
Aug 26 09:04:58 user nova-compute[73104]:  {{(pid=73104) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 09:04:58 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:04:58 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:04:58 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:04:58 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] No VIF found with MAC fa:16:3e:3c:ee:dd, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 09:04:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e5728847-f453-4743-a477-1fcb0320f15d tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "093c5d6f-c4ab-470e-86f6-7434295555aa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.946s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:04:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:04:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5cbf7a92-5b10-494a-bb05-2ebf8ac70604 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Acquiring lock "093c5d6f-c4ab-470e-86f6-7434295555aa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:04:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5cbf7a92-5b10-494a-bb05-2ebf8ac70604 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "093c5d6f-c4ab-470e-86f6-7434295555aa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:04:59 user nova-compute[73104]: INFO nova.compute.manager [None req-5cbf7a92-5b10-494a-bb05-2ebf8ac70604 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Detaching volume c011027c-b955-4574-989d-6b163601712f
Aug 26 09:04:59 user nova-compute[73104]: INFO nova.virt.block_device [None req-5cbf7a92-5b10-494a-bb05-2ebf8ac70604 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Attempting to driver detach volume c011027c-b955-4574-989d-6b163601712f from mountpoint /dev/vdc
Aug 26 09:04:59 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5cbf7a92-5b10-494a-bb05-2ebf8ac70604 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Attempting to detach device vdc from instance 093c5d6f-c4ab-470e-86f6-7434295555aa from the persistent domain config. {{(pid=73104) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 09:04:59 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-5cbf7a92-5b10-494a-bb05-2ebf8ac70604 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 09:04:59 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:04:59 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 09:04:59 user nova-compute[73104]:   <target dev="vdc" bus="virtio"/>
Aug 26 09:04:59 user nova-compute[73104]:   <serial>c011027c-b955-4574-989d-6b163601712f</serial>
Aug 26 09:04:59 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 09:04:59 user nova-compute[73104]: </disk>
Aug 26 09:04:59 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 09:04:59 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-5cbf7a92-5b10-494a-bb05-2ebf8ac70604 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Successfully detached device vdc from instance 093c5d6f-c4ab-470e-86f6-7434295555aa from the persistent domain config.
Aug 26 09:04:59 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5cbf7a92-5b10-494a-bb05-2ebf8ac70604 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 093c5d6f-c4ab-470e-86f6-7434295555aa from the live domain config. {{(pid=73104) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 09:04:59 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-5cbf7a92-5b10-494a-bb05-2ebf8ac70604 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 09:04:59 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:04:59 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 09:04:59 user nova-compute[73104]:   <target dev="vdc" bus="virtio"/>
Aug 26 09:04:59 user nova-compute[73104]:   <serial>c011027c-b955-4574-989d-6b163601712f</serial>
Aug 26 09:04:59 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 09:04:59 user nova-compute[73104]: </disk>
Aug 26 09:04:59 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Received event <DeviceRemovedEvent: 1693040700.4076316, 093c5d6f-c4ab-470e-86f6-7434295555aa => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73104) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-5cbf7a92-5b10-494a-bb05-2ebf8ac70604 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 093c5d6f-c4ab-470e-86f6-7434295555aa {{(pid=73104) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 09:05:00 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-5cbf7a92-5b10-494a-bb05-2ebf8ac70604 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Successfully detached device vdc from instance 093c5d6f-c4ab-470e-86f6-7434295555aa from the live domain config.
Aug 26 09:05:00 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cbf7a92-5b10-494a-bb05-2ebf8ac70604 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbf7a92-5b10-494a-bb05-2ebf8ac70604 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YFKEBuky', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:05:00 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-5cbf7a92-5b10-494a-bb05-2ebf8ac70604 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:05:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-5cbf7a92-5b10-494a-bb05-2ebf8ac70604 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-5cbf7a92-5b10-494a-bb05-2ebf8ac70604 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbf7a92-5b10-494a-bb05-2ebf8ac70604 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c888ca8-c05e-40c7-94f9-df2a1cbe6a6f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[84640579-65c0-48e7-9c3c-708a59e0a08d]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbf7a92-5b10-494a-bb05-2ebf8ac70604 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:05:00 user nova-compute[73104]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)
Aug 26 09:05:00 user nova-compute[73104]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 (non-flash)
Aug 26 09:05:00 user nova-compute[73104]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f (non-flash)
Aug 26 09:05:00 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbf7a92-5b10-494a-bb05-2ebf8ac70604 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:05:00 user nova-compute[73104]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)
Aug 26 09:05:00 user nova-compute[73104]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 (non-flash)
Aug 26 09:05:00 user nova-compute[73104]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f (non-flash)
Aug 26 09:05:00 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbf7a92-5b10-494a-bb05-2ebf8ac70604 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b473aef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f'): ({'sdb'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-5cbf7a92-5b10-494a-bb05-2ebf8ac70604 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Removing single pathed devices sdb {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b583f2-7700-4a86-a294-22f0c3c88f82]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[479bde27-0b54-47cb-b4a5-8da7e8467dc8]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-5cbf7a92-5b10-494a-bb05-2ebf8ac70604 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Flushing IO for device /dev/sdb {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4128018a-7af3-4791-8aa3-aba1d0c46893]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-5cbf7a92-5b10-494a-bb05-2ebf8ac70604 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[61601b0c-7417-4a7a-a7a9-09c135b5d881]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-5cbf7a92-5b10-494a-bb05-2ebf8ac70604 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-5cbf7a92-5b10-494a-bb05-2ebf8ac70604 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbf7a92-5b10-494a-bb05-2ebf8ac70604 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee67a005-735c-4881-83b7-7bf536a24054]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbf7a92-5b10-494a-bb05-2ebf8ac70604 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0e11ad-28ea-4890-9ea6-217304842201]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbf7a92-5b10-494a-bb05-2ebf8ac70604 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f, portal: 172.16.0.220,3260]
Aug 26 09:05:00 user nova-compute[73104]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f, portal: 172.16.0.220,3260] successful.
Aug 26 09:05:00 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c011027c-b955-4574-989d-6b163601712f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[370535e0-c590-4ffa-b638-7f6ec35dd4b5]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbf7a92-5b10-494a-bb05-2ebf8ac70604 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-5cbf7a92-5b10-494a-bb05-2ebf8ac70604 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cbf7a92-5b10-494a-bb05-2ebf8ac70604 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] <== disconnect_volume: return (282ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:05:00 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cbf7a92-5b10-494a-bb05-2ebf8ac70604 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 09:05:02 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693040687.4012873, e259e21c-3a8b-4ffd-880d-1fb29a2ef64f => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:05:02 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] VM Stopped (Lifecycle Event)
Aug 26 09:05:02 user nova-compute[73104]: DEBUG nova.compute.manager [None req-261218fe-dcee-40a8-8d2d-5e4f68017ddf None None] [instance: e259e21c-3a8b-4ffd-880d-1fb29a2ef64f] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:05:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:05:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:05:07 user nova-compute[73104]: DEBUG nova.objects.instance [None req-5cbf7a92-5b10-494a-bb05-2ebf8ac70604 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lazy-loading 'flavor' on Instance uuid 093c5d6f-c4ab-470e-86f6-7434295555aa {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:05:07 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:05:07 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:05:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5cbf7a92-5b10-494a-bb05-2ebf8ac70604 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "093c5d6f-c4ab-470e-86f6-7434295555aa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.378s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:05:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:05:08 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:05:09 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:05:09 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:05:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:05:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:05:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:05:09 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:05:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:05:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:05:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:05:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:05:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:05:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:05:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:05:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:05:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:05:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:05:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:05:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:05:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 09:05:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/093c5d6f-c4ab-470e-86f6-7434295555aa/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:05:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/093c5d6f-c4ab-470e-86f6-7434295555aa/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:05:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/093c5d6f-c4ab-470e-86f6-7434295555aa/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:05:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/093c5d6f-c4ab-470e-86f6-7434295555aa/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:05:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 09:05:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 09:05:11 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:05:11 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:05:11 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8032MB free_disk=24.127880096435547GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:05:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:05:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:05:11 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 56e8f70f-f077-41a7-9cbd-749c40ec0a23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:05:11 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 093c5d6f-c4ab-470e-86f6-7434295555aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:05:11 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:05:11 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 432a66be-853d-42d7-8622-0417ef36045c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:05:11 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:05:11 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:05:11 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:05:11 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:05:11 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:05:11 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:05:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.319s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:05:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:05:12 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:05:12 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:05:13 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:05:13 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:05:13 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:05:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-093c5d6f-c4ab-470e-86f6-7434295555aa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:05:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-093c5d6f-c4ab-470e-86f6-7434295555aa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:05:13 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 09:05:14 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Updating instance_info_cache with network_info: [{"id": "4cc3052a-4671-4201-b0c3-6f7f634a12cc", "address": "fa:16:3e:3c:ee:dd", "network": {"id": "e7648e7b-2516-4dda-8315-40a01975b663", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-350226034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f10314719d1a4b6ba0d23fbd05f8378e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc3052a-46", "ovs_interfaceid": "4cc3052a-4671-4201-b0c3-6f7f634a12cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:05:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-093c5d6f-c4ab-470e-86f6-7434295555aa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:05:14 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 09:05:14 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:05:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:05:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:05:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:05:21 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:05:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:05:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:05:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:05:26 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:05:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:05:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:05:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:05:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Acquiring lock "527198e4-48e3-4042-98ea-a2ff6258d1e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:05:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Lock "527198e4-48e3-4042-98ea-a2ff6258d1e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:05:29 user nova-compute[73104]: DEBUG nova.compute.manager [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 09:05:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:05:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:05:29 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 09:05:29 user nova-compute[73104]: INFO nova.compute.claims [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Claim successful on node user
Aug 26 09:05:30 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:05:30 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:05:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.285s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:05:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 09:05:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 09:05:30 user nova-compute[73104]: DEBUG nova.network.neutron [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 09:05:30 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 09:05:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 09:05:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 09:05:30 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 09:05:30 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Creating image(s)
Aug 26 09:05:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Acquiring lock "/opt/stack/data/nova/instances/527198e4-48e3-4042-98ea-a2ff6258d1e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:05:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Lock "/opt/stack/data/nova/instances/527198e4-48e3-4042-98ea-a2ff6258d1e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:05:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Lock "/opt/stack/data/nova/instances/527198e4-48e3-4042-98ea-a2ff6258d1e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:05:30 user nova-compute[73104]: DEBUG nova.policy [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '89a9e3dcd2914aa494455bccefa4e9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e3d624278a4654adf8f1f1ed225e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 09:05:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:05:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.180s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:05:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:05:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:05:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:05:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.182s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:05:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/527198e4-48e3-4042-98ea-a2ff6258d1e5/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:05:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/527198e4-48e3-4042-98ea-a2ff6258d1e5/disk 1073741824" returned: 0 in 0.060s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:05:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:05:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:05:30 user nova-compute[73104]: DEBUG nova.network.neutron [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Successfully created port: 5e6197a8-e19a-461b-88da-fd8369354ea0 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 09:05:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.176s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:05:30 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Checking if we can resize image /opt/stack/data/nova/instances/527198e4-48e3-4042-98ea-a2ff6258d1e5/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 09:05:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527198e4-48e3-4042-98ea-a2ff6258d1e5/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:05:31 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527198e4-48e3-4042-98ea-a2ff6258d1e5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:05:31 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Cannot resize image /opt/stack/data/nova/instances/527198e4-48e3-4042-98ea-a2ff6258d1e5/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 09:05:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 09:05:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Ensure instance console log exists: /opt/stack/data/nova/instances/527198e4-48e3-4042-98ea-a2ff6258d1e5/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 09:05:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:05:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:05:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:05:31 user nova-compute[73104]: DEBUG nova.network.neutron [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Successfully updated port: 5e6197a8-e19a-461b-88da-fd8369354ea0 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 09:05:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Acquiring lock "refresh_cache-527198e4-48e3-4042-98ea-a2ff6258d1e5" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:05:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Acquired lock "refresh_cache-527198e4-48e3-4042-98ea-a2ff6258d1e5" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:05:31 user nova-compute[73104]: DEBUG nova.network.neutron [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 09:05:31 user nova-compute[73104]: DEBUG nova.compute.manager [req-7dbe4322-cf9a-4e7a-aa18-01095c09e25b req-9816b1d4-7b0b-4a26-86b7-8cfc6bf6730d service nova] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Received event network-changed-5e6197a8-e19a-461b-88da-fd8369354ea0 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:05:31 user nova-compute[73104]: DEBUG nova.compute.manager [req-7dbe4322-cf9a-4e7a-aa18-01095c09e25b req-9816b1d4-7b0b-4a26-86b7-8cfc6bf6730d service nova] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Refreshing instance network info cache due to event network-changed-5e6197a8-e19a-461b-88da-fd8369354ea0. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:05:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-7dbe4322-cf9a-4e7a-aa18-01095c09e25b req-9816b1d4-7b0b-4a26-86b7-8cfc6bf6730d service nova] Acquiring lock "refresh_cache-527198e4-48e3-4042-98ea-a2ff6258d1e5" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:05:31 user nova-compute[73104]: DEBUG nova.network.neutron [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG nova.network.neutron [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Updating instance_info_cache with network_info: [{"id": "5e6197a8-e19a-461b-88da-fd8369354ea0", "address": "fa:16:3e:b1:47:fe", "network": {"id": "47768db2-7960-4cb7-a093-5b1c393e3e39", "bridge": "br-int", "label": "tempest-VolumesActionsTest-915078599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9e3d624278a4654adf8f1f1ed225e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6197a8-e1", "ovs_interfaceid": "5e6197a8-e19a-461b-88da-fd8369354ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Releasing lock "refresh_cache-527198e4-48e3-4042-98ea-a2ff6258d1e5" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG nova.compute.manager [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Instance network_info: |[{"id": "5e6197a8-e19a-461b-88da-fd8369354ea0", "address": "fa:16:3e:b1:47:fe", "network": {"id": "47768db2-7960-4cb7-a093-5b1c393e3e39", "bridge": "br-int", "label": "tempest-VolumesActionsTest-915078599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9e3d624278a4654adf8f1f1ed225e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6197a8-e1", "ovs_interfaceid": "5e6197a8-e19a-461b-88da-fd8369354ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-7dbe4322-cf9a-4e7a-aa18-01095c09e25b req-9816b1d4-7b0b-4a26-86b7-8cfc6bf6730d service nova] Acquired lock "refresh_cache-527198e4-48e3-4042-98ea-a2ff6258d1e5" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG nova.network.neutron [req-7dbe4322-cf9a-4e7a-aa18-01095c09e25b req-9816b1d4-7b0b-4a26-86b7-8cfc6bf6730d service nova] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Refreshing network info cache for port 5e6197a8-e19a-461b-88da-fd8369354ea0 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Start _get_guest_xml network_info=[{"id": "5e6197a8-e19a-461b-88da-fd8369354ea0", "address": "fa:16:3e:b1:47:fe", "network": {"id": "47768db2-7960-4cb7-a093-5b1c393e3e39", "bridge": "br-int", "label": "tempest-VolumesActionsTest-915078599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9e3d624278a4654adf8f1f1ed225e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6197a8-e1", "ovs_interfaceid": "5e6197a8-e19a-461b-88da-fd8369354ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 09:05:32 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:05:32 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:05:32 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:05:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1580623801',display_name='tempest-VolumesActionsTest-instance-1580623801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1580623801',id=44,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9e3d624278a4654adf8f1f1ed225e57',ramdisk_id='',reservation_id='r-0b1hphzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1198168530',owner_user_name='tempest-VolumesActionsTest-1198168530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:05:30Z,user_data=None,user_id='89a9e3dcd2914aa494455bccefa4e9fb',uuid=527198e4-48e3-4042-98ea-a2ff6258d1e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e6197a8-e19a-461b-88da-fd8369354ea0", "address": "fa:16:3e:b1:47:fe", "network": {"id": "47768db2-7960-4cb7-a093-5b1c393e3e39", "bridge": "br-int", "label": "tempest-VolumesActionsTest-915078599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9e3d624278a4654adf8f1f1ed225e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6197a8-e1", "ovs_interfaceid": "5e6197a8-e19a-461b-88da-fd8369354ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Converting VIF {"id": "5e6197a8-e19a-461b-88da-fd8369354ea0", "address": "fa:16:3e:b1:47:fe", "network": {"id": "47768db2-7960-4cb7-a093-5b1c393e3e39", "bridge": "br-int", "label": "tempest-VolumesActionsTest-915078599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9e3d624278a4654adf8f1f1ed225e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6197a8-e1", "ovs_interfaceid": "5e6197a8-e19a-461b-88da-fd8369354ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:47:fe,bridge_name='br-int',has_traffic_filtering=True,id=5e6197a8-e19a-461b-88da-fd8369354ea0,network=Network(47768db2-7960-4cb7-a093-5b1c393e3e39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e6197a8-e1') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG nova.objects.instance [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Lazy-loading 'pci_devices' on Instance uuid 527198e4-48e3-4042-98ea-a2ff6258d1e5 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] End _get_guest_xml xml=<domain type="kvm">
Aug 26 09:05:32 user nova-compute[73104]:   <uuid>527198e4-48e3-4042-98ea-a2ff6258d1e5</uuid>
Aug 26 09:05:32 user nova-compute[73104]:   <name>instance-0000002c</name>
Aug 26 09:05:32 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 09:05:32 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 09:05:32 user nova-compute[73104]:   <metadata>
Aug 26 09:05:32 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 09:05:32 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 09:05:32 user nova-compute[73104]:       <nova:name>tempest-VolumesActionsTest-instance-1580623801</nova:name>
Aug 26 09:05:32 user nova-compute[73104]:       <nova:creationTime>2023-08-26 09:05:32</nova:creationTime>
Aug 26 09:05:32 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 09:05:32 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 09:05:32 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 09:05:32 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 09:05:32 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 09:05:32 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 09:05:32 user nova-compute[73104]:       </nova:flavor>
Aug 26 09:05:32 user nova-compute[73104]:       <nova:owner>
Aug 26 09:05:32 user nova-compute[73104]:         <nova:user uuid="89a9e3dcd2914aa494455bccefa4e9fb">tempest-VolumesActionsTest-1198168530-project-member</nova:user>
Aug 26 09:05:32 user nova-compute[73104]:         <nova:project uuid="e9e3d624278a4654adf8f1f1ed225e57">tempest-VolumesActionsTest-1198168530</nova:project>
Aug 26 09:05:32 user nova-compute[73104]:       </nova:owner>
Aug 26 09:05:32 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 09:05:32 user nova-compute[73104]:       <nova:ports>
Aug 26 09:05:32 user nova-compute[73104]:         <nova:port uuid="5e6197a8-e19a-461b-88da-fd8369354ea0">
Aug 26 09:05:32 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 09:05:32 user nova-compute[73104]:         </nova:port>
Aug 26 09:05:32 user nova-compute[73104]:       </nova:ports>
Aug 26 09:05:32 user nova-compute[73104]:     </nova:instance>
Aug 26 09:05:32 user nova-compute[73104]:   </metadata>
Aug 26 09:05:32 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 09:05:32 user nova-compute[73104]:     <system>
Aug 26 09:05:32 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 09:05:32 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 09:05:32 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 09:05:32 user nova-compute[73104]:       <entry name="serial">527198e4-48e3-4042-98ea-a2ff6258d1e5</entry>
Aug 26 09:05:32 user nova-compute[73104]:       <entry name="uuid">527198e4-48e3-4042-98ea-a2ff6258d1e5</entry>
Aug 26 09:05:32 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 09:05:32 user nova-compute[73104]:     </system>
Aug 26 09:05:32 user nova-compute[73104]:   </sysinfo>
Aug 26 09:05:32 user nova-compute[73104]:   <os>
Aug 26 09:05:32 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 09:05:32 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 09:05:32 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 09:05:32 user nova-compute[73104]:   </os>
Aug 26 09:05:32 user nova-compute[73104]:   <features>
Aug 26 09:05:32 user nova-compute[73104]:     <acpi/>
Aug 26 09:05:32 user nova-compute[73104]:     <apic/>
Aug 26 09:05:32 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 09:05:32 user nova-compute[73104]:   </features>
Aug 26 09:05:32 user nova-compute[73104]:   <clock offset="utc">
Aug 26 09:05:32 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 09:05:32 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 09:05:32 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 09:05:32 user nova-compute[73104]:   </clock>
Aug 26 09:05:32 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 09:05:32 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 09:05:32 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 09:05:32 user nova-compute[73104]:   </cpu>
Aug 26 09:05:32 user nova-compute[73104]:   <devices>
Aug 26 09:05:32 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 09:05:32 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 09:05:32 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/527198e4-48e3-4042-98ea-a2ff6258d1e5/disk"/>
Aug 26 09:05:32 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 09:05:32 user nova-compute[73104]:     </disk>
Aug 26 09:05:32 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 09:05:32 user nova-compute[73104]:       <mac address="fa:16:3e:b1:47:fe"/>
Aug 26 09:05:32 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:05:32 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 09:05:32 user nova-compute[73104]:       <target dev="tap5e6197a8-e1"/>
Aug 26 09:05:32 user nova-compute[73104]:     </interface>
Aug 26 09:05:32 user nova-compute[73104]:     <serial type="pty">
Aug 26 09:05:32 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/527198e4-48e3-4042-98ea-a2ff6258d1e5/console.log" append="off"/>
Aug 26 09:05:32 user nova-compute[73104]:     </serial>
Aug 26 09:05:32 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 09:05:32 user nova-compute[73104]:     <video>
Aug 26 09:05:32 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:05:32 user nova-compute[73104]:     </video>
Aug 26 09:05:32 user nova-compute[73104]:     <rng model="virtio">
Aug 26 09:05:32 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 09:05:32 user nova-compute[73104]:     </rng>
Aug 26 09:05:32 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 09:05:32 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 09:05:32 user nova-compute[73104]:       <stats period="10"/>
Aug 26 09:05:32 user nova-compute[73104]:     </memballoon>
Aug 26 09:05:32 user nova-compute[73104]:   </devices>
Aug 26 09:05:32 user nova-compute[73104]: </domain>
Aug 26 09:05:32 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:05:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1580623801',display_name='tempest-VolumesActionsTest-instance-1580623801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1580623801',id=44,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9e3d624278a4654adf8f1f1ed225e57',ramdisk_id='',reservation_id='r-0b1hphzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1198168530',owner_user_name='tempest-VolumesActionsTest-1198168530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:05:30Z,user_data=None,user_id='89a9e3dcd2914aa494455bccefa4e9fb',uuid=527198e4-48e3-4042-98ea-a2ff6258d1e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e6197a8-e19a-461b-88da-fd8369354ea0", "address": "fa:16:3e:b1:47:fe", "network": {"id": "47768db2-7960-4cb7-a093-5b1c393e3e39", "bridge": "br-int", "label": "tempest-VolumesActionsTest-915078599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9e3d624278a4654adf8f1f1ed225e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6197a8-e1", "ovs_interfaceid": "5e6197a8-e19a-461b-88da-fd8369354ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Converting VIF {"id": "5e6197a8-e19a-461b-88da-fd8369354ea0", "address": "fa:16:3e:b1:47:fe", "network": {"id": "47768db2-7960-4cb7-a093-5b1c393e3e39", "bridge": "br-int", "label": "tempest-VolumesActionsTest-915078599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9e3d624278a4654adf8f1f1ed225e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6197a8-e1", "ovs_interfaceid": "5e6197a8-e19a-461b-88da-fd8369354ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:47:fe,bridge_name='br-int',has_traffic_filtering=True,id=5e6197a8-e19a-461b-88da-fd8369354ea0,network=Network(47768db2-7960-4cb7-a093-5b1c393e3e39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e6197a8-e1') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG os_vif [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:47:fe,bridge_name='br-int',has_traffic_filtering=True,id=5e6197a8-e19a-461b-88da-fd8369354ea0,network=Network(47768db2-7960-4cb7-a093-5b1c393e3e39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e6197a8-e1') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e6197a8-e1, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5e6197a8-e1, col_values=(('external_ids', {'iface-id': '5e6197a8-e19a-461b-88da-fd8369354ea0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:47:fe', 'vm-uuid': '527198e4-48e3-4042-98ea-a2ff6258d1e5'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:05:32 user nova-compute[73104]: INFO os_vif [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:47:fe,bridge_name='br-int',has_traffic_filtering=True,id=5e6197a8-e19a-461b-88da-fd8369354ea0,network=Network(47768db2-7960-4cb7-a093-5b1c393e3e39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e6197a8-e1')
Aug 26 09:05:32 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] No VIF found with MAC fa:16:3e:b1:47:fe, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG nova.network.neutron [req-7dbe4322-cf9a-4e7a-aa18-01095c09e25b req-9816b1d4-7b0b-4a26-86b7-8cfc6bf6730d service nova] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Updated VIF entry in instance network info cache for port 5e6197a8-e19a-461b-88da-fd8369354ea0. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG nova.network.neutron [req-7dbe4322-cf9a-4e7a-aa18-01095c09e25b req-9816b1d4-7b0b-4a26-86b7-8cfc6bf6730d service nova] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Updating instance_info_cache with network_info: [{"id": "5e6197a8-e19a-461b-88da-fd8369354ea0", "address": "fa:16:3e:b1:47:fe", "network": {"id": "47768db2-7960-4cb7-a093-5b1c393e3e39", "bridge": "br-int", "label": "tempest-VolumesActionsTest-915078599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9e3d624278a4654adf8f1f1ed225e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6197a8-e1", "ovs_interfaceid": "5e6197a8-e19a-461b-88da-fd8369354ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:05:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-7dbe4322-cf9a-4e7a-aa18-01095c09e25b req-9816b1d4-7b0b-4a26-86b7-8cfc6bf6730d service nova] Releasing lock "refresh_cache-527198e4-48e3-4042-98ea-a2ff6258d1e5" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:05:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:05:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:05:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:05:33 user nova-compute[73104]: DEBUG nova.compute.manager [req-a3d0257b-2cd1-46ad-b2f6-923466264058 req-61e93831-237c-4b1a-9295-26ca815d4b96 service nova] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Received event network-vif-plugged-5e6197a8-e19a-461b-88da-fd8369354ea0 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:05:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a3d0257b-2cd1-46ad-b2f6-923466264058 req-61e93831-237c-4b1a-9295-26ca815d4b96 service nova] Acquiring lock "527198e4-48e3-4042-98ea-a2ff6258d1e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:05:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a3d0257b-2cd1-46ad-b2f6-923466264058 req-61e93831-237c-4b1a-9295-26ca815d4b96 service nova] Lock "527198e4-48e3-4042-98ea-a2ff6258d1e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:05:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a3d0257b-2cd1-46ad-b2f6-923466264058 req-61e93831-237c-4b1a-9295-26ca815d4b96 service nova] Lock "527198e4-48e3-4042-98ea-a2ff6258d1e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:05:33 user nova-compute[73104]: DEBUG nova.compute.manager [req-a3d0257b-2cd1-46ad-b2f6-923466264058 req-61e93831-237c-4b1a-9295-26ca815d4b96 service nova] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] No waiting events found dispatching network-vif-plugged-5e6197a8-e19a-461b-88da-fd8369354ea0 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:05:33 user nova-compute[73104]: WARNING nova.compute.manager [req-a3d0257b-2cd1-46ad-b2f6-923466264058 req-61e93831-237c-4b1a-9295-26ca815d4b96 service nova] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Received unexpected event network-vif-plugged-5e6197a8-e19a-461b-88da-fd8369354ea0 for instance with vm_state building and task_state spawning.
Aug 26 09:05:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:05:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:05:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:05:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:05:35 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040735.484828, 527198e4-48e3-4042-98ea-a2ff6258d1e5 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:05:35 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] VM Resumed (Lifecycle Event)
Aug 26 09:05:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 09:05:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 09:05:35 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Instance spawned successfully.
Aug 26 09:05:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 09:05:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:05:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:05:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:05:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:05:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:05:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:05:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:05:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:05:35 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 09:05:35 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040735.4863117, 527198e4-48e3-4042-98ea-a2ff6258d1e5 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:05:35 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] VM Started (Lifecycle Event)
Aug 26 09:05:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:05:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:05:35 user nova-compute[73104]: INFO nova.compute.manager [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Took 5.31 seconds to spawn the instance on the hypervisor.
Aug 26 09:05:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:05:35 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 09:05:35 user nova-compute[73104]: INFO nova.compute.manager [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Took 5.89 seconds to build instance.
Aug 26 09:05:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-fa80bdb8-5c74-47ef-b55d-9c122223daff tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Lock "527198e4-48e3-4042-98ea-a2ff6258d1e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.990s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:05:35 user nova-compute[73104]: DEBUG nova.compute.manager [req-34cef6be-639a-493e-a0d9-40eb35299b45 req-14e02576-34a3-4c12-a4ba-4ac02372ef01 service nova] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Received event network-vif-plugged-5e6197a8-e19a-461b-88da-fd8369354ea0 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:05:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-34cef6be-639a-493e-a0d9-40eb35299b45 req-14e02576-34a3-4c12-a4ba-4ac02372ef01 service nova] Acquiring lock "527198e4-48e3-4042-98ea-a2ff6258d1e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:05:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-34cef6be-639a-493e-a0d9-40eb35299b45 req-14e02576-34a3-4c12-a4ba-4ac02372ef01 service nova] Lock "527198e4-48e3-4042-98ea-a2ff6258d1e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:05:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-34cef6be-639a-493e-a0d9-40eb35299b45 req-14e02576-34a3-4c12-a4ba-4ac02372ef01 service nova] Lock "527198e4-48e3-4042-98ea-a2ff6258d1e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:05:35 user nova-compute[73104]: DEBUG nova.compute.manager [req-34cef6be-639a-493e-a0d9-40eb35299b45 req-14e02576-34a3-4c12-a4ba-4ac02372ef01 service nova] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] No waiting events found dispatching network-vif-plugged-5e6197a8-e19a-461b-88da-fd8369354ea0 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:05:35 user nova-compute[73104]: WARNING nova.compute.manager [req-34cef6be-639a-493e-a0d9-40eb35299b45 req-14e02576-34a3-4c12-a4ba-4ac02372ef01 service nova] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Received unexpected event network-vif-plugged-5e6197a8-e19a-461b-88da-fd8369354ea0 for instance with vm_state active and task_state None.
Aug 26 09:05:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:05:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:05:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:05:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:05:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:05:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:05:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a06b2d84-4359-4c4d-a3cd-657374fbffa5 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Acquiring lock "093c5d6f-c4ab-470e-86f6-7434295555aa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:05:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a06b2d84-4359-4c4d-a3cd-657374fbffa5 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "093c5d6f-c4ab-470e-86f6-7434295555aa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:05:50 user nova-compute[73104]: INFO nova.compute.manager [None req-a06b2d84-4359-4c4d-a3cd-657374fbffa5 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Detaching volume 0019704f-68d1-4e03-a722-9cfde686dc20
Aug 26 09:05:50 user nova-compute[73104]: INFO nova.virt.block_device [None req-a06b2d84-4359-4c4d-a3cd-657374fbffa5 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Attempting to driver detach volume 0019704f-68d1-4e03-a722-9cfde686dc20 from mountpoint /dev/vdb
Aug 26 09:05:50 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a06b2d84-4359-4c4d-a3cd-657374fbffa5 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Attempting to detach device vdb from instance 093c5d6f-c4ab-470e-86f6-7434295555aa from the persistent domain config. {{(pid=73104) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 09:05:50 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-a06b2d84-4359-4c4d-a3cd-657374fbffa5 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 09:05:50 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:05:50 user nova-compute[73104]:   <source dev="/dev/sde"/>
Aug 26 09:05:50 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:05:50 user nova-compute[73104]:   <serial>0019704f-68d1-4e03-a722-9cfde686dc20</serial>
Aug 26 09:05:50 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 09:05:50 user nova-compute[73104]: </disk>
Aug 26 09:05:50 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 09:05:50 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-a06b2d84-4359-4c4d-a3cd-657374fbffa5 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Successfully detached device vdb from instance 093c5d6f-c4ab-470e-86f6-7434295555aa from the persistent domain config.
Aug 26 09:05:50 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a06b2d84-4359-4c4d-a3cd-657374fbffa5 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 093c5d6f-c4ab-470e-86f6-7434295555aa from the live domain config. {{(pid=73104) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 09:05:50 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-a06b2d84-4359-4c4d-a3cd-657374fbffa5 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 09:05:50 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:05:50 user nova-compute[73104]:   <source dev="/dev/sde"/>
Aug 26 09:05:50 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:05:50 user nova-compute[73104]:   <serial>0019704f-68d1-4e03-a722-9cfde686dc20</serial>
Aug 26 09:05:50 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 09:05:50 user nova-compute[73104]: </disk>
Aug 26 09:05:50 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Received event <DeviceRemovedEvent: 1693040751.0066667, 093c5d6f-c4ab-470e-86f6-7434295555aa => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73104) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a06b2d84-4359-4c4d-a3cd-657374fbffa5 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 093c5d6f-c4ab-470e-86f6-7434295555aa {{(pid=73104) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 09:05:51 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-a06b2d84-4359-4c4d-a3cd-657374fbffa5 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Successfully detached device vdb from instance 093c5d6f-c4ab-470e-86f6-7434295555aa from the live domain config.
Aug 26 09:05:51 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a06b2d84-4359-4c4d-a3cd-657374fbffa5 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b2d84-4359-4c4d-a3cd-657374fbffa5 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lPUKLZFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:05:51 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-a06b2d84-4359-4c4d-a3cd-657374fbffa5 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:05:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-a06b2d84-4359-4c4d-a3cd-657374fbffa5 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-a06b2d84-4359-4c4d-a3cd-657374fbffa5 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b2d84-4359-4c4d-a3cd-657374fbffa5 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[367d45fa-9589-4890-849a-073b26887a6c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c02ff69-53fb-4e73-8b9e-a7cfeb65d3e0]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b2d84-4359-4c4d-a3cd-657374fbffa5 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:05:51 user nova-compute[73104]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)
Aug 26 09:05:51 user nova-compute[73104]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 (non-flash)
Aug 26 09:05:51 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b2d84-4359-4c4d-a3cd-657374fbffa5 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:05:51 user nova-compute[73104]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)
Aug 26 09:05:51 user nova-compute[73104]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 (non-flash)
Aug 26 09:05:51 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b2d84-4359-4c4d-a3cd-657374fbffa5 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0d1bf9750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20'): ({'sde'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-a06b2d84-4359-4c4d-a3cd-657374fbffa5 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Removing single pathed devices sde {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cae733-04fe-4b23-a360-5381c4b8ade1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e933ce7-f803-4354-b6de-4c7b6526ce0a]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-a06b2d84-4359-4c4d-a3cd-657374fbffa5 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Flushing IO for device /dev/sde {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eed2f76-134b-4119-8d80-569c0fbad174]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-a06b2d84-4359-4c4d-a3cd-657374fbffa5 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bdbae8-10fd-4e9a-adb0-0cf4a1435c3f]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-a06b2d84-4359-4c4d-a3cd-657374fbffa5 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-a06b2d84-4359-4c4d-a3cd-657374fbffa5 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] SCSI volumes sde have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b2d84-4359-4c4d-a3cd-657374fbffa5 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[675ec8dd-796e-4806-95fe-dcf98fd41f01]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b2d84-4359-4c4d-a3cd-657374fbffa5 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a33d49-0873-478b-a075-2789c992370e]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b2d84-4359-4c4d-a3cd-657374fbffa5 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20, portal: 172.16.0.220,3260]
Aug 26 09:05:51 user nova-compute[73104]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20, portal: 172.16.0.220,3260] successful.
Aug 26 09:05:51 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0019704f-68d1-4e03-a722-9cfde686dc20 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c78821-29ea-472e-9283-baad22968ca3]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b2d84-4359-4c4d-a3cd-657374fbffa5 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-a06b2d84-4359-4c4d-a3cd-657374fbffa5 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.255s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b2d84-4359-4c4d-a3cd-657374fbffa5 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] <== disconnect_volume: return (257ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:05:51 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a06b2d84-4359-4c4d-a3cd-657374fbffa5 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 09:05:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:05:52 user nova-compute[73104]: DEBUG nova.objects.instance [None req-a06b2d84-4359-4c4d-a3cd-657374fbffa5 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lazy-loading 'flavor' on Instance uuid 093c5d6f-c4ab-470e-86f6-7434295555aa {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:05:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a06b2d84-4359-4c4d-a3cd-657374fbffa5 tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "093c5d6f-c4ab-470e-86f6-7434295555aa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.895s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:05:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:05:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:05:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:06:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:06:01 user nova-compute[73104]: DEBUG nova.compute.manager [req-6f98cca3-f461-4994-b0ae-55b8f9e27a33 req-af2c3b55-415c-44f8-a7e4-821923adbbc6 service nova] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Received event network-changed-0cd045f6-28c7-4bc5-b274-5c8b2bbeb799 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:06:01 user nova-compute[73104]: DEBUG nova.compute.manager [req-6f98cca3-f461-4994-b0ae-55b8f9e27a33 req-af2c3b55-415c-44f8-a7e4-821923adbbc6 service nova] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Refreshing instance network info cache due to event network-changed-0cd045f6-28c7-4bc5-b274-5c8b2bbeb799. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:06:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6f98cca3-f461-4994-b0ae-55b8f9e27a33 req-af2c3b55-415c-44f8-a7e4-821923adbbc6 service nova] Acquiring lock "refresh_cache-33175333-7cb3-46d7-bebe-ab8ce3fc2e3a" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:06:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6f98cca3-f461-4994-b0ae-55b8f9e27a33 req-af2c3b55-415c-44f8-a7e4-821923adbbc6 service nova] Acquired lock "refresh_cache-33175333-7cb3-46d7-bebe-ab8ce3fc2e3a" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:06:01 user nova-compute[73104]: DEBUG nova.network.neutron [req-6f98cca3-f461-4994-b0ae-55b8f9e27a33 req-af2c3b55-415c-44f8-a7e4-821923adbbc6 service nova] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Refreshing network info cache for port 0cd045f6-28c7-4bc5-b274-5c8b2bbeb799 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:06:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:06:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:06:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "33175333-7cb3-46d7-bebe-ab8ce3fc2e3a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:06:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "33175333-7cb3-46d7-bebe-ab8ce3fc2e3a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:06:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "33175333-7cb3-46d7-bebe-ab8ce3fc2e3a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:06:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "33175333-7cb3-46d7-bebe-ab8ce3fc2e3a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:06:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "33175333-7cb3-46d7-bebe-ab8ce3fc2e3a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:06:02 user nova-compute[73104]: INFO nova.compute.manager [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Terminating instance
Aug 26 09:06:02 user nova-compute[73104]: DEBUG nova.compute.manager [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 09:06:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:06:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:06:02 user nova-compute[73104]: DEBUG nova.network.neutron [req-6f98cca3-f461-4994-b0ae-55b8f9e27a33 req-af2c3b55-415c-44f8-a7e4-821923adbbc6 service nova] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Updated VIF entry in instance network info cache for port 0cd045f6-28c7-4bc5-b274-5c8b2bbeb799. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:06:02 user nova-compute[73104]: DEBUG nova.network.neutron [req-6f98cca3-f461-4994-b0ae-55b8f9e27a33 req-af2c3b55-415c-44f8-a7e4-821923adbbc6 service nova] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Updating instance_info_cache with network_info: [{"id": "0cd045f6-28c7-4bc5-b274-5c8b2bbeb799", "address": "fa:16:3e:ba:5e:a9", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd045f6-28", "ovs_interfaceid": "0cd045f6-28c7-4bc5-b274-5c8b2bbeb799", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:06:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6f98cca3-f461-4994-b0ae-55b8f9e27a33 req-af2c3b55-415c-44f8-a7e4-821923adbbc6 service nova] Releasing lock "refresh_cache-33175333-7cb3-46d7-bebe-ab8ce3fc2e3a" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG nova.compute.manager [req-94fbe48b-d251-48c4-80e8-16f756fe35ef req-61d29eb2-5ae1-4ce0-9eb0-ff8842ee1134 service nova] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Received event network-vif-unplugged-0cd045f6-28c7-4bc5-b274-5c8b2bbeb799 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-94fbe48b-d251-48c4-80e8-16f756fe35ef req-61d29eb2-5ae1-4ce0-9eb0-ff8842ee1134 service nova] Acquiring lock "33175333-7cb3-46d7-bebe-ab8ce3fc2e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-94fbe48b-d251-48c4-80e8-16f756fe35ef req-61d29eb2-5ae1-4ce0-9eb0-ff8842ee1134 service nova] Lock "33175333-7cb3-46d7-bebe-ab8ce3fc2e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-94fbe48b-d251-48c4-80e8-16f756fe35ef req-61d29eb2-5ae1-4ce0-9eb0-ff8842ee1134 service nova] Lock "33175333-7cb3-46d7-bebe-ab8ce3fc2e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG nova.compute.manager [req-94fbe48b-d251-48c4-80e8-16f756fe35ef req-61d29eb2-5ae1-4ce0-9eb0-ff8842ee1134 service nova] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] No waiting events found dispatching network-vif-unplugged-0cd045f6-28c7-4bc5-b274-5c8b2bbeb799 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG nova.compute.manager [req-94fbe48b-d251-48c4-80e8-16f756fe35ef req-61d29eb2-5ae1-4ce0-9eb0-ff8842ee1134 service nova] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Received event network-vif-unplugged-0cd045f6-28c7-4bc5-b274-5c8b2bbeb799 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 09:06:03 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Instance destroyed successfully.
Aug 26 09:06:03 user nova-compute[73104]: DEBUG nova.objects.instance [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lazy-loading 'resources' on Instance uuid 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1998354261',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1998354261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1998354261',id=43,image_ref='29e73ec4-5dee-4f73-82ab-4efec8ed17c9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlG1AZLEnRk41Sv0GplU4nia/QBRvuBQEc2fQaBlPwcQrpo2AjyqONodzbBQ32yokE/Jt+k/s66DTkz7XLeGOFsFraKpr09Wg1ishTUzNq0vmGKAtq7LIgE1fLhF9plHg==',key_name='tempest-keypair-47684490',keypairs=<?>,launch_index=0,launched_at=2023-08-26T09:04:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52518aa77344432385cfc2b73c63aebe',ramdisk_id='',reservation_id='r-a7dgn2bb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1466837638',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1466837638-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1466837638',owner_user_name='tempest-TestVolumeBootPattern-1466837638-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T09:04:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bae03c9c8a9a40b2af6bd1fefb3561d0',uuid=33175333-7cb3-46d7-bebe-ab8ce3fc2e3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0cd045f6-28c7-4bc5-b274-5c8b2bbeb799", "address": "fa:16:3e:ba:5e:a9", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd045f6-28", "ovs_interfaceid": "0cd045f6-28c7-4bc5-b274-5c8b2bbeb799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converting VIF {"id": "0cd045f6-28c7-4bc5-b274-5c8b2bbeb799", "address": "fa:16:3e:ba:5e:a9", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd045f6-28", "ovs_interfaceid": "0cd045f6-28c7-4bc5-b274-5c8b2bbeb799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:5e:a9,bridge_name='br-int',has_traffic_filtering=True,id=0cd045f6-28c7-4bc5-b274-5c8b2bbeb799,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd045f6-28') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG os_vif [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:5e:a9,bridge_name='br-int',has_traffic_filtering=True,id=0cd045f6-28c7-4bc5-b274-5c8b2bbeb799,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd045f6-28') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0cd045f6-28, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:06:03 user nova-compute[73104]: INFO os_vif [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:5e:a9,bridge_name='br-int',has_traffic_filtering=True,id=0cd045f6-28c7-4bc5-b274-5c8b2bbeb799,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd045f6-28')
Aug 26 09:06:03 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pZOiDPmf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:06:03 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:06:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe8df98-8e29-495e-bd12-780418a6dee3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c32513-b7b9-4e47-a922-175bb7b78cdf]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:06:03 user nova-compute[73104]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)
Aug 26 09:06:03 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:06:03 user nova-compute[73104]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a (non-flash)
Aug 26 09:06:03 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b4796830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a'): ({'sdd'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Removing single pathed devices sdd {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f629e818-5f15-40a7-bd0f-24300052aa4a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d47b01f-9d02-4028-9c7f-55bb965abb44]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Flushing IO for device /dev/sdd {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[478f7cbe-7be7-4d26-85e6-808279156285]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0dc190-435a-4c31-a808-bb0b0c28c244]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] SCSI volumes sdd have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOc10e4739-2060dba5e30b08ad', '/dev/disk/by-id/scsi-23230363064626135', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c10e4739') {{(pid=84263) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b12935-d553-49d8-898b-7b5ef1874204]: (4, None) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc143eb4-991b-448f-ae2b-873e007c2966]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4846917f-251f-4c92-826b-0a6c4cd4a87f]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a, portal: 172.16.0.220,3260]
Aug 26 09:06:03 user nova-compute[73104]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a, portal: 172.16.0.220,3260] successful.
Aug 26 09:06:03 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a69286-5aa2-4d90-9aa2-ba764d3d074a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[46eb390f-178c-45b4-b768-bfceaf05538c]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] <== disconnect_volume: return (280ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 09:06:03 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Deleting instance files /opt/stack/data/nova/instances/33175333-7cb3-46d7-bebe-ab8ce3fc2e3a_del
Aug 26 09:06:03 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Deletion of /opt/stack/data/nova/instances/33175333-7cb3-46d7-bebe-ab8ce3fc2e3a_del complete
Aug 26 09:06:03 user nova-compute[73104]: INFO nova.compute.manager [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 26 09:06:03 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 09:06:03 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 09:06:04 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:06:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:06:04 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Took 0.93 seconds to deallocate network for instance.
Aug 26 09:06:04 user nova-compute[73104]: DEBUG nova.compute.manager [req-6b977b49-b63f-4e47-ae1f-ce75a48b201c req-61dba75b-3a1b-4f57-aa9e-063c0919bc58 service nova] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Received event network-vif-deleted-0cd045f6-28c7-4bc5-b274-5c8b2bbeb799 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:06:05 user nova-compute[73104]: DEBUG nova.compute.manager [req-17d619b5-56f9-4c2a-b59b-847974e1e615 req-eb4089d3-5103-4519-9c91-c0194042aa7b service nova] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Received event network-vif-plugged-0cd045f6-28c7-4bc5-b274-5c8b2bbeb799 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:06:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-17d619b5-56f9-4c2a-b59b-847974e1e615 req-eb4089d3-5103-4519-9c91-c0194042aa7b service nova] Acquiring lock "33175333-7cb3-46d7-bebe-ab8ce3fc2e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:06:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-17d619b5-56f9-4c2a-b59b-847974e1e615 req-eb4089d3-5103-4519-9c91-c0194042aa7b service nova] Lock "33175333-7cb3-46d7-bebe-ab8ce3fc2e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:06:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-17d619b5-56f9-4c2a-b59b-847974e1e615 req-eb4089d3-5103-4519-9c91-c0194042aa7b service nova] Lock "33175333-7cb3-46d7-bebe-ab8ce3fc2e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:06:05 user nova-compute[73104]: DEBUG nova.compute.manager [req-17d619b5-56f9-4c2a-b59b-847974e1e615 req-eb4089d3-5103-4519-9c91-c0194042aa7b service nova] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] No waiting events found dispatching network-vif-plugged-0cd045f6-28c7-4bc5-b274-5c8b2bbeb799 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:06:05 user nova-compute[73104]: WARNING nova.compute.manager [req-17d619b5-56f9-4c2a-b59b-847974e1e615 req-eb4089d3-5103-4519-9c91-c0194042aa7b service nova] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Received unexpected event network-vif-plugged-0cd045f6-28c7-4bc5-b274-5c8b2bbeb799 for instance with vm_state active and task_state deleting.
Aug 26 09:06:05 user nova-compute[73104]: INFO nova.compute.manager [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Took 0.77 seconds to detach 1 volumes for instance.
Aug 26 09:06:05 user nova-compute[73104]: DEBUG nova.compute.manager [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Deleting volume: 58a69286-5aa2-4d90-9aa2-ba764d3d074a {{(pid=73104) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 09:06:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:06:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:06:05 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:06:05 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:06:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.272s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:06:05 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Deleted allocations for instance 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a
Aug 26 09:06:05 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-8e49efe2-c643-4bc2-af48-474a9a191016 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "33175333-7cb3-46d7-bebe-ab8ce3fc2e3a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.362s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:06:07 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:06:07 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:06:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:06:09 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:06:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:06:10 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:06:10 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:06:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:06:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:06:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:06:10 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:06:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527198e4-48e3-4042-98ea-a2ff6258d1e5/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:06:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527198e4-48e3-4042-98ea-a2ff6258d1e5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:06:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527198e4-48e3-4042-98ea-a2ff6258d1e5/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:06:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527198e4-48e3-4042-98ea-a2ff6258d1e5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:06:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:06:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:06:10 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:06:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:06:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:06:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:06:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:06:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:06:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:06:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:06:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:06:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:06:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/093c5d6f-c4ab-470e-86f6-7434295555aa/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:06:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/093c5d6f-c4ab-470e-86f6-7434295555aa/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:06:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/093c5d6f-c4ab-470e-86f6-7434295555aa/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:06:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/093c5d6f-c4ab-470e-86f6-7434295555aa/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:06:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 09:06:12 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:06:12 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:06:12 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8082MB free_disk=24.088088989257812GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:06:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:06:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:06:12 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 56e8f70f-f077-41a7-9cbd-749c40ec0a23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:06:12 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 093c5d6f-c4ab-470e-86f6-7434295555aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:06:12 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:06:12 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 432a66be-853d-42d7-8622-0417ef36045c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:06:12 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 527198e4-48e3-4042-98ea-a2ff6258d1e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:06:12 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:06:12 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:06:13 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:06:13 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:06:13 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:06:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.308s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:06:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:06:14 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:06:14 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:06:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-2c10f0ac-f63d-462d-a999-aa98eb6d91f2" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:06:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-2c10f0ac-f63d-462d-a999-aa98eb6d91f2" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:06:14 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 09:06:14 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Updating instance_info_cache with network_info: [{"id": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "address": "fa:16:3e:f0:cc:d7", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e91d018-83", "ovs_interfaceid": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:06:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-2c10f0ac-f63d-462d-a999-aa98eb6d91f2" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:06:14 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 09:06:14 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:06:14 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:06:15 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:06:15 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:06:18 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693040763.3907228, 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:06:18 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] VM Stopped (Lifecycle Event)
Aug 26 09:06:18 user nova-compute[73104]: DEBUG nova.compute.manager [None req-47e58dc3-91bf-4a90-8590-8b163f4b54f1 None None] [instance: 33175333-7cb3-46d7-bebe-ab8ce3fc2e3a] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:06:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:06:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:06:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:06:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:06:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:06:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:06:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:06:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:06:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:06:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:06:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a860be70-7c6a-4eef-920b-6cdca59586cd tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Acquiring lock "093c5d6f-c4ab-470e-86f6-7434295555aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:06:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a860be70-7c6a-4eef-920b-6cdca59586cd tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "093c5d6f-c4ab-470e-86f6-7434295555aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:06:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a860be70-7c6a-4eef-920b-6cdca59586cd tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Acquiring lock "093c5d6f-c4ab-470e-86f6-7434295555aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:06:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a860be70-7c6a-4eef-920b-6cdca59586cd tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "093c5d6f-c4ab-470e-86f6-7434295555aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:06:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a860be70-7c6a-4eef-920b-6cdca59586cd tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "093c5d6f-c4ab-470e-86f6-7434295555aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:06:40 user nova-compute[73104]: INFO nova.compute.manager [None req-a860be70-7c6a-4eef-920b-6cdca59586cd tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Terminating instance
Aug 26 09:06:40 user nova-compute[73104]: DEBUG nova.compute.manager [None req-a860be70-7c6a-4eef-920b-6cdca59586cd tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 09:06:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:06:41 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:06:41 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:06:41 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:06:41 user nova-compute[73104]: DEBUG nova.compute.manager [req-2611be7c-e61d-4d16-8e59-b0bcc730ede4 req-efabd5cf-f942-4bb9-a0c3-311c097cd7c6 service nova] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Received event network-vif-unplugged-4cc3052a-4671-4201-b0c3-6f7f634a12cc {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:06:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2611be7c-e61d-4d16-8e59-b0bcc730ede4 req-efabd5cf-f942-4bb9-a0c3-311c097cd7c6 service nova] Acquiring lock "093c5d6f-c4ab-470e-86f6-7434295555aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:06:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2611be7c-e61d-4d16-8e59-b0bcc730ede4 req-efabd5cf-f942-4bb9-a0c3-311c097cd7c6 service nova] Lock "093c5d6f-c4ab-470e-86f6-7434295555aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:06:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2611be7c-e61d-4d16-8e59-b0bcc730ede4 req-efabd5cf-f942-4bb9-a0c3-311c097cd7c6 service nova] Lock "093c5d6f-c4ab-470e-86f6-7434295555aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:06:41 user nova-compute[73104]: DEBUG nova.compute.manager [req-2611be7c-e61d-4d16-8e59-b0bcc730ede4 req-efabd5cf-f942-4bb9-a0c3-311c097cd7c6 service nova] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] No waiting events found dispatching network-vif-unplugged-4cc3052a-4671-4201-b0c3-6f7f634a12cc {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:06:41 user nova-compute[73104]: DEBUG nova.compute.manager [req-2611be7c-e61d-4d16-8e59-b0bcc730ede4 req-efabd5cf-f942-4bb9-a0c3-311c097cd7c6 service nova] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Received event network-vif-unplugged-4cc3052a-4671-4201-b0c3-6f7f634a12cc for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 09:06:41 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Instance destroyed successfully.
Aug 26 09:06:41 user nova-compute[73104]: DEBUG nova.objects.instance [None req-a860be70-7c6a-4eef-920b-6cdca59586cd tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lazy-loading 'resources' on Instance uuid 093c5d6f-c4ab-470e-86f6-7434295555aa {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:06:41 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-a860be70-7c6a-4eef-920b-6cdca59586cd tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:02:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-379130076',display_name='tempest-TestServerVolumeAttachmentScenario-server-379130076',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-379130076',id=40,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcvJ9UvOKzeiXSG8HzoOUBbI1R0ct1He/ei9rB0XSMCdOP/xPClTW57v/bJ0kyWStyPBZB7CVTPQq+8YOgDPQfBuiUavun9yDUP9hAT2hCMJcLzRmFORtHIFi9owx0kOw==',key_name='tempest-keypair-1109707204',keypairs=<?>,launch_index=0,launched_at=2023-08-26T09:02:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f10314719d1a4b6ba0d23fbd05f8378e',ramdisk_id='',reservation_id='r-38fjusim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1886190242',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1886190242-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T09:02:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7bd92a0b9b84a3388267f59332b254c',uuid=093c5d6f-c4ab-470e-86f6-7434295555aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4cc3052a-4671-4201-b0c3-6f7f634a12cc", "address": "fa:16:3e:3c:ee:dd", "network": {"id": "e7648e7b-2516-4dda-8315-40a01975b663", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-350226034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f10314719d1a4b6ba0d23fbd05f8378e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc3052a-46", "ovs_interfaceid": "4cc3052a-4671-4201-b0c3-6f7f634a12cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 09:06:41 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-a860be70-7c6a-4eef-920b-6cdca59586cd tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Converting VIF {"id": "4cc3052a-4671-4201-b0c3-6f7f634a12cc", "address": "fa:16:3e:3c:ee:dd", "network": {"id": "e7648e7b-2516-4dda-8315-40a01975b663", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-350226034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f10314719d1a4b6ba0d23fbd05f8378e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc3052a-46", "ovs_interfaceid": "4cc3052a-4671-4201-b0c3-6f7f634a12cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:06:41 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-a860be70-7c6a-4eef-920b-6cdca59586cd tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:ee:dd,bridge_name='br-int',has_traffic_filtering=True,id=4cc3052a-4671-4201-b0c3-6f7f634a12cc,network=Network(e7648e7b-2516-4dda-8315-40a01975b663),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc3052a-46') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:06:41 user nova-compute[73104]: DEBUG os_vif [None req-a860be70-7c6a-4eef-920b-6cdca59586cd tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:ee:dd,bridge_name='br-int',has_traffic_filtering=True,id=4cc3052a-4671-4201-b0c3-6f7f634a12cc,network=Network(e7648e7b-2516-4dda-8315-40a01975b663),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc3052a-46') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 09:06:41 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:06:41 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4cc3052a-46, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:06:41 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:06:41 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:06:41 user nova-compute[73104]: INFO os_vif [None req-a860be70-7c6a-4eef-920b-6cdca59586cd tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:ee:dd,bridge_name='br-int',has_traffic_filtering=True,id=4cc3052a-4671-4201-b0c3-6f7f634a12cc,network=Network(e7648e7b-2516-4dda-8315-40a01975b663),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc3052a-46')
Aug 26 09:06:41 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-a860be70-7c6a-4eef-920b-6cdca59586cd tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Deleting instance files /opt/stack/data/nova/instances/093c5d6f-c4ab-470e-86f6-7434295555aa_del
Aug 26 09:06:41 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-a860be70-7c6a-4eef-920b-6cdca59586cd tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Deletion of /opt/stack/data/nova/instances/093c5d6f-c4ab-470e-86f6-7434295555aa_del complete
Aug 26 09:06:42 user nova-compute[73104]: INFO nova.compute.manager [None req-a860be70-7c6a-4eef-920b-6cdca59586cd tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 26 09:06:42 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-a860be70-7c6a-4eef-920b-6cdca59586cd tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 09:06:42 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 09:06:42 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 09:06:43 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:06:43 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Took 0.98 seconds to deallocate network for instance.
Aug 26 09:06:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a860be70-7c6a-4eef-920b-6cdca59586cd tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:06:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a860be70-7c6a-4eef-920b-6cdca59586cd tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:06:43 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-a860be70-7c6a-4eef-920b-6cdca59586cd tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:06:43 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-a860be70-7c6a-4eef-920b-6cdca59586cd tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:06:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a860be70-7c6a-4eef-920b-6cdca59586cd tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:06:43 user nova-compute[73104]: DEBUG nova.compute.manager [req-5187e99f-1ec3-4750-ab1d-55e7b1388233 req-36571ab5-f199-42c5-a79e-cdffca94e72f service nova] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Received event network-vif-plugged-4cc3052a-4671-4201-b0c3-6f7f634a12cc {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:06:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5187e99f-1ec3-4750-ab1d-55e7b1388233 req-36571ab5-f199-42c5-a79e-cdffca94e72f service nova] Acquiring lock "093c5d6f-c4ab-470e-86f6-7434295555aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:06:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5187e99f-1ec3-4750-ab1d-55e7b1388233 req-36571ab5-f199-42c5-a79e-cdffca94e72f service nova] Lock "093c5d6f-c4ab-470e-86f6-7434295555aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:06:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5187e99f-1ec3-4750-ab1d-55e7b1388233 req-36571ab5-f199-42c5-a79e-cdffca94e72f service nova] Lock "093c5d6f-c4ab-470e-86f6-7434295555aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:06:43 user nova-compute[73104]: DEBUG nova.compute.manager [req-5187e99f-1ec3-4750-ab1d-55e7b1388233 req-36571ab5-f199-42c5-a79e-cdffca94e72f service nova] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] No waiting events found dispatching network-vif-plugged-4cc3052a-4671-4201-b0c3-6f7f634a12cc {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:06:43 user nova-compute[73104]: WARNING nova.compute.manager [req-5187e99f-1ec3-4750-ab1d-55e7b1388233 req-36571ab5-f199-42c5-a79e-cdffca94e72f service nova] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Received unexpected event network-vif-plugged-4cc3052a-4671-4201-b0c3-6f7f634a12cc for instance with vm_state deleted and task_state None.
Aug 26 09:06:43 user nova-compute[73104]: DEBUG nova.compute.manager [req-5187e99f-1ec3-4750-ab1d-55e7b1388233 req-36571ab5-f199-42c5-a79e-cdffca94e72f service nova] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Received event network-vif-deleted-4cc3052a-4671-4201-b0c3-6f7f634a12cc {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:06:43 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-a860be70-7c6a-4eef-920b-6cdca59586cd tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Deleted allocations for instance 093c5d6f-c4ab-470e-86f6-7434295555aa
Aug 26 09:06:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a860be70-7c6a-4eef-920b-6cdca59586cd tempest-TestServerVolumeAttachmentScenario-1886190242 tempest-TestServerVolumeAttachmentScenario-1886190242-project-member] Lock "093c5d6f-c4ab-470e-86f6-7434295555aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.490s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:06:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:06:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:06:51 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:06:56 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693040801.6700273, 093c5d6f-c4ab-470e-86f6-7434295555aa => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:06:56 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] VM Stopped (Lifecycle Event)
Aug 26 09:06:56 user nova-compute[73104]: DEBUG nova.compute.manager [None req-75337d7e-aeb5-4406-a051-2e95f4ad8d06 None None] [instance: 093c5d6f-c4ab-470e-86f6-7434295555aa] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:06:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:06:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:06:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:06:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:06:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:06:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:06:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "56e8f70f-f077-41a7-9cbd-749c40ec0a23" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:06:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "56e8f70f-f077-41a7-9cbd-749c40ec0a23" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:06:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "56e8f70f-f077-41a7-9cbd-749c40ec0a23-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:06:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "56e8f70f-f077-41a7-9cbd-749c40ec0a23-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:06:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "56e8f70f-f077-41a7-9cbd-749c40ec0a23-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:06:59 user nova-compute[73104]: INFO nova.compute.manager [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Terminating instance
Aug 26 09:06:59 user nova-compute[73104]: DEBUG nova.compute.manager [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 09:06:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:06:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:06:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:06:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:06:59 user nova-compute[73104]: DEBUG nova.compute.manager [req-f3178fef-64d9-4cd9-89f4-a1dd7a30ccf3 req-99707c40-42be-4c50-ad79-78931996509a service nova] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Received event network-vif-unplugged-7dbed8ca-ccd9-491a-9abe-c0a71f17e2af {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:06:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f3178fef-64d9-4cd9-89f4-a1dd7a30ccf3 req-99707c40-42be-4c50-ad79-78931996509a service nova] Acquiring lock "56e8f70f-f077-41a7-9cbd-749c40ec0a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:06:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f3178fef-64d9-4cd9-89f4-a1dd7a30ccf3 req-99707c40-42be-4c50-ad79-78931996509a service nova] Lock "56e8f70f-f077-41a7-9cbd-749c40ec0a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:06:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f3178fef-64d9-4cd9-89f4-a1dd7a30ccf3 req-99707c40-42be-4c50-ad79-78931996509a service nova] Lock "56e8f70f-f077-41a7-9cbd-749c40ec0a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:06:59 user nova-compute[73104]: DEBUG nova.compute.manager [req-f3178fef-64d9-4cd9-89f4-a1dd7a30ccf3 req-99707c40-42be-4c50-ad79-78931996509a service nova] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] No waiting events found dispatching network-vif-unplugged-7dbed8ca-ccd9-491a-9abe-c0a71f17e2af {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:06:59 user nova-compute[73104]: DEBUG nova.compute.manager [req-f3178fef-64d9-4cd9-89f4-a1dd7a30ccf3 req-99707c40-42be-4c50-ad79-78931996509a service nova] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Received event network-vif-unplugged-7dbed8ca-ccd9-491a-9abe-c0a71f17e2af for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 09:07:00 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Instance destroyed successfully.
Aug 26 09:07:00 user nova-compute[73104]: DEBUG nova.objects.instance [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lazy-loading 'resources' on Instance uuid 56e8f70f-f077-41a7-9cbd-749c40ec0a23 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:02:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1991857493',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1991857493',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1991857493',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPEQWXOPX4GJR2SwUUbvPmB8y/rgY1wN6ELjP7tBluOT610x8Gq5t/UH38fHqrIDxRNj9+nrBXIDox4qwcjnMQyVEXhOgj1hovUE7Ta2xcMsojoFMeytCQBM9VWC+1rVA==',key_name='tempest-keypair-1751671084',keypairs=<?>,launch_index=0,launched_at=2023-08-26T09:02:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52518aa77344432385cfc2b73c63aebe',ramdisk_id='',reservation_id='r-x53p0pir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1466837638',owner_user_name='tempest-TestVolumeBootPattern-1466837638-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T09:02:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bae03c9c8a9a40b2af6bd1fefb3561d0',uuid=56e8f70f-f077-41a7-9cbd-749c40ec0a23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7dbed8ca-ccd9-491a-9abe-c0a71f17e2af", "address": "fa:16:3e:6a:35:ce", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dbed8ca-cc", "ovs_interfaceid": "7dbed8ca-ccd9-491a-9abe-c0a71f17e2af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converting VIF {"id": "7dbed8ca-ccd9-491a-9abe-c0a71f17e2af", "address": "fa:16:3e:6a:35:ce", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dbed8ca-cc", "ovs_interfaceid": "7dbed8ca-ccd9-491a-9abe-c0a71f17e2af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:35:ce,bridge_name='br-int',has_traffic_filtering=True,id=7dbed8ca-ccd9-491a-9abe-c0a71f17e2af,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dbed8ca-cc') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG os_vif [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:35:ce,bridge_name='br-int',has_traffic_filtering=True,id=7dbed8ca-ccd9-491a-9abe-c0a71f17e2af,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dbed8ca-cc') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7dbed8ca-cc, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:07:00 user nova-compute[73104]: INFO os_vif [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:35:ce,bridge_name='br-int',has_traffic_filtering=True,id=7dbed8ca-ccd9-491a-9abe-c0a71f17e2af,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dbed8ca-cc')
Aug 26 09:07:00 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVsApFlG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:07:00 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:07:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0064c995-5932-4ea4-a484-c9024f5f7656]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c983161-4192-489e-99ac-8396defc9a4a]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:07:00 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e (non-flash)
Aug 26 09:07:00 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0cc2c5360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e'): ({'sdc'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Removing single pathed devices sdc {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0064a120-15d8-48c3-b439-2d2d4343f480]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[99340df2-c467-45cb-aeee-8515f9732124]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Flushing IO for device /dev/sdc {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b50e7b-240d-4fbf-949f-4097f414cee4]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0feb7ff8-bae0-4590-86f1-83a0f2496c7a]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] SCSI volumes sdc have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOf2940467-8f18366df82d118e', '/dev/disk/by-id/scsi-23866313833363664', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f2940467') {{(pid=84263) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99993a6-1159-46b7-8d1a-a64be9bf83a3]: (4, None) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d8bd4c-d381-4afb-91b9-ff78dee3a99c]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30fea6b-3149-455c-833e-51b0eb797fb7]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e, portal: 172.16.0.220,3260]
Aug 26 09:07:00 user nova-compute[73104]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e, portal: 172.16.0.220,3260] successful.
Aug 26 09:07:00 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bb579eb-a354-482f-93fd-8a500f30d57e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f584267-1095-4457-ba18-8150d8e0d927]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] <== disconnect_volume: return (279ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 09:07:00 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Deleting instance files /opt/stack/data/nova/instances/56e8f70f-f077-41a7-9cbd-749c40ec0a23_del
Aug 26 09:07:00 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Deletion of /opt/stack/data/nova/instances/56e8f70f-f077-41a7-9cbd-749c40ec0a23_del complete
Aug 26 09:07:00 user nova-compute[73104]: INFO nova.compute.manager [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 26 09:07:00 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 09:07:00 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 09:07:01 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:07:01 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Took 0.87 seconds to deallocate network for instance.
Aug 26 09:07:01 user nova-compute[73104]: DEBUG nova.compute.manager [req-77e03a37-912b-4dee-95cd-2d906bc60675 req-0260ab61-0e3a-4563-951e-4b3d105f5a8b service nova] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Received event network-vif-deleted-7dbed8ca-ccd9-491a-9abe-c0a71f17e2af {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:07:02 user nova-compute[73104]: DEBUG nova.compute.manager [req-ea555ac7-1b04-4ac0-b16a-82e0b87964be req-721c4db0-f7b7-4aeb-aafc-008e437767bf service nova] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Received event network-vif-plugged-7dbed8ca-ccd9-491a-9abe-c0a71f17e2af {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:07:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ea555ac7-1b04-4ac0-b16a-82e0b87964be req-721c4db0-f7b7-4aeb-aafc-008e437767bf service nova] Acquiring lock "56e8f70f-f077-41a7-9cbd-749c40ec0a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:07:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ea555ac7-1b04-4ac0-b16a-82e0b87964be req-721c4db0-f7b7-4aeb-aafc-008e437767bf service nova] Lock "56e8f70f-f077-41a7-9cbd-749c40ec0a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:07:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ea555ac7-1b04-4ac0-b16a-82e0b87964be req-721c4db0-f7b7-4aeb-aafc-008e437767bf service nova] Lock "56e8f70f-f077-41a7-9cbd-749c40ec0a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:07:02 user nova-compute[73104]: DEBUG nova.compute.manager [req-ea555ac7-1b04-4ac0-b16a-82e0b87964be req-721c4db0-f7b7-4aeb-aafc-008e437767bf service nova] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] No waiting events found dispatching network-vif-plugged-7dbed8ca-ccd9-491a-9abe-c0a71f17e2af {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:07:02 user nova-compute[73104]: WARNING nova.compute.manager [req-ea555ac7-1b04-4ac0-b16a-82e0b87964be req-721c4db0-f7b7-4aeb-aafc-008e437767bf service nova] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Received unexpected event network-vif-plugged-7dbed8ca-ccd9-491a-9abe-c0a71f17e2af for instance with vm_state active and task_state deleting.
Aug 26 09:07:02 user nova-compute[73104]: INFO nova.compute.manager [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Took 0.85 seconds to detach 1 volumes for instance.
Aug 26 09:07:02 user nova-compute[73104]: DEBUG nova.compute.manager [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Deleting volume: 2bb579eb-a354-482f-93fd-8a500f30d57e {{(pid=73104) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 09:07:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:07:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:07:02 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:07:02 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:07:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.231s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:07:02 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Deleted allocations for instance 56e8f70f-f077-41a7-9cbd-749c40ec0a23
Aug 26 09:07:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ba86b71e-2d4e-497d-8b87-fb1dca091441 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "56e8f70f-f077-41a7-9cbd-749c40ec0a23" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.361s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:07:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:07:07 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:07:07 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:07:09 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:07:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:07:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:07:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:07:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:07:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:07:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:07:11 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:07:11 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:07:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:07:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:07:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:07:11 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:07:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527198e4-48e3-4042-98ea-a2ff6258d1e5/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:07:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527198e4-48e3-4042-98ea-a2ff6258d1e5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:07:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527198e4-48e3-4042-98ea-a2ff6258d1e5/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:07:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527198e4-48e3-4042-98ea-a2ff6258d1e5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:07:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:07:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:07:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:07:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:07:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:07:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:07:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:07:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:07:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:07:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:07:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:07:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:07:13 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:07:13 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:07:13 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8410MB free_disk=24.113880157470703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:07:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:07:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:07:13 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:07:13 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 432a66be-853d-42d7-8622-0417ef36045c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:07:13 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 527198e4-48e3-4042-98ea-a2ff6258d1e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:07:13 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:07:13 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:07:13 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:07:13 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:07:13 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:07:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.268s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:07:14 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:07:14 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:07:15 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:07:15 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:07:15 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:07:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-432a66be-853d-42d7-8622-0417ef36045c" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:07:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-432a66be-853d-42d7-8622-0417ef36045c" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:07:15 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 09:07:15 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693040820.4115214, 56e8f70f-f077-41a7-9cbd-749c40ec0a23 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:07:15 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] VM Stopped (Lifecycle Event)
Aug 26 09:07:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:07:15 user nova-compute[73104]: DEBUG nova.compute.manager [None req-11af1d7a-372a-4eda-a1c0-6ea62c36dd50 None None] [instance: 56e8f70f-f077-41a7-9cbd-749c40ec0a23] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:07:15 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Updating instance_info_cache with network_info: [{"id": "52b25498-8470-454f-9cf5-4989ec64751a", "address": "fa:16:3e:76:d4:93", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b25498-84", "ovs_interfaceid": "52b25498-8470-454f-9cf5-4989ec64751a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:07:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-432a66be-853d-42d7-8622-0417ef36045c" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:07:15 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 09:07:16 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:07:20 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:07:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:07:21 user nova-compute[73104]: INFO nova.compute.manager [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Rescuing
Aug 26 09:07:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "refresh_cache-2c10f0ac-f63d-462d-a999-aa98eb6d91f2" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:07:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquired lock "refresh_cache-2c10f0ac-f63d-462d-a999-aa98eb6d91f2" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:07:21 user nova-compute[73104]: DEBUG nova.network.neutron [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 09:07:22 user nova-compute[73104]: DEBUG nova.network.neutron [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Updating instance_info_cache with network_info: [{"id": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "address": "fa:16:3e:f0:cc:d7", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e91d018-83", "ovs_interfaceid": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:07:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Releasing lock "refresh_cache-2c10f0ac-f63d-462d-a999-aa98eb6d91f2" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:07:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:07:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:07:22 user nova-compute[73104]: DEBUG nova.compute.manager [req-309ea083-c610-449e-981a-104c8aa583f1 req-8a20af44-8dfa-45a3-9ccc-6472c4b920e0 service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Received event network-vif-unplugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:07:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-309ea083-c610-449e-981a-104c8aa583f1 req-8a20af44-8dfa-45a3-9ccc-6472c4b920e0 service nova] Acquiring lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:07:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-309ea083-c610-449e-981a-104c8aa583f1 req-8a20af44-8dfa-45a3-9ccc-6472c4b920e0 service nova] Lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:07:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-309ea083-c610-449e-981a-104c8aa583f1 req-8a20af44-8dfa-45a3-9ccc-6472c4b920e0 service nova] Lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:07:22 user nova-compute[73104]: DEBUG nova.compute.manager [req-309ea083-c610-449e-981a-104c8aa583f1 req-8a20af44-8dfa-45a3-9ccc-6472c4b920e0 service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] No waiting events found dispatching network-vif-unplugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:07:22 user nova-compute[73104]: WARNING nova.compute.manager [req-309ea083-c610-449e-981a-104c8aa583f1 req-8a20af44-8dfa-45a3-9ccc-6472c4b920e0 service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Received unexpected event network-vif-unplugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f for instance with vm_state active and task_state rescuing.
Aug 26 09:07:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:07:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:07:23 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Instance destroyed successfully.
Aug 26 09:07:23 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Attempting rescue
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73104) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Instance directory exists: not creating {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 09:07:23 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Creating image(s)
Aug 26 09:07:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "/opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "/opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "/opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.objects.instance [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.181s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk.rescue {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk.rescue" returned: 0 in 0.062s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.objects.instance [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lazy-loading 'migration_context' on Instance uuid 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.objects.base [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Object Instance<2c10f0ac-f63d-462d-a999-aa98eb6d91f2> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Start _get_guest_xml network_info=[{"id": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "address": "fa:16:3e:f0:cc:d7", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "vif_mac": "fa:16:3e:f0:cc:d7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e91d018-83", "ovs_interfaceid": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.objects.instance [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lazy-loading 'resources' on Instance uuid 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.objects.base [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Object Instance<2c10f0ac-f63d-462d-a999-aa98eb6d91f2> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.objects.instance [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lazy-loading 'numa_topology' on Instance uuid 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.objects.base [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Object Instance<2c10f0ac-f63d-462d-a999-aa98eb6d91f2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 09:07:23 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:07:23 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.objects.instance [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.objects.base [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Object Instance<2c10f0ac-f63d-462d-a999-aa98eb6d91f2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-636224961',display_name='tempest-ServerRescueNegativeTestJSON-server-636224961',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-636224961',id=41,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T09:02:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b7642d165474defadde34dabc11f842',ramdisk_id='',reservation_id='r-dt3wsa96',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-901062798',owner_user_name='tempest-ServerRescueNegativeTestJSON-901062798-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:02:45Z,user_data=None,user_id='da4b6574d165418eaf2b8c8b84d6151f',uuid=2c10f0ac-f63d-462d-a999-aa98eb6d91f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "address": "fa:16:3e:f0:cc:d7", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "vif_mac": "fa:16:3e:f0:cc:d7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e91d018-83", "ovs_interfaceid": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Converting VIF {"id": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "address": "fa:16:3e:f0:cc:d7", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "vif_mac": "fa:16:3e:f0:cc:d7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e91d018-83", "ovs_interfaceid": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:cc:d7,bridge_name='br-int',has_traffic_filtering=True,id=5e91d018-838e-4b87-bd5f-1b5f31c22d5f,network=Network(fb2d19ab-1c79-4529-b058-e1b8c4fc8276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e91d018-83') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.objects.instance [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.objects.base [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Object Instance<2c10f0ac-f63d-462d-a999-aa98eb6d91f2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] End _get_guest_xml xml=<domain type="kvm">
Aug 26 09:07:23 user nova-compute[73104]:   <uuid>2c10f0ac-f63d-462d-a999-aa98eb6d91f2</uuid>
Aug 26 09:07:23 user nova-compute[73104]:   <name>instance-00000029</name>
Aug 26 09:07:23 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 09:07:23 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 09:07:23 user nova-compute[73104]:   <metadata>
Aug 26 09:07:23 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 09:07:23 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 09:07:23 user nova-compute[73104]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-636224961</nova:name>
Aug 26 09:07:23 user nova-compute[73104]:       <nova:creationTime>2023-08-26 09:07:23</nova:creationTime>
Aug 26 09:07:23 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 09:07:23 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 09:07:23 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 09:07:23 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 09:07:23 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 09:07:23 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 09:07:23 user nova-compute[73104]:       </nova:flavor>
Aug 26 09:07:23 user nova-compute[73104]:       <nova:owner>
Aug 26 09:07:23 user nova-compute[73104]:         <nova:user uuid="da4b6574d165418eaf2b8c8b84d6151f">tempest-ServerRescueNegativeTestJSON-901062798-project-member</nova:user>
Aug 26 09:07:23 user nova-compute[73104]:         <nova:project uuid="0b7642d165474defadde34dabc11f842">tempest-ServerRescueNegativeTestJSON-901062798</nova:project>
Aug 26 09:07:23 user nova-compute[73104]:       </nova:owner>
Aug 26 09:07:23 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 09:07:23 user nova-compute[73104]:       <nova:ports>
Aug 26 09:07:23 user nova-compute[73104]:         <nova:port uuid="5e91d018-838e-4b87-bd5f-1b5f31c22d5f">
Aug 26 09:07:23 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 09:07:23 user nova-compute[73104]:         </nova:port>
Aug 26 09:07:23 user nova-compute[73104]:       </nova:ports>
Aug 26 09:07:23 user nova-compute[73104]:     </nova:instance>
Aug 26 09:07:23 user nova-compute[73104]:   </metadata>
Aug 26 09:07:23 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 09:07:23 user nova-compute[73104]:     <system>
Aug 26 09:07:23 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 09:07:23 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 09:07:23 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 09:07:23 user nova-compute[73104]:       <entry name="serial">2c10f0ac-f63d-462d-a999-aa98eb6d91f2</entry>
Aug 26 09:07:23 user nova-compute[73104]:       <entry name="uuid">2c10f0ac-f63d-462d-a999-aa98eb6d91f2</entry>
Aug 26 09:07:23 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 09:07:23 user nova-compute[73104]:     </system>
Aug 26 09:07:23 user nova-compute[73104]:   </sysinfo>
Aug 26 09:07:23 user nova-compute[73104]:   <os>
Aug 26 09:07:23 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 09:07:23 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 09:07:23 user nova-compute[73104]:   </os>
Aug 26 09:07:23 user nova-compute[73104]:   <features>
Aug 26 09:07:23 user nova-compute[73104]:     <acpi/>
Aug 26 09:07:23 user nova-compute[73104]:     <apic/>
Aug 26 09:07:23 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 09:07:23 user nova-compute[73104]:   </features>
Aug 26 09:07:23 user nova-compute[73104]:   <clock offset="utc">
Aug 26 09:07:23 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 09:07:23 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 09:07:23 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 09:07:23 user nova-compute[73104]:   </clock>
Aug 26 09:07:23 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 09:07:23 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 09:07:23 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 09:07:23 user nova-compute[73104]:   </cpu>
Aug 26 09:07:23 user nova-compute[73104]:   <devices>
Aug 26 09:07:23 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 09:07:23 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 09:07:23 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk.rescue"/>
Aug 26 09:07:23 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 09:07:23 user nova-compute[73104]:     </disk>
Aug 26 09:07:23 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 09:07:23 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 09:07:23 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk"/>
Aug 26 09:07:23 user nova-compute[73104]:       <target dev="vdb" bus="virtio"/>
Aug 26 09:07:23 user nova-compute[73104]:     </disk>
Aug 26 09:07:23 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 09:07:23 user nova-compute[73104]:       <mac address="fa:16:3e:f0:cc:d7"/>
Aug 26 09:07:23 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:07:23 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 09:07:23 user nova-compute[73104]:       <target dev="tap5e91d018-83"/>
Aug 26 09:07:23 user nova-compute[73104]:     </interface>
Aug 26 09:07:23 user nova-compute[73104]:     <serial type="pty">
Aug 26 09:07:23 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/console.log" append="off"/>
Aug 26 09:07:23 user nova-compute[73104]:     </serial>
Aug 26 09:07:23 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 09:07:23 user nova-compute[73104]:     <video>
Aug 26 09:07:23 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:07:23 user nova-compute[73104]:     </video>
Aug 26 09:07:23 user nova-compute[73104]:     <rng model="virtio">
Aug 26 09:07:23 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 09:07:23 user nova-compute[73104]:     </rng>
Aug 26 09:07:23 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 09:07:23 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 09:07:23 user nova-compute[73104]:       <stats period="10"/>
Aug 26 09:07:23 user nova-compute[73104]:     </memballoon>
Aug 26 09:07:23 user nova-compute[73104]:   </devices>
Aug 26 09:07:23 user nova-compute[73104]: </domain>
Aug 26 09:07:23 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 09:07:23 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Instance destroyed successfully.
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:07:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] No VIF found with MAC fa:16:3e:f0:cc:d7, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 09:07:24 user nova-compute[73104]: DEBUG nova.compute.manager [req-39aeb958-71ad-47cf-a108-cff32d2398bd req-71aab530-059c-477b-babe-3c303b7c7ded service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Received event network-vif-plugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:07:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-39aeb958-71ad-47cf-a108-cff32d2398bd req-71aab530-059c-477b-babe-3c303b7c7ded service nova] Acquiring lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:07:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-39aeb958-71ad-47cf-a108-cff32d2398bd req-71aab530-059c-477b-babe-3c303b7c7ded service nova] Lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:07:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-39aeb958-71ad-47cf-a108-cff32d2398bd req-71aab530-059c-477b-babe-3c303b7c7ded service nova] Lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:07:24 user nova-compute[73104]: DEBUG nova.compute.manager [req-39aeb958-71ad-47cf-a108-cff32d2398bd req-71aab530-059c-477b-babe-3c303b7c7ded service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] No waiting events found dispatching network-vif-plugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:07:24 user nova-compute[73104]: WARNING nova.compute.manager [req-39aeb958-71ad-47cf-a108-cff32d2398bd req-71aab530-059c-477b-babe-3c303b7c7ded service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Received unexpected event network-vif-plugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f for instance with vm_state active and task_state rescuing.
Aug 26 09:07:25 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:07:25 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:07:25 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:07:25 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:07:25 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:07:26 user nova-compute[73104]: DEBUG nova.compute.manager [req-6114b378-a271-4393-b8fa-66bd535f46c6 req-3018ef26-0bda-4445-b3ab-90cd00a33bdc service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Received event network-vif-plugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:07:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6114b378-a271-4393-b8fa-66bd535f46c6 req-3018ef26-0bda-4445-b3ab-90cd00a33bdc service nova] Acquiring lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:07:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6114b378-a271-4393-b8fa-66bd535f46c6 req-3018ef26-0bda-4445-b3ab-90cd00a33bdc service nova] Lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:07:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6114b378-a271-4393-b8fa-66bd535f46c6 req-3018ef26-0bda-4445-b3ab-90cd00a33bdc service nova] Lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:07:26 user nova-compute[73104]: DEBUG nova.compute.manager [req-6114b378-a271-4393-b8fa-66bd535f46c6 req-3018ef26-0bda-4445-b3ab-90cd00a33bdc service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] No waiting events found dispatching network-vif-plugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:07:26 user nova-compute[73104]: WARNING nova.compute.manager [req-6114b378-a271-4393-b8fa-66bd535f46c6 req-3018ef26-0bda-4445-b3ab-90cd00a33bdc service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Received unexpected event network-vif-plugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f for instance with vm_state active and task_state rescuing.
Aug 26 09:07:26 user nova-compute[73104]: DEBUG nova.compute.manager [req-6114b378-a271-4393-b8fa-66bd535f46c6 req-3018ef26-0bda-4445-b3ab-90cd00a33bdc service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Received event network-vif-plugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:07:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6114b378-a271-4393-b8fa-66bd535f46c6 req-3018ef26-0bda-4445-b3ab-90cd00a33bdc service nova] Acquiring lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:07:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6114b378-a271-4393-b8fa-66bd535f46c6 req-3018ef26-0bda-4445-b3ab-90cd00a33bdc service nova] Lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:07:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6114b378-a271-4393-b8fa-66bd535f46c6 req-3018ef26-0bda-4445-b3ab-90cd00a33bdc service nova] Lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:07:26 user nova-compute[73104]: DEBUG nova.compute.manager [req-6114b378-a271-4393-b8fa-66bd535f46c6 req-3018ef26-0bda-4445-b3ab-90cd00a33bdc service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] No waiting events found dispatching network-vif-plugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:07:26 user nova-compute[73104]: WARNING nova.compute.manager [req-6114b378-a271-4393-b8fa-66bd535f46c6 req-3018ef26-0bda-4445-b3ab-90cd00a33bdc service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Received unexpected event network-vif-plugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f for instance with vm_state active and task_state rescuing.
Aug 26 09:07:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Removed pending event for 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 due to event {{(pid=73104) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 09:07:27 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040847.4343843, 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:07:27 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] VM Resumed (Lifecycle Event)
Aug 26 09:07:27 user nova-compute[73104]: DEBUG nova.compute.manager [None req-62a84ede-ca96-46f5-a355-b8a69b939945 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:07:27 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:07:27 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:07:27 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 09:07:27 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040847.4361298, 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:07:27 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] VM Started (Lifecycle Event)
Aug 26 09:07:27 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:07:27 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:07:27 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 09:07:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:07:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:07:35 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:07:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-03458fca-3f77-4f76-a1fb-d82b9673b63c tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Acquiring lock "527198e4-48e3-4042-98ea-a2ff6258d1e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:07:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-03458fca-3f77-4f76-a1fb-d82b9673b63c tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Lock "527198e4-48e3-4042-98ea-a2ff6258d1e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:07:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-03458fca-3f77-4f76-a1fb-d82b9673b63c tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Acquiring lock "527198e4-48e3-4042-98ea-a2ff6258d1e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:07:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-03458fca-3f77-4f76-a1fb-d82b9673b63c tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Lock "527198e4-48e3-4042-98ea-a2ff6258d1e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:07:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-03458fca-3f77-4f76-a1fb-d82b9673b63c tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Lock "527198e4-48e3-4042-98ea-a2ff6258d1e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:07:38 user nova-compute[73104]: INFO nova.compute.manager [None req-03458fca-3f77-4f76-a1fb-d82b9673b63c tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Terminating instance
Aug 26 09:07:38 user nova-compute[73104]: DEBUG nova.compute.manager [None req-03458fca-3f77-4f76-a1fb-d82b9673b63c tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 09:07:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:07:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:07:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:07:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:07:38 user nova-compute[73104]: DEBUG nova.compute.manager [req-d775ae29-2ed2-4d0c-830f-55a4256230fd req-62d63fb9-720c-4488-bc98-64767e88cecf service nova] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Received event network-vif-unplugged-5e6197a8-e19a-461b-88da-fd8369354ea0 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:07:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d775ae29-2ed2-4d0c-830f-55a4256230fd req-62d63fb9-720c-4488-bc98-64767e88cecf service nova] Acquiring lock "527198e4-48e3-4042-98ea-a2ff6258d1e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:07:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d775ae29-2ed2-4d0c-830f-55a4256230fd req-62d63fb9-720c-4488-bc98-64767e88cecf service nova] Lock "527198e4-48e3-4042-98ea-a2ff6258d1e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:07:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d775ae29-2ed2-4d0c-830f-55a4256230fd req-62d63fb9-720c-4488-bc98-64767e88cecf service nova] Lock "527198e4-48e3-4042-98ea-a2ff6258d1e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:07:38 user nova-compute[73104]: DEBUG nova.compute.manager [req-d775ae29-2ed2-4d0c-830f-55a4256230fd req-62d63fb9-720c-4488-bc98-64767e88cecf service nova] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] No waiting events found dispatching network-vif-unplugged-5e6197a8-e19a-461b-88da-fd8369354ea0 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:07:38 user nova-compute[73104]: DEBUG nova.compute.manager [req-d775ae29-2ed2-4d0c-830f-55a4256230fd req-62d63fb9-720c-4488-bc98-64767e88cecf service nova] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Received event network-vif-unplugged-5e6197a8-e19a-461b-88da-fd8369354ea0 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 09:07:39 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Instance destroyed successfully.
Aug 26 09:07:39 user nova-compute[73104]: DEBUG nova.objects.instance [None req-03458fca-3f77-4f76-a1fb-d82b9673b63c tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Lazy-loading 'resources' on Instance uuid 527198e4-48e3-4042-98ea-a2ff6258d1e5 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:07:39 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-03458fca-3f77-4f76-a1fb-d82b9673b63c tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:05:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1580623801',display_name='tempest-VolumesActionsTest-instance-1580623801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1580623801',id=44,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T09:05:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e9e3d624278a4654adf8f1f1ed225e57',ramdisk_id='',reservation_id='r-0b1hphzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1198168530',owner_user_name='tempest-VolumesActionsTest-1198168530-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T09:05:36Z,user_data=None,user_id='89a9e3dcd2914aa494455bccefa4e9fb',uuid=527198e4-48e3-4042-98ea-a2ff6258d1e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e6197a8-e19a-461b-88da-fd8369354ea0", "address": "fa:16:3e:b1:47:fe", "network": {"id": "47768db2-7960-4cb7-a093-5b1c393e3e39", "bridge": "br-int", "label": "tempest-VolumesActionsTest-915078599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9e3d624278a4654adf8f1f1ed225e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6197a8-e1", "ovs_interfaceid": "5e6197a8-e19a-461b-88da-fd8369354ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 09:07:39 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-03458fca-3f77-4f76-a1fb-d82b9673b63c tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Converting VIF {"id": "5e6197a8-e19a-461b-88da-fd8369354ea0", "address": "fa:16:3e:b1:47:fe", "network": {"id": "47768db2-7960-4cb7-a093-5b1c393e3e39", "bridge": "br-int", "label": "tempest-VolumesActionsTest-915078599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9e3d624278a4654adf8f1f1ed225e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6197a8-e1", "ovs_interfaceid": "5e6197a8-e19a-461b-88da-fd8369354ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:07:39 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-03458fca-3f77-4f76-a1fb-d82b9673b63c tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:47:fe,bridge_name='br-int',has_traffic_filtering=True,id=5e6197a8-e19a-461b-88da-fd8369354ea0,network=Network(47768db2-7960-4cb7-a093-5b1c393e3e39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e6197a8-e1') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:07:39 user nova-compute[73104]: DEBUG os_vif [None req-03458fca-3f77-4f76-a1fb-d82b9673b63c tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:47:fe,bridge_name='br-int',has_traffic_filtering=True,id=5e6197a8-e19a-461b-88da-fd8369354ea0,network=Network(47768db2-7960-4cb7-a093-5b1c393e3e39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e6197a8-e1') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 09:07:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:07:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e6197a8-e1, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:07:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:07:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:07:39 user nova-compute[73104]: INFO os_vif [None req-03458fca-3f77-4f76-a1fb-d82b9673b63c tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:47:fe,bridge_name='br-int',has_traffic_filtering=True,id=5e6197a8-e19a-461b-88da-fd8369354ea0,network=Network(47768db2-7960-4cb7-a093-5b1c393e3e39),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e6197a8-e1')
Aug 26 09:07:39 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-03458fca-3f77-4f76-a1fb-d82b9673b63c tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Deleting instance files /opt/stack/data/nova/instances/527198e4-48e3-4042-98ea-a2ff6258d1e5_del
Aug 26 09:07:39 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-03458fca-3f77-4f76-a1fb-d82b9673b63c tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Deletion of /opt/stack/data/nova/instances/527198e4-48e3-4042-98ea-a2ff6258d1e5_del complete
Aug 26 09:07:39 user nova-compute[73104]: INFO nova.compute.manager [None req-03458fca-3f77-4f76-a1fb-d82b9673b63c tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 26 09:07:39 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-03458fca-3f77-4f76-a1fb-d82b9673b63c tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 09:07:39 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 09:07:39 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 09:07:39 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:07:39 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Took 0.70 seconds to deallocate network for instance.
Aug 26 09:07:39 user nova-compute[73104]: DEBUG nova.compute.manager [req-5c2d0eea-82b5-43b4-ba49-6ff017f0663a req-642869b7-f97a-4d0e-8958-144e87735e39 service nova] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Received event network-vif-deleted-5e6197a8-e19a-461b-88da-fd8369354ea0 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:07:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-03458fca-3f77-4f76-a1fb-d82b9673b63c tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:07:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-03458fca-3f77-4f76-a1fb-d82b9673b63c tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:07:40 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-03458fca-3f77-4f76-a1fb-d82b9673b63c tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:07:40 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-03458fca-3f77-4f76-a1fb-d82b9673b63c tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:07:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-03458fca-3f77-4f76-a1fb-d82b9673b63c tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.154s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:07:40 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-03458fca-3f77-4f76-a1fb-d82b9673b63c tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Deleted allocations for instance 527198e4-48e3-4042-98ea-a2ff6258d1e5
Aug 26 09:07:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-03458fca-3f77-4f76-a1fb-d82b9673b63c tempest-VolumesActionsTest-1198168530 tempest-VolumesActionsTest-1198168530-project-member] Lock "527198e4-48e3-4042-98ea-a2ff6258d1e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.738s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:07:40 user nova-compute[73104]: DEBUG nova.compute.manager [req-db90d4f2-f579-4886-a58b-c0d3fd78810f req-89c31aff-f25e-46c4-9473-076ca6c4924c service nova] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Received event network-vif-plugged-5e6197a8-e19a-461b-88da-fd8369354ea0 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:07:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-db90d4f2-f579-4886-a58b-c0d3fd78810f req-89c31aff-f25e-46c4-9473-076ca6c4924c service nova] Acquiring lock "527198e4-48e3-4042-98ea-a2ff6258d1e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:07:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-db90d4f2-f579-4886-a58b-c0d3fd78810f req-89c31aff-f25e-46c4-9473-076ca6c4924c service nova] Lock "527198e4-48e3-4042-98ea-a2ff6258d1e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:07:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-db90d4f2-f579-4886-a58b-c0d3fd78810f req-89c31aff-f25e-46c4-9473-076ca6c4924c service nova] Lock "527198e4-48e3-4042-98ea-a2ff6258d1e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:07:40 user nova-compute[73104]: DEBUG nova.compute.manager [req-db90d4f2-f579-4886-a58b-c0d3fd78810f req-89c31aff-f25e-46c4-9473-076ca6c4924c service nova] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] No waiting events found dispatching network-vif-plugged-5e6197a8-e19a-461b-88da-fd8369354ea0 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:07:40 user nova-compute[73104]: WARNING nova.compute.manager [req-db90d4f2-f579-4886-a58b-c0d3fd78810f req-89c31aff-f25e-46c4-9473-076ca6c4924c service nova] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Received unexpected event network-vif-plugged-5e6197a8-e19a-461b-88da-fd8369354ea0 for instance with vm_state deleted and task_state None.
Aug 26 09:07:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:07:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:07:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:07:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:07:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:07:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:07:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:07:54 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693040859.1419516, 527198e4-48e3-4042-98ea-a2ff6258d1e5 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:07:54 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] VM Stopped (Lifecycle Event)
Aug 26 09:07:54 user nova-compute[73104]: DEBUG nova.compute.manager [None req-69b2f42d-c794-4848-a4e1-ff0ad755c0aa None None] [instance: 527198e4-48e3-4042-98ea-a2ff6258d1e5] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:07:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:07:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:07:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:07:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "59fd2387-7387-46ef-b950-97621693452e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:08:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "59fd2387-7387-46ef-b950-97621693452e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:08:06 user nova-compute[73104]: DEBUG nova.compute.manager [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 09:08:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:08:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:08:06 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 09:08:06 user nova-compute[73104]: INFO nova.compute.claims [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Claim successful on node user
Aug 26 09:08:06 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:08:06 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:08:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.220s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:08:06 user nova-compute[73104]: DEBUG nova.compute.manager [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 09:08:06 user nova-compute[73104]: DEBUG nova.compute.manager [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 09:08:06 user nova-compute[73104]: DEBUG nova.network.neutron [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 09:08:06 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 09:08:06 user nova-compute[73104]: DEBUG nova.compute.manager [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 09:08:06 user nova-compute[73104]: INFO nova.virt.block_device [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Booting with volume 0ed6a6d9-5eae-4452-991b-59497b0bb492 at /dev/vda
Aug 26 09:08:06 user nova-compute[73104]: DEBUG nova.policy [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bae03c9c8a9a40b2af6bd1fefb3561d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52518aa77344432385cfc2b73c63aebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 09:08:06 user nova-compute[73104]: DEBUG os_brick.utils [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:08:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:06 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb7b406-8e5a-433f-bd15-e781137c51b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:08:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:06 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5140b297-74d4-4326-a937-acde3dbea763]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:08:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:06 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[03338bea-9b0e-4918-a2ff-325ba061d786]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:08:06 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9769b24-052f-42af-90fc-80fe7a8514cd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:08:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:08:06 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 09:08:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:06 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:08:06 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 09:08:06 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0492ca30-786a-47d4-a3a3-5869fac96e68]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:08:06 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 09:08:06 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 09:08:06 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 09:08:06 user nova-compute[73104]: DEBUG os_brick.utils [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:08:06 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Updating existing volume attachment record: a3d12364-3832-4c45-ba97-063d9c37d066 {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 09:08:07 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:08:07 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:08:07 user nova-compute[73104]: DEBUG nova.network.neutron [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Successfully created port: 304cc672-7a72-4962-bc0c-b6c8d4e94807 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 09:08:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:09 user nova-compute[73104]: DEBUG nova.network.neutron [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Successfully updated port: 304cc672-7a72-4962-bc0c-b6c8d4e94807 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 09:08:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "refresh_cache-59fd2387-7387-46ef-b950-97621693452e" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:08:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquired lock "refresh_cache-59fd2387-7387-46ef-b950-97621693452e" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:08:09 user nova-compute[73104]: DEBUG nova.network.neutron [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 09:08:09 user nova-compute[73104]: DEBUG nova.compute.manager [req-8302f2b4-deb1-4c01-8e32-9b8a30ba5879 req-30877ecf-5279-4b2c-b7ee-1c9658052a4e service nova] [instance: 59fd2387-7387-46ef-b950-97621693452e] Received event network-changed-304cc672-7a72-4962-bc0c-b6c8d4e94807 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:08:09 user nova-compute[73104]: DEBUG nova.compute.manager [req-8302f2b4-deb1-4c01-8e32-9b8a30ba5879 req-30877ecf-5279-4b2c-b7ee-1c9658052a4e service nova] [instance: 59fd2387-7387-46ef-b950-97621693452e] Refreshing instance network info cache due to event network-changed-304cc672-7a72-4962-bc0c-b6c8d4e94807. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:08:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-8302f2b4-deb1-4c01-8e32-9b8a30ba5879 req-30877ecf-5279-4b2c-b7ee-1c9658052a4e service nova] Acquiring lock "refresh_cache-59fd2387-7387-46ef-b950-97621693452e" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:08:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:09 user nova-compute[73104]: DEBUG nova.network.neutron [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 09:08:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:09 user nova-compute[73104]: DEBUG nova.network.neutron [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Updating instance_info_cache with network_info: [{"id": "304cc672-7a72-4962-bc0c-b6c8d4e94807", "address": "fa:16:3e:f6:33:57", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap304cc672-7a", "ovs_interfaceid": "304cc672-7a72-4962-bc0c-b6c8d4e94807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:08:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Releasing lock "refresh_cache-59fd2387-7387-46ef-b950-97621693452e" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:08:09 user nova-compute[73104]: DEBUG nova.compute.manager [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Instance network_info: |[{"id": "304cc672-7a72-4962-bc0c-b6c8d4e94807", "address": "fa:16:3e:f6:33:57", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap304cc672-7a", "ovs_interfaceid": "304cc672-7a72-4962-bc0c-b6c8d4e94807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 09:08:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-8302f2b4-deb1-4c01-8e32-9b8a30ba5879 req-30877ecf-5279-4b2c-b7ee-1c9658052a4e service nova] Acquired lock "refresh_cache-59fd2387-7387-46ef-b950-97621693452e" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:08:09 user nova-compute[73104]: DEBUG nova.network.neutron [req-8302f2b4-deb1-4c01-8e32-9b8a30ba5879 req-30877ecf-5279-4b2c-b7ee-1c9658052a4e service nova] [instance: 59fd2387-7387-46ef-b950-97621693452e] Refreshing network info cache for port 304cc672-7a72-4962-bc0c-b6c8d4e94807 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:08:10 user nova-compute[73104]: DEBUG nova.network.neutron [req-8302f2b4-deb1-4c01-8e32-9b8a30ba5879 req-30877ecf-5279-4b2c-b7ee-1c9658052a4e service nova] [instance: 59fd2387-7387-46ef-b950-97621693452e] Updated VIF entry in instance network info cache for port 304cc672-7a72-4962-bc0c-b6c8d4e94807. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:08:10 user nova-compute[73104]: DEBUG nova.network.neutron [req-8302f2b4-deb1-4c01-8e32-9b8a30ba5879 req-30877ecf-5279-4b2c-b7ee-1c9658052a4e service nova] [instance: 59fd2387-7387-46ef-b950-97621693452e] Updating instance_info_cache with network_info: [{"id": "304cc672-7a72-4962-bc0c-b6c8d4e94807", "address": "fa:16:3e:f6:33:57", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap304cc672-7a", "ovs_interfaceid": "304cc672-7a72-4962-bc0c-b6c8d4e94807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:08:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-8302f2b4-deb1-4c01-8e32-9b8a30ba5879 req-30877ecf-5279-4b2c-b7ee-1c9658052a4e service nova] Releasing lock "refresh_cache-59fd2387-7387-46ef-b950-97621693452e" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:08:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:11 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:08:11 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:08:11 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73104) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 09:08:12 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:08:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:08:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:08:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:08:12 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:08:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:14 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:08:14 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:08:14 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8530MB free_disk=24.137100219726562GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:08:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:08:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:08:14 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:08:14 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 432a66be-853d-42d7-8622-0417ef36045c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:08:14 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 59fd2387-7387-46ef-b950-97621693452e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:08:14 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:08:14 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:08:14 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Refreshing inventories for resource provider 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 09:08:14 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Updating ProviderTree inventory for provider 8a2a2397-4d47-4524-8146-84db4225a812 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 09:08:14 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Updating inventory in ProviderTree for provider 8a2a2397-4d47-4524-8146-84db4225a812 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 09:08:14 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Refreshing aggregate associations for resource provider 8a2a2397-4d47-4524-8146-84db4225a812, aggregates: None {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 09:08:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:14 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Refreshing trait associations for resource provider 8a2a2397-4d47-4524-8146-84db4225a812, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 09:08:14 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:08:14 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:08:14 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:08:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.524s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:08:15 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:08:15 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:08:15 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:08:16 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:08:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:08:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Rebuilding the list of instances to heal {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 09:08:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 59fd2387-7387-46ef-b950-97621693452e] Skipping network cache update for instance because it is Building. {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 26 09:08:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-2c10f0ac-f63d-462d-a999-aa98eb6d91f2" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:08:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-2c10f0ac-f63d-462d-a999-aa98eb6d91f2" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:08:16 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 09:08:16 user nova-compute[73104]: DEBUG nova.objects.instance [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lazy-loading 'info_cache' on Instance uuid 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:08:16 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Updating instance_info_cache with network_info: [{"id": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "address": "fa:16:3e:f0:cc:d7", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e91d018-83", "ovs_interfaceid": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:08:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-2c10f0ac-f63d-462d-a999-aa98eb6d91f2" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:08:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 09:08:16 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG nova.compute.manager [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 09:08:17 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Creating image(s)
Aug 26 09:08:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Did not create local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Ensure instance console log exists: /opt/stack/data/nova/instances/59fd2387-7387-46ef-b950-97621693452e/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Start _get_guest_xml network_info=[{"id": "304cc672-7a72-4962-bc0c-b6c8d4e94807", "address": "fa:16:3e:f6:33:57", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap304cc672-7a", "ovs_interfaceid": "304cc672-7a72-4962-bc0c-b6c8d4e94807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'a3d12364-3832-4c45-ba97-063d9c37d066', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BAMdDLex', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '59fd2387-7387-46ef-b950-97621693452e', 'attached_at': '', 'detached_at': '', 'volume_id': '0ed6a6d9-5eae-4452-991b-59497b0bb492', 'serial': '0ed6a6d9-5eae-4452-991b-59497b0bb492'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 09:08:17 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:08:17 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:08:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BAMdDLex', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:08:17 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:08:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:08:17 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:08:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:08:17 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ac0aeb-4880-4cdd-8343-0c337e637d53]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 09:08:17 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f42d422-8315-4b79-95f3-d33515c15208]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492] added
Aug 26 09:08:17 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[510642a8-8531-4c44-bf87-01adeb4400a3]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbee32a2-84e8-4882-9045-c15b9ac7f717]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BAMdDLex {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BAMdDLex" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d901bf84-1c6c-4bb6-855a-19e26660b473]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BAMdDLex'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8138a44a-fe37-4ce0-97c6-3c54efa90730]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bc04c9-e8ab-43bb-aa18-b05e6a519eab]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 09:08:17 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 09:08:17 user nova-compute[73104]:  {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:08:17 user nova-compute[73104]: WARNING os_brick.initiator.connectors.iscsi [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 09:08:17 user nova-compute[73104]: 
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3dcdfb6-1326-46ef-be7f-6a2d1b0d0683]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492, portal: 172.16.0.220,3260]
Aug 26 09:08:17 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492, portal: 172.16.0.220,3260] successful.
Aug 26 09:08:17 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23aa74e-ffb5-4b57-b16b-5de761baf3a5]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[24324eed-7071-4e14-9433-95f5887d76ec]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)
Aug 26 09:08:17 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)
Aug 26 09:08:17 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b80857-6f6f-42d9-a943-72a0e8cdd60f]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BAMdDLex', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 09:08:17 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:08:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:08:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '23532613665663238', 'path': '/dev/sdb'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:08:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532613665663238', 'path': '/dev/sdb'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 09:08:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:08:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1219000514',display_name='tempest-TestVolumeBootPattern-server-1219000514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1219000514',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8fRBTEgWDKx34ZjNEBgV61oHsmnLZZP+YeQ0nSInYs/RyTZwfSiKB8KZ1aFHYupg5U+DrtEMSfZK0uHXz1ZYj79NAVQuNGFL8QjT4HEH9i5HLhublR/vgOebjTekyxMQ==',key_name='tempest-TestVolumeBootPattern-447823700',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52518aa77344432385cfc2b73c63aebe',ramdisk_id='',reservation_id='r-9ww0ii0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1466837638',owner_user_name='tempest-TestVolumeBootPattern-1466837638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:08:07Z,user_data=None,user_id='bae03c9c8a9a40b2af6bd1fefb3561d0',uuid=59fd2387-7387-46ef-b950-97621693452e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "304cc672-7a72-4962-bc0c-b6c8d4e94807", "address": "fa:16:3e:f6:33:57", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap304cc672-7a", "ovs_interfaceid": "304cc672-7a72-4962-bc0c-b6c8d4e94807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 09:08:18 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converting VIF {"id": "304cc672-7a72-4962-bc0c-b6c8d4e94807", "address": "fa:16:3e:f6:33:57", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap304cc672-7a", "ovs_interfaceid": "304cc672-7a72-4962-bc0c-b6c8d4e94807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:08:18 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:33:57,bridge_name='br-int',has_traffic_filtering=True,id=304cc672-7a72-4962-bc0c-b6c8d4e94807,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap304cc672-7a') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:08:18 user nova-compute[73104]: DEBUG nova.objects.instance [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lazy-loading 'pci_devices' on Instance uuid 59fd2387-7387-46ef-b950-97621693452e {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:08:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] End _get_guest_xml xml=<domain type="kvm">
Aug 26 09:08:18 user nova-compute[73104]:   <uuid>59fd2387-7387-46ef-b950-97621693452e</uuid>
Aug 26 09:08:18 user nova-compute[73104]:   <name>instance-0000002d</name>
Aug 26 09:08:18 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 09:08:18 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 09:08:18 user nova-compute[73104]:   <metadata>
Aug 26 09:08:18 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 09:08:18 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 09:08:18 user nova-compute[73104]:       <nova:name>tempest-TestVolumeBootPattern-server-1219000514</nova:name>
Aug 26 09:08:18 user nova-compute[73104]:       <nova:creationTime>2023-08-26 09:08:17</nova:creationTime>
Aug 26 09:08:18 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 09:08:18 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 09:08:18 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 09:08:18 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 09:08:18 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 09:08:18 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 09:08:18 user nova-compute[73104]:       </nova:flavor>
Aug 26 09:08:18 user nova-compute[73104]:       <nova:owner>
Aug 26 09:08:18 user nova-compute[73104]:         <nova:user uuid="bae03c9c8a9a40b2af6bd1fefb3561d0">tempest-TestVolumeBootPattern-1466837638-project-member</nova:user>
Aug 26 09:08:18 user nova-compute[73104]:         <nova:project uuid="52518aa77344432385cfc2b73c63aebe">tempest-TestVolumeBootPattern-1466837638</nova:project>
Aug 26 09:08:18 user nova-compute[73104]:       </nova:owner>
Aug 26 09:08:18 user nova-compute[73104]:       <nova:ports>
Aug 26 09:08:18 user nova-compute[73104]:         <nova:port uuid="304cc672-7a72-4962-bc0c-b6c8d4e94807">
Aug 26 09:08:18 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 09:08:18 user nova-compute[73104]:         </nova:port>
Aug 26 09:08:18 user nova-compute[73104]:       </nova:ports>
Aug 26 09:08:18 user nova-compute[73104]:     </nova:instance>
Aug 26 09:08:18 user nova-compute[73104]:   </metadata>
Aug 26 09:08:18 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 09:08:18 user nova-compute[73104]:     <system>
Aug 26 09:08:18 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 09:08:18 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 09:08:18 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 09:08:18 user nova-compute[73104]:       <entry name="serial">59fd2387-7387-46ef-b950-97621693452e</entry>
Aug 26 09:08:18 user nova-compute[73104]:       <entry name="uuid">59fd2387-7387-46ef-b950-97621693452e</entry>
Aug 26 09:08:18 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 09:08:18 user nova-compute[73104]:     </system>
Aug 26 09:08:18 user nova-compute[73104]:   </sysinfo>
Aug 26 09:08:18 user nova-compute[73104]:   <os>
Aug 26 09:08:18 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 09:08:18 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 09:08:18 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 09:08:18 user nova-compute[73104]:   </os>
Aug 26 09:08:18 user nova-compute[73104]:   <features>
Aug 26 09:08:18 user nova-compute[73104]:     <acpi/>
Aug 26 09:08:18 user nova-compute[73104]:     <apic/>
Aug 26 09:08:18 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 09:08:18 user nova-compute[73104]:   </features>
Aug 26 09:08:18 user nova-compute[73104]:   <clock offset="utc">
Aug 26 09:08:18 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 09:08:18 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 09:08:18 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 09:08:18 user nova-compute[73104]:   </clock>
Aug 26 09:08:18 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 09:08:18 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 09:08:18 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 09:08:18 user nova-compute[73104]:   </cpu>
Aug 26 09:08:18 user nova-compute[73104]:   <devices>
Aug 26 09:08:18 user nova-compute[73104]:     <disk type="block" device="disk">
Aug 26 09:08:18 user nova-compute[73104]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:08:18 user nova-compute[73104]:       <source dev="/dev/sdb"/>
Aug 26 09:08:18 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 09:08:18 user nova-compute[73104]:       <serial>0ed6a6d9-5eae-4452-991b-59497b0bb492</serial>
Aug 26 09:08:18 user nova-compute[73104]:     </disk>
Aug 26 09:08:18 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 09:08:18 user nova-compute[73104]:       <mac address="fa:16:3e:f6:33:57"/>
Aug 26 09:08:18 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:08:18 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 09:08:18 user nova-compute[73104]:       <target dev="tap304cc672-7a"/>
Aug 26 09:08:18 user nova-compute[73104]:     </interface>
Aug 26 09:08:18 user nova-compute[73104]:     <serial type="pty">
Aug 26 09:08:18 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/59fd2387-7387-46ef-b950-97621693452e/console.log" append="off"/>
Aug 26 09:08:18 user nova-compute[73104]:     </serial>
Aug 26 09:08:18 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 09:08:18 user nova-compute[73104]:     <video>
Aug 26 09:08:18 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:08:18 user nova-compute[73104]:     </video>
Aug 26 09:08:18 user nova-compute[73104]:     <rng model="virtio">
Aug 26 09:08:18 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 09:08:18 user nova-compute[73104]:     </rng>
Aug 26 09:08:18 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 09:08:18 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 09:08:18 user nova-compute[73104]:       <stats period="10"/>
Aug 26 09:08:18 user nova-compute[73104]:     </memballoon>
Aug 26 09:08:18 user nova-compute[73104]:   </devices>
Aug 26 09:08:18 user nova-compute[73104]: </domain>
Aug 26 09:08:18 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 09:08:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:08:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1219000514',display_name='tempest-TestVolumeBootPattern-server-1219000514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1219000514',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8fRBTEgWDKx34ZjNEBgV61oHsmnLZZP+YeQ0nSInYs/RyTZwfSiKB8KZ1aFHYupg5U+DrtEMSfZK0uHXz1ZYj79NAVQuNGFL8QjT4HEH9i5HLhublR/vgOebjTekyxMQ==',key_name='tempest-TestVolumeBootPattern-447823700',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52518aa77344432385cfc2b73c63aebe',ramdisk_id='',reservation_id='r-9ww0ii0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1466837638',owner_user_name='tempest-TestVolumeBootPattern-1466837638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:08:07Z,user_data=None,user_id='bae03c9c8a9a40b2af6bd1fefb3561d0',uuid=59fd2387-7387-46ef-b950-97621693452e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "304cc672-7a72-4962-bc0c-b6c8d4e94807", "address": "fa:16:3e:f6:33:57", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap304cc672-7a", "ovs_interfaceid": "304cc672-7a72-4962-bc0c-b6c8d4e94807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 09:08:18 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converting VIF {"id": "304cc672-7a72-4962-bc0c-b6c8d4e94807", "address": "fa:16:3e:f6:33:57", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap304cc672-7a", "ovs_interfaceid": "304cc672-7a72-4962-bc0c-b6c8d4e94807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:08:18 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:33:57,bridge_name='br-int',has_traffic_filtering=True,id=304cc672-7a72-4962-bc0c-b6c8d4e94807,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap304cc672-7a') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:08:18 user nova-compute[73104]: DEBUG os_vif [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:33:57,bridge_name='br-int',has_traffic_filtering=True,id=304cc672-7a72-4962-bc0c-b6c8d4e94807,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap304cc672-7a') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 09:08:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:08:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 09:08:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap304cc672-7a, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:08:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap304cc672-7a, col_values=(('external_ids', {'iface-id': '304cc672-7a72-4962-bc0c-b6c8d4e94807', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:33:57', 'vm-uuid': '59fd2387-7387-46ef-b950-97621693452e'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:08:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:08:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:18 user nova-compute[73104]: INFO os_vif [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:33:57,bridge_name='br-int',has_traffic_filtering=True,id=304cc672-7a72-4962-bc0c-b6c8d4e94807,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap304cc672-7a')
Aug 26 09:08:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:08:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] No VIF found with MAC fa:16:3e:f6:33:57, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 09:08:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:20 user nova-compute[73104]: DEBUG nova.compute.manager [req-66a4b5fd-c2b5-49ca-80e9-43de657f7243 req-68ad4601-ad7f-48b7-b925-c269cc1156db service nova] [instance: 59fd2387-7387-46ef-b950-97621693452e] Received event network-vif-plugged-304cc672-7a72-4962-bc0c-b6c8d4e94807 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:08:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-66a4b5fd-c2b5-49ca-80e9-43de657f7243 req-68ad4601-ad7f-48b7-b925-c269cc1156db service nova] Acquiring lock "59fd2387-7387-46ef-b950-97621693452e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:08:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-66a4b5fd-c2b5-49ca-80e9-43de657f7243 req-68ad4601-ad7f-48b7-b925-c269cc1156db service nova] Lock "59fd2387-7387-46ef-b950-97621693452e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:08:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-66a4b5fd-c2b5-49ca-80e9-43de657f7243 req-68ad4601-ad7f-48b7-b925-c269cc1156db service nova] Lock "59fd2387-7387-46ef-b950-97621693452e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:08:20 user nova-compute[73104]: DEBUG nova.compute.manager [req-66a4b5fd-c2b5-49ca-80e9-43de657f7243 req-68ad4601-ad7f-48b7-b925-c269cc1156db service nova] [instance: 59fd2387-7387-46ef-b950-97621693452e] No waiting events found dispatching network-vif-plugged-304cc672-7a72-4962-bc0c-b6c8d4e94807 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:08:20 user nova-compute[73104]: WARNING nova.compute.manager [req-66a4b5fd-c2b5-49ca-80e9-43de657f7243 req-68ad4601-ad7f-48b7-b925-c269cc1156db service nova] [instance: 59fd2387-7387-46ef-b950-97621693452e] Received unexpected event network-vif-plugged-304cc672-7a72-4962-bc0c-b6c8d4e94807 for instance with vm_state building and task_state spawning.
Aug 26 09:08:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:21 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:08:21 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040901.9646277, 59fd2387-7387-46ef-b950-97621693452e => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:08:21 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 59fd2387-7387-46ef-b950-97621693452e] VM Resumed (Lifecycle Event)
Aug 26 09:08:21 user nova-compute[73104]: DEBUG nova.compute.manager [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 09:08:21 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 09:08:21 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 59fd2387-7387-46ef-b950-97621693452e] Instance spawned successfully.
Aug 26 09:08:21 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 09:08:21 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 59fd2387-7387-46ef-b950-97621693452e] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:08:22 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 59fd2387-7387-46ef-b950-97621693452e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:08:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:08:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:08:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:08:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:08:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:08:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:08:22 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 59fd2387-7387-46ef-b950-97621693452e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 09:08:22 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040901.9659858, 59fd2387-7387-46ef-b950-97621693452e => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:08:22 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 59fd2387-7387-46ef-b950-97621693452e] VM Started (Lifecycle Event)
Aug 26 09:08:22 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 59fd2387-7387-46ef-b950-97621693452e] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:08:22 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 59fd2387-7387-46ef-b950-97621693452e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:08:22 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 59fd2387-7387-46ef-b950-97621693452e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 09:08:22 user nova-compute[73104]: INFO nova.compute.manager [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Took 4.95 seconds to spawn the instance on the hypervisor.
Aug 26 09:08:22 user nova-compute[73104]: DEBUG nova.compute.manager [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:08:22 user nova-compute[73104]: DEBUG nova.compute.manager [req-a52817f3-3e2b-421e-a4f7-0881fce47240 req-73fd222a-4bc4-4298-8a23-b3a48227e6f3 service nova] [instance: 59fd2387-7387-46ef-b950-97621693452e] Received event network-vif-plugged-304cc672-7a72-4962-bc0c-b6c8d4e94807 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:08:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a52817f3-3e2b-421e-a4f7-0881fce47240 req-73fd222a-4bc4-4298-8a23-b3a48227e6f3 service nova] Acquiring lock "59fd2387-7387-46ef-b950-97621693452e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:08:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a52817f3-3e2b-421e-a4f7-0881fce47240 req-73fd222a-4bc4-4298-8a23-b3a48227e6f3 service nova] Lock "59fd2387-7387-46ef-b950-97621693452e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:08:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a52817f3-3e2b-421e-a4f7-0881fce47240 req-73fd222a-4bc4-4298-8a23-b3a48227e6f3 service nova] Lock "59fd2387-7387-46ef-b950-97621693452e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:08:22 user nova-compute[73104]: DEBUG nova.compute.manager [req-a52817f3-3e2b-421e-a4f7-0881fce47240 req-73fd222a-4bc4-4298-8a23-b3a48227e6f3 service nova] [instance: 59fd2387-7387-46ef-b950-97621693452e] No waiting events found dispatching network-vif-plugged-304cc672-7a72-4962-bc0c-b6c8d4e94807 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:08:22 user nova-compute[73104]: WARNING nova.compute.manager [req-a52817f3-3e2b-421e-a4f7-0881fce47240 req-73fd222a-4bc4-4298-8a23-b3a48227e6f3 service nova] [instance: 59fd2387-7387-46ef-b950-97621693452e] Received unexpected event network-vif-plugged-304cc672-7a72-4962-bc0c-b6c8d4e94807 for instance with vm_state building and task_state spawning.
Aug 26 09:08:22 user nova-compute[73104]: INFO nova.compute.manager [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Took 16.20 seconds to build instance.
Aug 26 09:08:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a6bfa692-b0df-42de-adee-893daf33ee46 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "59fd2387-7387-46ef-b950-97621693452e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.344s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:08:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Acquiring lock "1e477d95-6072-4149-bb55-e30613e2cfaa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lock "1e477d95-6072-4149-bb55-e30613e2cfaa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG nova.compute.manager [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Cleaning up deleted instances {{(pid=73104) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] There are 0 instances to clean {{(pid=73104) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 09:08:24 user nova-compute[73104]: INFO nova.compute.claims [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Claim successful on node user
Aug 26 09:08:24 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.267s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG nova.compute.manager [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG nova.compute.manager [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG nova.network.neutron [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 09:08:24 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 09:08:24 user nova-compute[73104]: DEBUG nova.compute.manager [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 09:08:24 user nova-compute[73104]: INFO nova.virt.block_device [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Booting with volume 96d3f62d-a2b6-4867-afb0-275ea8604133 at /dev/vda
Aug 26 09:08:24 user nova-compute[73104]: DEBUG nova.policy [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10d0765b06cb4292bc08833c16abd334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc641323fbc4076a21019951c4edb8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG os_brick.utils [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc12b18-1b26-4bae-bfae-6ee545df5c2b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4123c4-8acf-4cd4-a4e7-8c78b909590f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d603a7-a35b-473f-bda2-8f47f6bca656]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c430c50a-9f00-45e6-98ad-4913571eb8ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:08:24 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 09:08:24 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[02228c81-2ddf-41e3-b8ce-f56d9dc8eaba]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG os_brick.utils [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:08:24 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Updating existing volume attachment record: a5bd200b-19ff-44f4-955e-8018019ebadd {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 09:08:25 user nova-compute[73104]: DEBUG nova.network.neutron [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Successfully created port: ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 09:08:26 user nova-compute[73104]: DEBUG nova.network.neutron [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Successfully updated port: ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 09:08:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Acquiring lock "refresh_cache-1e477d95-6072-4149-bb55-e30613e2cfaa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:08:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Acquired lock "refresh_cache-1e477d95-6072-4149-bb55-e30613e2cfaa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:08:26 user nova-compute[73104]: DEBUG nova.network.neutron [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 09:08:26 user nova-compute[73104]: DEBUG nova.compute.manager [req-828b8d7f-fe3a-40dc-bcd6-1126230aa7e4 req-ce4ecb50-2784-44c3-bc65-bafc77274627 service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Received event network-changed-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:08:26 user nova-compute[73104]: DEBUG nova.compute.manager [req-828b8d7f-fe3a-40dc-bcd6-1126230aa7e4 req-ce4ecb50-2784-44c3-bc65-bafc77274627 service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Refreshing instance network info cache due to event network-changed-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:08:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-828b8d7f-fe3a-40dc-bcd6-1126230aa7e4 req-ce4ecb50-2784-44c3-bc65-bafc77274627 service nova] Acquiring lock "refresh_cache-1e477d95-6072-4149-bb55-e30613e2cfaa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:08:26 user nova-compute[73104]: DEBUG nova.network.neutron [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 09:08:27 user nova-compute[73104]: DEBUG nova.network.neutron [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Updating instance_info_cache with network_info: [{"id": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "address": "fa:16:3e:10:11:1e", "network": {"id": "429edb63-d3bb-475a-8384-ec36138e73d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-495261383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc641323fbc4076a21019951c4edb8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee23340e-9a", "ovs_interfaceid": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:08:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Releasing lock "refresh_cache-1e477d95-6072-4149-bb55-e30613e2cfaa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:08:27 user nova-compute[73104]: DEBUG nova.compute.manager [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Instance network_info: |[{"id": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "address": "fa:16:3e:10:11:1e", "network": {"id": "429edb63-d3bb-475a-8384-ec36138e73d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-495261383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc641323fbc4076a21019951c4edb8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee23340e-9a", "ovs_interfaceid": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 09:08:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-828b8d7f-fe3a-40dc-bcd6-1126230aa7e4 req-ce4ecb50-2784-44c3-bc65-bafc77274627 service nova] Acquired lock "refresh_cache-1e477d95-6072-4149-bb55-e30613e2cfaa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:08:27 user nova-compute[73104]: DEBUG nova.network.neutron [req-828b8d7f-fe3a-40dc-bcd6-1126230aa7e4 req-ce4ecb50-2784-44c3-bc65-bafc77274627 service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Refreshing network info cache for port ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:08:27 user nova-compute[73104]: DEBUG nova.network.neutron [req-828b8d7f-fe3a-40dc-bcd6-1126230aa7e4 req-ce4ecb50-2784-44c3-bc65-bafc77274627 service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Updated VIF entry in instance network info cache for port ee23340e-9aaf-4a0b-b212-0be8ff5c25d7. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:08:27 user nova-compute[73104]: DEBUG nova.network.neutron [req-828b8d7f-fe3a-40dc-bcd6-1126230aa7e4 req-ce4ecb50-2784-44c3-bc65-bafc77274627 service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Updating instance_info_cache with network_info: [{"id": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "address": "fa:16:3e:10:11:1e", "network": {"id": "429edb63-d3bb-475a-8384-ec36138e73d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-495261383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc641323fbc4076a21019951c4edb8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee23340e-9a", "ovs_interfaceid": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:08:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-828b8d7f-fe3a-40dc-bcd6-1126230aa7e4 req-ce4ecb50-2784-44c3-bc65-bafc77274627 service nova] Releasing lock "refresh_cache-1e477d95-6072-4149-bb55-e30613e2cfaa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:08:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 09:08:35 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Creating image(s)
Aug 26 09:08:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Did not create local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Ensure instance console log exists: /opt/stack/data/nova/instances/1e477d95-6072-4149-bb55-e30613e2cfaa/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Start _get_guest_xml network_info=[{"id": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "address": "fa:16:3e:10:11:1e", "network": {"id": "429edb63-d3bb-475a-8384-ec36138e73d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-495261383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc641323fbc4076a21019951c4edb8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee23340e-9a", "ovs_interfaceid": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'a5bd200b-19ff-44f4-955e-8018019ebadd', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTWXmYIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1e477d95-6072-4149-bb55-e30613e2cfaa', 'attached_at': '', 'detached_at': '', 'volume_id': '96d3f62d-a2b6-4867-afb0-275ea8604133', 'serial': '96d3f62d-a2b6-4867-afb0-275ea8604133'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 09:08:35 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:08:35 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:08:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTWXmYIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:08:35 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:08:35 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:08:35 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:08:35 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:08:35 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 09:08:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a221f4f-fea7-4951-818c-aa51030c4ff8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 09:08:35 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee34355-5a31-4fde-8abe-29671df344ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133] added
Aug 26 09:08:35 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3800a7e8-acc5-43ae-b52d-c6241ccaf787]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[934afb06-c681-4b2e-b9a3-e5530afdaa05]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:08:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qTWXmYIo {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qTWXmYIo" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:36 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[601ca4bd-d366-4569-9a41-61b066956f2d]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:08:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qTWXmYIo'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:08:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:36 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[155661be-3c00-40f1-bcc6-8629128604d4]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:08:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:08:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:36 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[546b41e8-2324-40fd-a8d9-787e3f6d548f]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:08:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)
Aug 26 09:08:36 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:08:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)
Aug 26 09:08:36 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:08:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:36 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee575f2a-ea16-43cd-b77a-9c570607c598]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:08:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133, portal: 172.16.0.220,3260]
Aug 26 09:08:36 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133, portal: 172.16.0.220,3260] successful.
Aug 26 09:08:36 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:08:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:36 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c0d07a-d86d-42b3-918c-c26d4da673b0]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:08:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:08:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:36 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1aa9e7b-b23a-4366-961f-e1b48fd7a9b9]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:08:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)
Aug 26 09:08:36 user nova-compute[73104]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 (non-flash)
Aug 26 09:08:36 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:08:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)
Aug 26 09:08:36 user nova-compute[73104]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 (non-flash)
Aug 26 09:08:36 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:08:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:08:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 09:08:36 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 09:08:36 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 09:08:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:08:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:08:36 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc48ea4-8fca-49ad-9569-3295694308c2]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:08:36 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: None {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 09:08:37 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 09:08:37 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTWXmYIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 09:08:37 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:08:37 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23363303232393334', 'path': '/dev/sdc'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:08:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363303232393334', 'path': '/dev/sdc'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 09:08:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:08:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-369140230',display_name='tempest-TestShelveInstance-server-369140230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-369140230',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDL7QTVnRtxNNYu9s2jtgBpLVjlOS2jaIWAbBzgzv2PeJEK37B8XddLYXxBBROkBAOa0C5F538LWNNpM9vdG2lZJ55HwWgj9Yfv0WIYEw7cY6X2u0zcjZsuXKaY+7d5XA==',key_name='tempest-TestShelveInstance-1332627145',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfc641323fbc4076a21019951c4edb8e',ramdisk_id='',reservation_id='r-bkrqzvvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-488591318',owner_user_name='tempest-TestShelveInstance-488591318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:08:25Z,user_data=None,user_id='10d0765b06cb4292bc08833c16abd334',uuid=1e477d95-6072-4149-bb55-e30613e2cfaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "address": "fa:16:3e:10:11:1e", "network": {"id": "429edb63-d3bb-475a-8384-ec36138e73d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-495261383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc641323fbc4076a21019951c4edb8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee23340e-9a", "ovs_interfaceid": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 09:08:37 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Converting VIF {"id": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "address": "fa:16:3e:10:11:1e", "network": {"id": "429edb63-d3bb-475a-8384-ec36138e73d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-495261383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc641323fbc4076a21019951c4edb8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee23340e-9a", "ovs_interfaceid": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:08:37 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:11:1e,bridge_name='br-int',has_traffic_filtering=True,id=ee23340e-9aaf-4a0b-b212-0be8ff5c25d7,network=Network(429edb63-d3bb-475a-8384-ec36138e73d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee23340e-9a') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:08:37 user nova-compute[73104]: DEBUG nova.objects.instance [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e477d95-6072-4149-bb55-e30613e2cfaa {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:08:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] End _get_guest_xml xml=<domain type="kvm">
Aug 26 09:08:37 user nova-compute[73104]:   <uuid>1e477d95-6072-4149-bb55-e30613e2cfaa</uuid>
Aug 26 09:08:37 user nova-compute[73104]:   <name>instance-0000002e</name>
Aug 26 09:08:37 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 09:08:37 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 09:08:37 user nova-compute[73104]:   <metadata>
Aug 26 09:08:37 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 09:08:37 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 09:08:37 user nova-compute[73104]:       <nova:name>tempest-TestShelveInstance-server-369140230</nova:name>
Aug 26 09:08:37 user nova-compute[73104]:       <nova:creationTime>2023-08-26 09:08:35</nova:creationTime>
Aug 26 09:08:37 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 09:08:37 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 09:08:37 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 09:08:37 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 09:08:37 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 09:08:37 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 09:08:37 user nova-compute[73104]:       </nova:flavor>
Aug 26 09:08:37 user nova-compute[73104]:       <nova:owner>
Aug 26 09:08:37 user nova-compute[73104]:         <nova:user uuid="10d0765b06cb4292bc08833c16abd334">tempest-TestShelveInstance-488591318-project-member</nova:user>
Aug 26 09:08:37 user nova-compute[73104]:         <nova:project uuid="bfc641323fbc4076a21019951c4edb8e">tempest-TestShelveInstance-488591318</nova:project>
Aug 26 09:08:37 user nova-compute[73104]:       </nova:owner>
Aug 26 09:08:37 user nova-compute[73104]:       <nova:ports>
Aug 26 09:08:37 user nova-compute[73104]:         <nova:port uuid="ee23340e-9aaf-4a0b-b212-0be8ff5c25d7">
Aug 26 09:08:37 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 09:08:37 user nova-compute[73104]:         </nova:port>
Aug 26 09:08:37 user nova-compute[73104]:       </nova:ports>
Aug 26 09:08:37 user nova-compute[73104]:     </nova:instance>
Aug 26 09:08:37 user nova-compute[73104]:   </metadata>
Aug 26 09:08:37 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 09:08:37 user nova-compute[73104]:     <system>
Aug 26 09:08:37 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 09:08:37 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 09:08:37 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 09:08:37 user nova-compute[73104]:       <entry name="serial">1e477d95-6072-4149-bb55-e30613e2cfaa</entry>
Aug 26 09:08:37 user nova-compute[73104]:       <entry name="uuid">1e477d95-6072-4149-bb55-e30613e2cfaa</entry>
Aug 26 09:08:37 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 09:08:37 user nova-compute[73104]:     </system>
Aug 26 09:08:37 user nova-compute[73104]:   </sysinfo>
Aug 26 09:08:37 user nova-compute[73104]:   <os>
Aug 26 09:08:37 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 09:08:37 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 09:08:37 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 09:08:37 user nova-compute[73104]:   </os>
Aug 26 09:08:37 user nova-compute[73104]:   <features>
Aug 26 09:08:37 user nova-compute[73104]:     <acpi/>
Aug 26 09:08:37 user nova-compute[73104]:     <apic/>
Aug 26 09:08:37 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 09:08:37 user nova-compute[73104]:   </features>
Aug 26 09:08:37 user nova-compute[73104]:   <clock offset="utc">
Aug 26 09:08:37 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 09:08:37 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 09:08:37 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 09:08:37 user nova-compute[73104]:   </clock>
Aug 26 09:08:37 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 09:08:37 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 09:08:37 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 09:08:37 user nova-compute[73104]:   </cpu>
Aug 26 09:08:37 user nova-compute[73104]:   <devices>
Aug 26 09:08:37 user nova-compute[73104]:     <disk type="block" device="disk">
Aug 26 09:08:37 user nova-compute[73104]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:08:37 user nova-compute[73104]:       <source dev="/dev/sdc"/>
Aug 26 09:08:37 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 09:08:37 user nova-compute[73104]:       <serial>96d3f62d-a2b6-4867-afb0-275ea8604133</serial>
Aug 26 09:08:37 user nova-compute[73104]:     </disk>
Aug 26 09:08:37 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 09:08:37 user nova-compute[73104]:       <mac address="fa:16:3e:10:11:1e"/>
Aug 26 09:08:37 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:08:37 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 09:08:37 user nova-compute[73104]:       <target dev="tapee23340e-9a"/>
Aug 26 09:08:37 user nova-compute[73104]:     </interface>
Aug 26 09:08:37 user nova-compute[73104]:     <serial type="pty">
Aug 26 09:08:37 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/1e477d95-6072-4149-bb55-e30613e2cfaa/console.log" append="off"/>
Aug 26 09:08:37 user nova-compute[73104]:     </serial>
Aug 26 09:08:37 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 09:08:37 user nova-compute[73104]:     <video>
Aug 26 09:08:37 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:08:37 user nova-compute[73104]:     </video>
Aug 26 09:08:37 user nova-compute[73104]:     <rng model="virtio">
Aug 26 09:08:37 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 09:08:37 user nova-compute[73104]:     </rng>
Aug 26 09:08:37 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 09:08:37 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 09:08:37 user nova-compute[73104]:       <stats period="10"/>
Aug 26 09:08:37 user nova-compute[73104]:     </memballoon>
Aug 26 09:08:37 user nova-compute[73104]:   </devices>
Aug 26 09:08:37 user nova-compute[73104]: </domain>
Aug 26 09:08:37 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 09:08:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:08:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-369140230',display_name='tempest-TestShelveInstance-server-369140230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-369140230',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDL7QTVnRtxNNYu9s2jtgBpLVjlOS2jaIWAbBzgzv2PeJEK37B8XddLYXxBBROkBAOa0C5F538LWNNpM9vdG2lZJ55HwWgj9Yfv0WIYEw7cY6X2u0zcjZsuXKaY+7d5XA==',key_name='tempest-TestShelveInstance-1332627145',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfc641323fbc4076a21019951c4edb8e',ramdisk_id='',reservation_id='r-bkrqzvvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-488591318',owner_user_name='tempest-TestShelveInstance-488591318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:08:25Z,user_data=None,user_id='10d0765b06cb4292bc08833c16abd334',uuid=1e477d95-6072-4149-bb55-e30613e2cfaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "address": "fa:16:3e:10:11:1e", "network": {"id": "429edb63-d3bb-475a-8384-ec36138e73d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-495261383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc641323fbc4076a21019951c4edb8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee23340e-9a", "ovs_interfaceid": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 09:08:37 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Converting VIF {"id": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "address": "fa:16:3e:10:11:1e", "network": {"id": "429edb63-d3bb-475a-8384-ec36138e73d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-495261383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc641323fbc4076a21019951c4edb8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee23340e-9a", "ovs_interfaceid": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:08:37 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:11:1e,bridge_name='br-int',has_traffic_filtering=True,id=ee23340e-9aaf-4a0b-b212-0be8ff5c25d7,network=Network(429edb63-d3bb-475a-8384-ec36138e73d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee23340e-9a') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:08:37 user nova-compute[73104]: DEBUG os_vif [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:11:1e,bridge_name='br-int',has_traffic_filtering=True,id=ee23340e-9aaf-4a0b-b212-0be8ff5c25d7,network=Network(429edb63-d3bb-475a-8384-ec36138e73d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee23340e-9a') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 09:08:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:08:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 09:08:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee23340e-9a, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:08:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapee23340e-9a, col_values=(('external_ids', {'iface-id': 'ee23340e-9aaf-4a0b-b212-0be8ff5c25d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:11:1e', 'vm-uuid': '1e477d95-6072-4149-bb55-e30613e2cfaa'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:08:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:08:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:37 user nova-compute[73104]: INFO os_vif [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:11:1e,bridge_name='br-int',has_traffic_filtering=True,id=ee23340e-9aaf-4a0b-b212-0be8ff5c25d7,network=Network(429edb63-d3bb-475a-8384-ec36138e73d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee23340e-9a')
Aug 26 09:08:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:08:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] No VIF found with MAC fa:16:3e:10:11:1e, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 09:08:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:38 user nova-compute[73104]: DEBUG nova.compute.manager [req-d0d043f0-9b46-4c10-84d6-8cfda1b2a752 req-e8e2546b-2e25-4164-9673-80883ffada03 service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Received event network-vif-plugged-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:08:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d0d043f0-9b46-4c10-84d6-8cfda1b2a752 req-e8e2546b-2e25-4164-9673-80883ffada03 service nova] Acquiring lock "1e477d95-6072-4149-bb55-e30613e2cfaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:08:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d0d043f0-9b46-4c10-84d6-8cfda1b2a752 req-e8e2546b-2e25-4164-9673-80883ffada03 service nova] Lock "1e477d95-6072-4149-bb55-e30613e2cfaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:08:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d0d043f0-9b46-4c10-84d6-8cfda1b2a752 req-e8e2546b-2e25-4164-9673-80883ffada03 service nova] Lock "1e477d95-6072-4149-bb55-e30613e2cfaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:08:38 user nova-compute[73104]: DEBUG nova.compute.manager [req-d0d043f0-9b46-4c10-84d6-8cfda1b2a752 req-e8e2546b-2e25-4164-9673-80883ffada03 service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] No waiting events found dispatching network-vif-plugged-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:08:38 user nova-compute[73104]: WARNING nova.compute.manager [req-d0d043f0-9b46-4c10-84d6-8cfda1b2a752 req-e8e2546b-2e25-4164-9673-80883ffada03 service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Received unexpected event network-vif-plugged-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 for instance with vm_state building and task_state spawning.
Aug 26 09:08:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:40 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040920.841625, 1e477d95-6072-4149-bb55-e30613e2cfaa => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:08:40 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] VM Resumed (Lifecycle Event)
Aug 26 09:08:40 user nova-compute[73104]: DEBUG nova.compute.manager [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 09:08:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 09:08:40 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Instance spawned successfully.
Aug 26 09:08:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 09:08:40 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:08:40 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:08:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:08:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:08:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:08:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:08:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:08:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:08:40 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 09:08:40 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040920.842973, 1e477d95-6072-4149-bb55-e30613e2cfaa => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:08:40 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] VM Started (Lifecycle Event)
Aug 26 09:08:40 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:08:40 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:08:40 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 09:08:40 user nova-compute[73104]: INFO nova.compute.manager [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Took 5.13 seconds to spawn the instance on the hypervisor.
Aug 26 09:08:40 user nova-compute[73104]: DEBUG nova.compute.manager [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:08:41 user nova-compute[73104]: DEBUG nova.compute.manager [req-0f79dfc0-b73f-4e52-8c3a-bba6938f37cf req-673a5125-3c9e-4790-96bd-e9ea6775bea2 service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Received event network-vif-plugged-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:08:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0f79dfc0-b73f-4e52-8c3a-bba6938f37cf req-673a5125-3c9e-4790-96bd-e9ea6775bea2 service nova] Acquiring lock "1e477d95-6072-4149-bb55-e30613e2cfaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:08:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0f79dfc0-b73f-4e52-8c3a-bba6938f37cf req-673a5125-3c9e-4790-96bd-e9ea6775bea2 service nova] Lock "1e477d95-6072-4149-bb55-e30613e2cfaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:08:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0f79dfc0-b73f-4e52-8c3a-bba6938f37cf req-673a5125-3c9e-4790-96bd-e9ea6775bea2 service nova] Lock "1e477d95-6072-4149-bb55-e30613e2cfaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:08:41 user nova-compute[73104]: DEBUG nova.compute.manager [req-0f79dfc0-b73f-4e52-8c3a-bba6938f37cf req-673a5125-3c9e-4790-96bd-e9ea6775bea2 service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] No waiting events found dispatching network-vif-plugged-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:08:41 user nova-compute[73104]: WARNING nova.compute.manager [req-0f79dfc0-b73f-4e52-8c3a-bba6938f37cf req-673a5125-3c9e-4790-96bd-e9ea6775bea2 service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Received unexpected event network-vif-plugged-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 for instance with vm_state building and task_state spawning.
Aug 26 09:08:41 user nova-compute[73104]: INFO nova.compute.manager [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Took 16.76 seconds to build instance.
Aug 26 09:08:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-be11a70c-b7a3-48a7-942e-3f036ce8d392 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lock "1e477d95-6072-4149-bb55-e30613e2cfaa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.862s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:08:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:08:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:09 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:09:09 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:09:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:12 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:09:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:09:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:09:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:09:12 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:09:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 09:09:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:09:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:09:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:09:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:09:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:09:12 user nova-compute[73104]: INFO nova.compute.manager [None req-1528356c-a837-48f7-9100-2dec11f5e91d tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Unrescuing
Aug 26 09:09:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1528356c-a837-48f7-9100-2dec11f5e91d tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "refresh_cache-2c10f0ac-f63d-462d-a999-aa98eb6d91f2" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:09:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1528356c-a837-48f7-9100-2dec11f5e91d tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquired lock "refresh_cache-2c10f0ac-f63d-462d-a999-aa98eb6d91f2" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:09:12 user nova-compute[73104]: DEBUG nova.network.neutron [None req-1528356c-a837-48f7-9100-2dec11f5e91d tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 09:09:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:09:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:09:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:09:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 09:09:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:09:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:09:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:09:13 user nova-compute[73104]: DEBUG nova.network.neutron [None req-1528356c-a837-48f7-9100-2dec11f5e91d tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Updating instance_info_cache with network_info: [{"id": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "address": "fa:16:3e:f0:cc:d7", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e91d018-83", "ovs_interfaceid": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:09:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-1528356c-a837-48f7-9100-2dec11f5e91d tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Releasing lock "refresh_cache-2c10f0ac-f63d-462d-a999-aa98eb6d91f2" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:09:13 user nova-compute[73104]: DEBUG nova.objects.instance [None req-1528356c-a837-48f7-9100-2dec11f5e91d tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lazy-loading 'flavor' on Instance uuid 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:09:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:09:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:09:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:09:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:09:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:09:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:14 user nova-compute[73104]: DEBUG nova.compute.manager [req-f99795ef-cab6-4c44-9c3c-90fa66b62a1c req-7945db0d-a33d-4594-a168-3a57041a12ca service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Received event network-vif-unplugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:09:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f99795ef-cab6-4c44-9c3c-90fa66b62a1c req-7945db0d-a33d-4594-a168-3a57041a12ca service nova] Acquiring lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:09:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f99795ef-cab6-4c44-9c3c-90fa66b62a1c req-7945db0d-a33d-4594-a168-3a57041a12ca service nova] Lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:09:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f99795ef-cab6-4c44-9c3c-90fa66b62a1c req-7945db0d-a33d-4594-a168-3a57041a12ca service nova] Lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:09:14 user nova-compute[73104]: DEBUG nova.compute.manager [req-f99795ef-cab6-4c44-9c3c-90fa66b62a1c req-7945db0d-a33d-4594-a168-3a57041a12ca service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] No waiting events found dispatching network-vif-unplugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:09:14 user nova-compute[73104]: WARNING nova.compute.manager [req-f99795ef-cab6-4c44-9c3c-90fa66b62a1c req-7945db0d-a33d-4594-a168-3a57041a12ca service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Received unexpected event network-vif-unplugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f for instance with vm_state rescued and task_state unrescuing.
Aug 26 09:09:14 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:09:14 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:09:14 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8264MB free_disk=24.12574005126953GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:09:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:09:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:09:14 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Instance destroyed successfully.
Aug 26 09:09:15 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:09:15 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 432a66be-853d-42d7-8622-0417ef36045c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:09:15 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 59fd2387-7387-46ef-b950-97621693452e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:09:15 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 1e477d95-6072-4149-bb55-e30613e2cfaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:09:15 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:09:15 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:09:15 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:09:15 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:09:15 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:09:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.300s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:09:16 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:09:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:09:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-4f945bbd-f50f-4152-81b5-7cdc6c8b16ad req-8b57bf2d-bf22-4576-aed7-2f74681c152c service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Received event network-vif-plugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:09:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4f945bbd-f50f-4152-81b5-7cdc6c8b16ad req-8b57bf2d-bf22-4576-aed7-2f74681c152c service nova] Acquiring lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:09:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4f945bbd-f50f-4152-81b5-7cdc6c8b16ad req-8b57bf2d-bf22-4576-aed7-2f74681c152c service nova] Lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:09:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-4f945bbd-f50f-4152-81b5-7cdc6c8b16ad req-8b57bf2d-bf22-4576-aed7-2f74681c152c service nova] Lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:09:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-4f945bbd-f50f-4152-81b5-7cdc6c8b16ad req-8b57bf2d-bf22-4576-aed7-2f74681c152c service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] No waiting events found dispatching network-vif-plugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:09:16 user nova-compute[73104]: WARNING nova.compute.manager [req-4f945bbd-f50f-4152-81b5-7cdc6c8b16ad req-8b57bf2d-bf22-4576-aed7-2f74681c152c service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Received unexpected event network-vif-plugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f for instance with vm_state rescued and task_state unrescuing.
Aug 26 09:09:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-432a66be-853d-42d7-8622-0417ef36045c" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:09:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-432a66be-853d-42d7-8622-0417ef36045c" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:09:16 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 09:09:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:17 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Updating instance_info_cache with network_info: [{"id": "52b25498-8470-454f-9cf5-4989ec64751a", "address": "fa:16:3e:76:d4:93", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b25498-84", "ovs_interfaceid": "52b25498-8470-454f-9cf5-4989ec64751a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:09:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-432a66be-853d-42d7-8622-0417ef36045c" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:09:17 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 09:09:17 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:09:17 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:09:17 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:09:17 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:09:17 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:09:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:18 user nova-compute[73104]: DEBUG nova.compute.manager [req-d6699e5f-a90b-4050-9f45-c1251fa450c5 req-aa73550c-3514-4c1a-bb34-dc3a158c0d56 service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Received event network-vif-plugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:09:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d6699e5f-a90b-4050-9f45-c1251fa450c5 req-aa73550c-3514-4c1a-bb34-dc3a158c0d56 service nova] Acquiring lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:09:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d6699e5f-a90b-4050-9f45-c1251fa450c5 req-aa73550c-3514-4c1a-bb34-dc3a158c0d56 service nova] Lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:09:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d6699e5f-a90b-4050-9f45-c1251fa450c5 req-aa73550c-3514-4c1a-bb34-dc3a158c0d56 service nova] Lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:09:18 user nova-compute[73104]: DEBUG nova.compute.manager [req-d6699e5f-a90b-4050-9f45-c1251fa450c5 req-aa73550c-3514-4c1a-bb34-dc3a158c0d56 service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] No waiting events found dispatching network-vif-plugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:09:18 user nova-compute[73104]: WARNING nova.compute.manager [req-d6699e5f-a90b-4050-9f45-c1251fa450c5 req-aa73550c-3514-4c1a-bb34-dc3a158c0d56 service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Received unexpected event network-vif-plugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f for instance with vm_state rescued and task_state unrescuing.
Aug 26 09:09:18 user nova-compute[73104]: DEBUG nova.compute.manager [req-d6699e5f-a90b-4050-9f45-c1251fa450c5 req-aa73550c-3514-4c1a-bb34-dc3a158c0d56 service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Received event network-vif-plugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:09:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d6699e5f-a90b-4050-9f45-c1251fa450c5 req-aa73550c-3514-4c1a-bb34-dc3a158c0d56 service nova] Acquiring lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:09:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d6699e5f-a90b-4050-9f45-c1251fa450c5 req-aa73550c-3514-4c1a-bb34-dc3a158c0d56 service nova] Lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:09:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d6699e5f-a90b-4050-9f45-c1251fa450c5 req-aa73550c-3514-4c1a-bb34-dc3a158c0d56 service nova] Lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:09:18 user nova-compute[73104]: DEBUG nova.compute.manager [req-d6699e5f-a90b-4050-9f45-c1251fa450c5 req-aa73550c-3514-4c1a-bb34-dc3a158c0d56 service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] No waiting events found dispatching network-vif-plugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:09:18 user nova-compute[73104]: WARNING nova.compute.manager [req-d6699e5f-a90b-4050-9f45-c1251fa450c5 req-aa73550c-3514-4c1a-bb34-dc3a158c0d56 service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Received unexpected event network-vif-plugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f for instance with vm_state rescued and task_state unrescuing.
Aug 26 09:09:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Removed pending event for 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 due to event {{(pid=73104) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 09:09:18 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040958.674077, 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:09:18 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] VM Resumed (Lifecycle Event)
Aug 26 09:09:18 user nova-compute[73104]: DEBUG nova.compute.manager [None req-1528356c-a837-48f7-9100-2dec11f5e91d tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:09:18 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:09:18 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:09:18 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 09:09:18 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040958.6746666, 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:09:18 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] VM Started (Lifecycle Event)
Aug 26 09:09:18 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:09:18 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:09:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:20 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:09:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:24 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:09:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:09:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:09:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:09:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:09:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:35 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:41 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Acquiring lock "cf088ee3-5c28-4513-84f1-6fd264d10310" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:09:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lock "cf088ee3-5c28-4513-84f1-6fd264d10310" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:09:50 user nova-compute[73104]: DEBUG nova.compute.manager [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 09:09:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:09:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:09:50 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 09:09:50 user nova-compute[73104]: INFO nova.compute.claims [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Claim successful on node user
Aug 26 09:09:50 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:09:50 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:09:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.267s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:09:50 user nova-compute[73104]: DEBUG nova.compute.manager [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 09:09:50 user nova-compute[73104]: DEBUG nova.compute.manager [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 09:09:50 user nova-compute[73104]: DEBUG nova.network.neutron [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 09:09:50 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 09:09:50 user nova-compute[73104]: DEBUG nova.compute.manager [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 09:09:50 user nova-compute[73104]: DEBUG nova.compute.manager [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 09:09:50 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 09:09:50 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Creating image(s)
Aug 26 09:09:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf088ee3-5c28-4513-84f1-6fd264d10310/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:09:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lock "/opt/stack/data/nova/instances/cf088ee3-5c28-4513-84f1-6fd264d10310/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:09:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lock "/opt/stack/data/nova/instances/cf088ee3-5c28-4513-84f1-6fd264d10310/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:09:50 user nova-compute[73104]: DEBUG nova.policy [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13393bcc881a4c35864d1c9ee251c9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc656fac68304c889f4cf1998dd28b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 09:09:50 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:09:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.247s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:09:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:09:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:09:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:09:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.174s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:09:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/cf088ee3-5c28-4513-84f1-6fd264d10310/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:09:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/cf088ee3-5c28-4513-84f1-6fd264d10310/disk 1073741824" returned: 0 in 0.063s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:09:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:09:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:09:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.184s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:09:51 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cf088ee3-5c28-4513-84f1-6fd264d10310/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 09:09:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf088ee3-5c28-4513-84f1-6fd264d10310/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:09:51 user nova-compute[73104]: DEBUG nova.network.neutron [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Successfully created port: 2c2b84cc-5d88-422b-a31b-03de78040082 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 09:09:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf088ee3-5c28-4513-84f1-6fd264d10310/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:09:51 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Cannot resize image /opt/stack/data/nova/instances/cf088ee3-5c28-4513-84f1-6fd264d10310/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 09:09:51 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 09:09:51 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Ensure instance console log exists: /opt/stack/data/nova/instances/cf088ee3-5c28-4513-84f1-6fd264d10310/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 09:09:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:09:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:09:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG nova.network.neutron [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Successfully updated port: 2c2b84cc-5d88-422b-a31b-03de78040082 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Acquiring lock "refresh_cache-cf088ee3-5c28-4513-84f1-6fd264d10310" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Acquired lock "refresh_cache-cf088ee3-5c28-4513-84f1-6fd264d10310" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG nova.network.neutron [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG nova.compute.manager [req-78b62c1c-dae3-45a6-ac1f-6808d47f3eed req-b264221a-ebf8-41b2-ac2f-e858ea7a9335 service nova] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Received event network-changed-2c2b84cc-5d88-422b-a31b-03de78040082 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG nova.compute.manager [req-78b62c1c-dae3-45a6-ac1f-6808d47f3eed req-b264221a-ebf8-41b2-ac2f-e858ea7a9335 service nova] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Refreshing instance network info cache due to event network-changed-2c2b84cc-5d88-422b-a31b-03de78040082. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-78b62c1c-dae3-45a6-ac1f-6808d47f3eed req-b264221a-ebf8-41b2-ac2f-e858ea7a9335 service nova] Acquiring lock "refresh_cache-cf088ee3-5c28-4513-84f1-6fd264d10310" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG nova.network.neutron [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG nova.network.neutron [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Updating instance_info_cache with network_info: [{"id": "2c2b84cc-5d88-422b-a31b-03de78040082", "address": "fa:16:3e:a0:ee:44", "network": {"id": "407926d8-ed1c-4bcb-9c52-b3f1494996ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-46889385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc656fac68304c889f4cf1998dd28b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2b84cc-5d", "ovs_interfaceid": "2c2b84cc-5d88-422b-a31b-03de78040082", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Releasing lock "refresh_cache-cf088ee3-5c28-4513-84f1-6fd264d10310" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG nova.compute.manager [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Instance network_info: |[{"id": "2c2b84cc-5d88-422b-a31b-03de78040082", "address": "fa:16:3e:a0:ee:44", "network": {"id": "407926d8-ed1c-4bcb-9c52-b3f1494996ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-46889385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc656fac68304c889f4cf1998dd28b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2b84cc-5d", "ovs_interfaceid": "2c2b84cc-5d88-422b-a31b-03de78040082", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-78b62c1c-dae3-45a6-ac1f-6808d47f3eed req-b264221a-ebf8-41b2-ac2f-e858ea7a9335 service nova] Acquired lock "refresh_cache-cf088ee3-5c28-4513-84f1-6fd264d10310" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG nova.network.neutron [req-78b62c1c-dae3-45a6-ac1f-6808d47f3eed req-b264221a-ebf8-41b2-ac2f-e858ea7a9335 service nova] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Refreshing network info cache for port 2c2b84cc-5d88-422b-a31b-03de78040082 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Start _get_guest_xml network_info=[{"id": "2c2b84cc-5d88-422b-a31b-03de78040082", "address": "fa:16:3e:a0:ee:44", "network": {"id": "407926d8-ed1c-4bcb-9c52-b3f1494996ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-46889385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc656fac68304c889f4cf1998dd28b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2b84cc-5d", "ovs_interfaceid": "2c2b84cc-5d88-422b-a31b-03de78040082", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 09:09:52 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:09:52 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:09:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:09:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-351270687',display_name='tempest-VolumesActionsTest-instance-351270687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-351270687',id=47,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc656fac68304c889f4cf1998dd28b83',ramdisk_id='',reservation_id='r-21dh1zow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-23958363',owner_user_name='tempest-VolumesActionsTest-23958363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:09:51Z,user_data=None,user_id='13393bcc881a4c35864d1c9ee251c9de',uuid=cf088ee3-5c28-4513-84f1-6fd264d10310,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c2b84cc-5d88-422b-a31b-03de78040082", "address": "fa:16:3e:a0:ee:44", "network": {"id": "407926d8-ed1c-4bcb-9c52-b3f1494996ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-46889385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc656fac68304c889f4cf1998dd28b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2b84cc-5d", "ovs_interfaceid": "2c2b84cc-5d88-422b-a31b-03de78040082", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Converting VIF {"id": "2c2b84cc-5d88-422b-a31b-03de78040082", "address": "fa:16:3e:a0:ee:44", "network": {"id": "407926d8-ed1c-4bcb-9c52-b3f1494996ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-46889385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc656fac68304c889f4cf1998dd28b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2b84cc-5d", "ovs_interfaceid": "2c2b84cc-5d88-422b-a31b-03de78040082", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:ee:44,bridge_name='br-int',has_traffic_filtering=True,id=2c2b84cc-5d88-422b-a31b-03de78040082,network=Network(407926d8-ed1c-4bcb-9c52-b3f1494996ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2b84cc-5d') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG nova.objects.instance [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lazy-loading 'pci_devices' on Instance uuid cf088ee3-5c28-4513-84f1-6fd264d10310 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] End _get_guest_xml xml=<domain type="kvm">
Aug 26 09:09:52 user nova-compute[73104]:   <uuid>cf088ee3-5c28-4513-84f1-6fd264d10310</uuid>
Aug 26 09:09:52 user nova-compute[73104]:   <name>instance-0000002f</name>
Aug 26 09:09:52 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 09:09:52 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 09:09:52 user nova-compute[73104]:   <metadata>
Aug 26 09:09:52 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 09:09:52 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 09:09:52 user nova-compute[73104]:       <nova:name>tempest-VolumesActionsTest-instance-351270687</nova:name>
Aug 26 09:09:52 user nova-compute[73104]:       <nova:creationTime>2023-08-26 09:09:52</nova:creationTime>
Aug 26 09:09:52 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 09:09:52 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 09:09:52 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 09:09:52 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 09:09:52 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 09:09:52 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 09:09:52 user nova-compute[73104]:       </nova:flavor>
Aug 26 09:09:52 user nova-compute[73104]:       <nova:owner>
Aug 26 09:09:52 user nova-compute[73104]:         <nova:user uuid="13393bcc881a4c35864d1c9ee251c9de">tempest-VolumesActionsTest-23958363-project-member</nova:user>
Aug 26 09:09:52 user nova-compute[73104]:         <nova:project uuid="fc656fac68304c889f4cf1998dd28b83">tempest-VolumesActionsTest-23958363</nova:project>
Aug 26 09:09:52 user nova-compute[73104]:       </nova:owner>
Aug 26 09:09:52 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 09:09:52 user nova-compute[73104]:       <nova:ports>
Aug 26 09:09:52 user nova-compute[73104]:         <nova:port uuid="2c2b84cc-5d88-422b-a31b-03de78040082">
Aug 26 09:09:52 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 09:09:52 user nova-compute[73104]:         </nova:port>
Aug 26 09:09:52 user nova-compute[73104]:       </nova:ports>
Aug 26 09:09:52 user nova-compute[73104]:     </nova:instance>
Aug 26 09:09:52 user nova-compute[73104]:   </metadata>
Aug 26 09:09:52 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 09:09:52 user nova-compute[73104]:     <system>
Aug 26 09:09:52 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 09:09:52 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 09:09:52 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 09:09:52 user nova-compute[73104]:       <entry name="serial">cf088ee3-5c28-4513-84f1-6fd264d10310</entry>
Aug 26 09:09:52 user nova-compute[73104]:       <entry name="uuid">cf088ee3-5c28-4513-84f1-6fd264d10310</entry>
Aug 26 09:09:52 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 09:09:52 user nova-compute[73104]:     </system>
Aug 26 09:09:52 user nova-compute[73104]:   </sysinfo>
Aug 26 09:09:52 user nova-compute[73104]:   <os>
Aug 26 09:09:52 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 09:09:52 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 09:09:52 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 09:09:52 user nova-compute[73104]:   </os>
Aug 26 09:09:52 user nova-compute[73104]:   <features>
Aug 26 09:09:52 user nova-compute[73104]:     <acpi/>
Aug 26 09:09:52 user nova-compute[73104]:     <apic/>
Aug 26 09:09:52 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 09:09:52 user nova-compute[73104]:   </features>
Aug 26 09:09:52 user nova-compute[73104]:   <clock offset="utc">
Aug 26 09:09:52 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 09:09:52 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 09:09:52 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 09:09:52 user nova-compute[73104]:   </clock>
Aug 26 09:09:52 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 09:09:52 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 09:09:52 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 09:09:52 user nova-compute[73104]:   </cpu>
Aug 26 09:09:52 user nova-compute[73104]:   <devices>
Aug 26 09:09:52 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 09:09:52 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 09:09:52 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/cf088ee3-5c28-4513-84f1-6fd264d10310/disk"/>
Aug 26 09:09:52 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 09:09:52 user nova-compute[73104]:     </disk>
Aug 26 09:09:52 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 09:09:52 user nova-compute[73104]:       <mac address="fa:16:3e:a0:ee:44"/>
Aug 26 09:09:52 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:09:52 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 09:09:52 user nova-compute[73104]:       <target dev="tap2c2b84cc-5d"/>
Aug 26 09:09:52 user nova-compute[73104]:     </interface>
Aug 26 09:09:52 user nova-compute[73104]:     <serial type="pty">
Aug 26 09:09:52 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/cf088ee3-5c28-4513-84f1-6fd264d10310/console.log" append="off"/>
Aug 26 09:09:52 user nova-compute[73104]:     </serial>
Aug 26 09:09:52 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 09:09:52 user nova-compute[73104]:     <video>
Aug 26 09:09:52 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:09:52 user nova-compute[73104]:     </video>
Aug 26 09:09:52 user nova-compute[73104]:     <rng model="virtio">
Aug 26 09:09:52 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 09:09:52 user nova-compute[73104]:     </rng>
Aug 26 09:09:52 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 09:09:52 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 09:09:52 user nova-compute[73104]:       <stats period="10"/>
Aug 26 09:09:52 user nova-compute[73104]:     </memballoon>
Aug 26 09:09:52 user nova-compute[73104]:   </devices>
Aug 26 09:09:52 user nova-compute[73104]: </domain>
Aug 26 09:09:52 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:09:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-351270687',display_name='tempest-VolumesActionsTest-instance-351270687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-351270687',id=47,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc656fac68304c889f4cf1998dd28b83',ramdisk_id='',reservation_id='r-21dh1zow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-23958363',owner_user_name='tempest-VolumesActionsTest-23958363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:09:51Z,user_data=None,user_id='13393bcc881a4c35864d1c9ee251c9de',uuid=cf088ee3-5c28-4513-84f1-6fd264d10310,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c2b84cc-5d88-422b-a31b-03de78040082", "address": "fa:16:3e:a0:ee:44", "network": {"id": "407926d8-ed1c-4bcb-9c52-b3f1494996ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-46889385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc656fac68304c889f4cf1998dd28b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2b84cc-5d", "ovs_interfaceid": "2c2b84cc-5d88-422b-a31b-03de78040082", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Converting VIF {"id": "2c2b84cc-5d88-422b-a31b-03de78040082", "address": "fa:16:3e:a0:ee:44", "network": {"id": "407926d8-ed1c-4bcb-9c52-b3f1494996ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-46889385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc656fac68304c889f4cf1998dd28b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2b84cc-5d", "ovs_interfaceid": "2c2b84cc-5d88-422b-a31b-03de78040082", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:ee:44,bridge_name='br-int',has_traffic_filtering=True,id=2c2b84cc-5d88-422b-a31b-03de78040082,network=Network(407926d8-ed1c-4bcb-9c52-b3f1494996ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2b84cc-5d') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG os_vif [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:ee:44,bridge_name='br-int',has_traffic_filtering=True,id=2c2b84cc-5d88-422b-a31b-03de78040082,network=Network(407926d8-ed1c-4bcb-9c52-b3f1494996ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2b84cc-5d') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c2b84cc-5d, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2c2b84cc-5d, col_values=(('external_ids', {'iface-id': '2c2b84cc-5d88-422b-a31b-03de78040082', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:ee:44', 'vm-uuid': 'cf088ee3-5c28-4513-84f1-6fd264d10310'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:09:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:52 user nova-compute[73104]: INFO os_vif [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:ee:44,bridge_name='br-int',has_traffic_filtering=True,id=2c2b84cc-5d88-422b-a31b-03de78040082,network=Network(407926d8-ed1c-4bcb-9c52-b3f1494996ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2b84cc-5d')
Aug 26 09:09:53 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:09:53 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] No VIF found with MAC fa:16:3e:a0:ee:44, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 09:09:53 user nova-compute[73104]: DEBUG nova.network.neutron [req-78b62c1c-dae3-45a6-ac1f-6808d47f3eed req-b264221a-ebf8-41b2-ac2f-e858ea7a9335 service nova] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Updated VIF entry in instance network info cache for port 2c2b84cc-5d88-422b-a31b-03de78040082. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:09:53 user nova-compute[73104]: DEBUG nova.network.neutron [req-78b62c1c-dae3-45a6-ac1f-6808d47f3eed req-b264221a-ebf8-41b2-ac2f-e858ea7a9335 service nova] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Updating instance_info_cache with network_info: [{"id": "2c2b84cc-5d88-422b-a31b-03de78040082", "address": "fa:16:3e:a0:ee:44", "network": {"id": "407926d8-ed1c-4bcb-9c52-b3f1494996ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-46889385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc656fac68304c889f4cf1998dd28b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2b84cc-5d", "ovs_interfaceid": "2c2b84cc-5d88-422b-a31b-03de78040082", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:09:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-78b62c1c-dae3-45a6-ac1f-6808d47f3eed req-b264221a-ebf8-41b2-ac2f-e858ea7a9335 service nova] Releasing lock "refresh_cache-cf088ee3-5c28-4513-84f1-6fd264d10310" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:09:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-56d35ca9-8c99-4467-8f2c-1cabe59b804c req-a39c9ff8-57c1-46c2-8b65-b93c06195d94 service nova] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Received event network-vif-plugged-2c2b84cc-5d88-422b-a31b-03de78040082 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:09:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-56d35ca9-8c99-4467-8f2c-1cabe59b804c req-a39c9ff8-57c1-46c2-8b65-b93c06195d94 service nova] Acquiring lock "cf088ee3-5c28-4513-84f1-6fd264d10310-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:09:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-56d35ca9-8c99-4467-8f2c-1cabe59b804c req-a39c9ff8-57c1-46c2-8b65-b93c06195d94 service nova] Lock "cf088ee3-5c28-4513-84f1-6fd264d10310-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:09:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-56d35ca9-8c99-4467-8f2c-1cabe59b804c req-a39c9ff8-57c1-46c2-8b65-b93c06195d94 service nova] Lock "cf088ee3-5c28-4513-84f1-6fd264d10310-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:09:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-56d35ca9-8c99-4467-8f2c-1cabe59b804c req-a39c9ff8-57c1-46c2-8b65-b93c06195d94 service nova] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] No waiting events found dispatching network-vif-plugged-2c2b84cc-5d88-422b-a31b-03de78040082 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:09:54 user nova-compute[73104]: WARNING nova.compute.manager [req-56d35ca9-8c99-4467-8f2c-1cabe59b804c req-a39c9ff8-57c1-46c2-8b65-b93c06195d94 service nova] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Received unexpected event network-vif-plugged-2c2b84cc-5d88-422b-a31b-03de78040082 for instance with vm_state building and task_state spawning.
Aug 26 09:09:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:56 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040996.512084, cf088ee3-5c28-4513-84f1-6fd264d10310 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:09:56 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] VM Resumed (Lifecycle Event)
Aug 26 09:09:56 user nova-compute[73104]: DEBUG nova.compute.manager [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 09:09:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 09:09:56 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Instance spawned successfully.
Aug 26 09:09:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 09:09:56 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:09:56 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:09:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:09:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:09:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:09:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:09:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:09:56 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:09:56 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 09:09:56 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693040996.514156, cf088ee3-5c28-4513-84f1-6fd264d10310 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:09:56 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] VM Started (Lifecycle Event)
Aug 26 09:09:56 user nova-compute[73104]: DEBUG nova.compute.manager [req-e4f708eb-52dd-4121-9746-ebaf4ef4007e req-8341194a-457b-4ef9-b2cf-0d7de7171de9 service nova] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Received event network-vif-plugged-2c2b84cc-5d88-422b-a31b-03de78040082 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:09:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e4f708eb-52dd-4121-9746-ebaf4ef4007e req-8341194a-457b-4ef9-b2cf-0d7de7171de9 service nova] Acquiring lock "cf088ee3-5c28-4513-84f1-6fd264d10310-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:09:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e4f708eb-52dd-4121-9746-ebaf4ef4007e req-8341194a-457b-4ef9-b2cf-0d7de7171de9 service nova] Lock "cf088ee3-5c28-4513-84f1-6fd264d10310-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:09:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e4f708eb-52dd-4121-9746-ebaf4ef4007e req-8341194a-457b-4ef9-b2cf-0d7de7171de9 service nova] Lock "cf088ee3-5c28-4513-84f1-6fd264d10310-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:09:56 user nova-compute[73104]: DEBUG nova.compute.manager [req-e4f708eb-52dd-4121-9746-ebaf4ef4007e req-8341194a-457b-4ef9-b2cf-0d7de7171de9 service nova] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] No waiting events found dispatching network-vif-plugged-2c2b84cc-5d88-422b-a31b-03de78040082 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:09:56 user nova-compute[73104]: WARNING nova.compute.manager [req-e4f708eb-52dd-4121-9746-ebaf4ef4007e req-8341194a-457b-4ef9-b2cf-0d7de7171de9 service nova] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Received unexpected event network-vif-plugged-2c2b84cc-5d88-422b-a31b-03de78040082 for instance with vm_state building and task_state spawning.
Aug 26 09:09:56 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:09:56 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:09:56 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 09:09:56 user nova-compute[73104]: INFO nova.compute.manager [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Took 5.79 seconds to spawn the instance on the hypervisor.
Aug 26 09:09:56 user nova-compute[73104]: DEBUG nova.compute.manager [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:09:56 user nova-compute[73104]: INFO nova.compute.manager [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Took 6.36 seconds to build instance.
Aug 26 09:09:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e706f835-048b-46d4-976e-cbd9ee260081 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lock "cf088ee3-5c28-4513-84f1-6fd264d10310" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.445s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:09:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:58 user nova-compute[73104]: DEBUG nova.compute.manager [req-7557f64f-a914-4215-9938-ded1ddc402ba req-792963d2-1151-4d75-a310-bad9651cb5a3 service nova] [instance: 59fd2387-7387-46ef-b950-97621693452e] Received event network-changed-304cc672-7a72-4962-bc0c-b6c8d4e94807 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:09:58 user nova-compute[73104]: DEBUG nova.compute.manager [req-7557f64f-a914-4215-9938-ded1ddc402ba req-792963d2-1151-4d75-a310-bad9651cb5a3 service nova] [instance: 59fd2387-7387-46ef-b950-97621693452e] Refreshing instance network info cache due to event network-changed-304cc672-7a72-4962-bc0c-b6c8d4e94807. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:09:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-7557f64f-a914-4215-9938-ded1ddc402ba req-792963d2-1151-4d75-a310-bad9651cb5a3 service nova] Acquiring lock "refresh_cache-59fd2387-7387-46ef-b950-97621693452e" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:09:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-7557f64f-a914-4215-9938-ded1ddc402ba req-792963d2-1151-4d75-a310-bad9651cb5a3 service nova] Acquired lock "refresh_cache-59fd2387-7387-46ef-b950-97621693452e" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:09:58 user nova-compute[73104]: DEBUG nova.network.neutron [req-7557f64f-a914-4215-9938-ded1ddc402ba req-792963d2-1151-4d75-a310-bad9651cb5a3 service nova] [instance: 59fd2387-7387-46ef-b950-97621693452e] Refreshing network info cache for port 304cc672-7a72-4962-bc0c-b6c8d4e94807 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:09:58 user nova-compute[73104]: DEBUG nova.network.neutron [req-7557f64f-a914-4215-9938-ded1ddc402ba req-792963d2-1151-4d75-a310-bad9651cb5a3 service nova] [instance: 59fd2387-7387-46ef-b950-97621693452e] Updated VIF entry in instance network info cache for port 304cc672-7a72-4962-bc0c-b6c8d4e94807. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:09:58 user nova-compute[73104]: DEBUG nova.network.neutron [req-7557f64f-a914-4215-9938-ded1ddc402ba req-792963d2-1151-4d75-a310-bad9651cb5a3 service nova] [instance: 59fd2387-7387-46ef-b950-97621693452e] Updating instance_info_cache with network_info: [{"id": "304cc672-7a72-4962-bc0c-b6c8d4e94807", "address": "fa:16:3e:f6:33:57", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap304cc672-7a", "ovs_interfaceid": "304cc672-7a72-4962-bc0c-b6c8d4e94807", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:09:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-7557f64f-a914-4215-9938-ded1ddc402ba req-792963d2-1151-4d75-a310-bad9651cb5a3 service nova] Releasing lock "refresh_cache-59fd2387-7387-46ef-b950-97621693452e" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:09:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "59fd2387-7387-46ef-b950-97621693452e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:09:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "59fd2387-7387-46ef-b950-97621693452e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:09:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "59fd2387-7387-46ef-b950-97621693452e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:09:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "59fd2387-7387-46ef-b950-97621693452e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:09:58 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "59fd2387-7387-46ef-b950-97621693452e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:09:58 user nova-compute[73104]: INFO nova.compute.manager [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Terminating instance
Aug 26 09:09:58 user nova-compute[73104]: DEBUG nova.compute.manager [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 09:09:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG nova.compute.manager [req-b5bf1f34-f2ea-45ac-9e38-6c0208a827bd req-2d3f837c-79fd-4d95-bc5c-0a9e39457dbc service nova] [instance: 59fd2387-7387-46ef-b950-97621693452e] Received event network-vif-unplugged-304cc672-7a72-4962-bc0c-b6c8d4e94807 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b5bf1f34-f2ea-45ac-9e38-6c0208a827bd req-2d3f837c-79fd-4d95-bc5c-0a9e39457dbc service nova] Acquiring lock "59fd2387-7387-46ef-b950-97621693452e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b5bf1f34-f2ea-45ac-9e38-6c0208a827bd req-2d3f837c-79fd-4d95-bc5c-0a9e39457dbc service nova] Lock "59fd2387-7387-46ef-b950-97621693452e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b5bf1f34-f2ea-45ac-9e38-6c0208a827bd req-2d3f837c-79fd-4d95-bc5c-0a9e39457dbc service nova] Lock "59fd2387-7387-46ef-b950-97621693452e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG nova.compute.manager [req-b5bf1f34-f2ea-45ac-9e38-6c0208a827bd req-2d3f837c-79fd-4d95-bc5c-0a9e39457dbc service nova] [instance: 59fd2387-7387-46ef-b950-97621693452e] No waiting events found dispatching network-vif-unplugged-304cc672-7a72-4962-bc0c-b6c8d4e94807 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG nova.compute.manager [req-b5bf1f34-f2ea-45ac-9e38-6c0208a827bd req-2d3f837c-79fd-4d95-bc5c-0a9e39457dbc service nova] [instance: 59fd2387-7387-46ef-b950-97621693452e] Received event network-vif-unplugged-304cc672-7a72-4962-bc0c-b6c8d4e94807 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 09:09:59 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 59fd2387-7387-46ef-b950-97621693452e] Instance destroyed successfully.
Aug 26 09:09:59 user nova-compute[73104]: DEBUG nova.objects.instance [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lazy-loading 'resources' on Instance uuid 59fd2387-7387-46ef-b950-97621693452e {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:08:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1219000514',display_name='tempest-TestVolumeBootPattern-server-1219000514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1219000514',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8fRBTEgWDKx34ZjNEBgV61oHsmnLZZP+YeQ0nSInYs/RyTZwfSiKB8KZ1aFHYupg5U+DrtEMSfZK0uHXz1ZYj79NAVQuNGFL8QjT4HEH9i5HLhublR/vgOebjTekyxMQ==',key_name='tempest-TestVolumeBootPattern-447823700',keypairs=<?>,launch_index=0,launched_at=2023-08-26T09:08:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52518aa77344432385cfc2b73c63aebe',ramdisk_id='',reservation_id='r-9ww0ii0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1466837638',owner_user_name='tempest-TestVolumeBootPattern-1466837638-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T09:08:22Z,user_data=None,user_id='bae03c9c8a9a40b2af6bd1fefb3561d0',uuid=59fd2387-7387-46ef-b950-97621693452e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "304cc672-7a72-4962-bc0c-b6c8d4e94807", "address": "fa:16:3e:f6:33:57", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap304cc672-7a", "ovs_interfaceid": "304cc672-7a72-4962-bc0c-b6c8d4e94807", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converting VIF {"id": "304cc672-7a72-4962-bc0c-b6c8d4e94807", "address": "fa:16:3e:f6:33:57", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap304cc672-7a", "ovs_interfaceid": "304cc672-7a72-4962-bc0c-b6c8d4e94807", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:33:57,bridge_name='br-int',has_traffic_filtering=True,id=304cc672-7a72-4962-bc0c-b6c8d4e94807,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap304cc672-7a') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG os_vif [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:33:57,bridge_name='br-int',has_traffic_filtering=True,id=304cc672-7a72-4962-bc0c-b6c8d4e94807,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap304cc672-7a') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap304cc672-7a, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:09:59 user nova-compute[73104]: INFO os_vif [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:33:57,bridge_name='br-int',has_traffic_filtering=True,id=304cc672-7a72-4962-bc0c-b6c8d4e94807,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap304cc672-7a')
Aug 26 09:09:59 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BAMdDLex', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:09:59 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:09:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8a6bed-513f-4c16-8302-263965f4c50e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbfc083-4e32-4974-bf86-1a65dbacb262]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)
Aug 26 09:09:59 user nova-compute[73104]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 (non-flash)
Aug 26 09:09:59 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)
Aug 26 09:09:59 user nova-compute[73104]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 (non-flash)
Aug 26 09:09:59 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0c4228c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492'): ({'sdb'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Removing single pathed devices sdb {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[493f58fb-0295-47c8-8699-96c8a337737e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d93658-1160-4af6-8345-d3193fc0f030]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Flushing IO for device /dev/sdb {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7e7fd1-75a0-4b81-b665-7c8082a99c31]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[898bf91b-731e-4176-8db1-b5578d6e254c]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOb2c7a564-52a6ef28322791ba', '/dev/disk/by-id/scsi-23532613665663238', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b2c7a564') {{(pid=84263) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[145e85c4-e089-4835-bcc5-6587ab8b46c4]: (4, None) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4557a26f-e74f-47da-9dd4-88117fa4172e]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72f9f05-a55f-4955-8934-b10c59f4147a]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492, portal: 172.16.0.220,3260]
Aug 26 09:09:59 user nova-compute[73104]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492, portal: 172.16.0.220,3260] successful.
Aug 26 09:09:59 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca0e1db-7823-44aa-926f-a70db1d7d689]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] <== disconnect_volume: return (287ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 09:09:59 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Deleting instance files /opt/stack/data/nova/instances/59fd2387-7387-46ef-b950-97621693452e_del
Aug 26 09:09:59 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Deletion of /opt/stack/data/nova/instances/59fd2387-7387-46ef-b950-97621693452e_del complete
Aug 26 09:09:59 user nova-compute[73104]: INFO nova.compute.manager [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 26 09:09:59 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 59fd2387-7387-46ef-b950-97621693452e] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 09:09:59 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 59fd2387-7387-46ef-b950-97621693452e] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 09:10:01 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 59fd2387-7387-46ef-b950-97621693452e] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:10:01 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 59fd2387-7387-46ef-b950-97621693452e] Took 1.14 seconds to deallocate network for instance.
Aug 26 09:10:01 user nova-compute[73104]: DEBUG nova.compute.manager [req-36721790-073f-459a-bcab-4d007ebd55ef req-2c6f2d7e-aad6-40dc-9e0e-532148688863 service nova] [instance: 59fd2387-7387-46ef-b950-97621693452e] Received event network-vif-plugged-304cc672-7a72-4962-bc0c-b6c8d4e94807 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:10:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-36721790-073f-459a-bcab-4d007ebd55ef req-2c6f2d7e-aad6-40dc-9e0e-532148688863 service nova] Acquiring lock "59fd2387-7387-46ef-b950-97621693452e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:10:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-36721790-073f-459a-bcab-4d007ebd55ef req-2c6f2d7e-aad6-40dc-9e0e-532148688863 service nova] Lock "59fd2387-7387-46ef-b950-97621693452e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:10:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-36721790-073f-459a-bcab-4d007ebd55ef req-2c6f2d7e-aad6-40dc-9e0e-532148688863 service nova] Lock "59fd2387-7387-46ef-b950-97621693452e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:10:01 user nova-compute[73104]: DEBUG nova.compute.manager [req-36721790-073f-459a-bcab-4d007ebd55ef req-2c6f2d7e-aad6-40dc-9e0e-532148688863 service nova] [instance: 59fd2387-7387-46ef-b950-97621693452e] No waiting events found dispatching network-vif-plugged-304cc672-7a72-4962-bc0c-b6c8d4e94807 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:10:01 user nova-compute[73104]: WARNING nova.compute.manager [req-36721790-073f-459a-bcab-4d007ebd55ef req-2c6f2d7e-aad6-40dc-9e0e-532148688863 service nova] [instance: 59fd2387-7387-46ef-b950-97621693452e] Received unexpected event network-vif-plugged-304cc672-7a72-4962-bc0c-b6c8d4e94807 for instance with vm_state active and task_state deleting.
Aug 26 09:10:01 user nova-compute[73104]: DEBUG nova.compute.manager [req-36721790-073f-459a-bcab-4d007ebd55ef req-2c6f2d7e-aad6-40dc-9e0e-532148688863 service nova] [instance: 59fd2387-7387-46ef-b950-97621693452e] Received event network-vif-deleted-304cc672-7a72-4962-bc0c-b6c8d4e94807 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:10:01 user nova-compute[73104]: INFO nova.compute.manager [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 59fd2387-7387-46ef-b950-97621693452e] Took 0.89 seconds to detach 1 volumes for instance.
Aug 26 09:10:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:10:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:10:02 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:10:02 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:10:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:10:02 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Deleted allocations for instance 59fd2387-7387-46ef-b950-97621693452e
Aug 26 09:10:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-76a12bbb-a80c-4954-afc8-c17819bce580 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "59fd2387-7387-46ef-b950-97621693452e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.701s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:10:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:10:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:10:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:10:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:10:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:10:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:10:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:10:11 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:10:11 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:10:14 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:10:14 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:10:14 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:10:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:10:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:10:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:10:14 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:10:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:10:14 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693040999.4936318, 59fd2387-7387-46ef-b950-97621693452e => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:10:14 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 59fd2387-7387-46ef-b950-97621693452e] VM Stopped (Lifecycle Event)
Aug 26 09:10:14 user nova-compute[73104]: DEBUG nova.compute.manager [None req-45008e8c-3702-4996-b7b5-22a2a43a3e33 None None] [instance: 59fd2387-7387-46ef-b950-97621693452e] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:10:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:10:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:10:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:10:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:10:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:10:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:10:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:10:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:10:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:10:15 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 09:10:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:10:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:10:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:10:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:10:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf088ee3-5c28-4513-84f1-6fd264d10310/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:10:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf088ee3-5c28-4513-84f1-6fd264d10310/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:10:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf088ee3-5c28-4513-84f1-6fd264d10310/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:10:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf088ee3-5c28-4513-84f1-6fd264d10310/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:10:16 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:10:16 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:10:16 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8167MB free_disk=24.08802032470703GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:10:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:10:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:10:16 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:10:16 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 432a66be-853d-42d7-8622-0417ef36045c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:10:16 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 1e477d95-6072-4149-bb55-e30613e2cfaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:10:16 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance cf088ee3-5c28-4513-84f1-6fd264d10310 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:10:16 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:10:16 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:10:16 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:10:16 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:10:16 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:10:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.302s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:10:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-ba56524f-002d-48f5-8254-ff3f8b5cb5fe req-9775f482-eee8-4b5f-afea-f1dc4c0e5015 service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Received event network-changed-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:10:16 user nova-compute[73104]: DEBUG nova.compute.manager [req-ba56524f-002d-48f5-8254-ff3f8b5cb5fe req-9775f482-eee8-4b5f-afea-f1dc4c0e5015 service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Refreshing instance network info cache due to event network-changed-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:10:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ba56524f-002d-48f5-8254-ff3f8b5cb5fe req-9775f482-eee8-4b5f-afea-f1dc4c0e5015 service nova] Acquiring lock "refresh_cache-1e477d95-6072-4149-bb55-e30613e2cfaa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:10:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ba56524f-002d-48f5-8254-ff3f8b5cb5fe req-9775f482-eee8-4b5f-afea-f1dc4c0e5015 service nova] Acquired lock "refresh_cache-1e477d95-6072-4149-bb55-e30613e2cfaa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:10:16 user nova-compute[73104]: DEBUG nova.network.neutron [req-ba56524f-002d-48f5-8254-ff3f8b5cb5fe req-9775f482-eee8-4b5f-afea-f1dc4c0e5015 service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Refreshing network info cache for port ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:10:17 user nova-compute[73104]: DEBUG nova.network.neutron [req-ba56524f-002d-48f5-8254-ff3f8b5cb5fe req-9775f482-eee8-4b5f-afea-f1dc4c0e5015 service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Updated VIF entry in instance network info cache for port ee23340e-9aaf-4a0b-b212-0be8ff5c25d7. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:10:17 user nova-compute[73104]: DEBUG nova.network.neutron [req-ba56524f-002d-48f5-8254-ff3f8b5cb5fe req-9775f482-eee8-4b5f-afea-f1dc4c0e5015 service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Updating instance_info_cache with network_info: [{"id": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "address": "fa:16:3e:10:11:1e", "network": {"id": "429edb63-d3bb-475a-8384-ec36138e73d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-495261383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc641323fbc4076a21019951c4edb8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee23340e-9a", "ovs_interfaceid": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:10:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-ba56524f-002d-48f5-8254-ff3f8b5cb5fe req-9775f482-eee8-4b5f-afea-f1dc4c0e5015 service nova] Releasing lock "refresh_cache-1e477d95-6072-4149-bb55-e30613e2cfaa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:10:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Acquiring lock "1e477d95-6072-4149-bb55-e30613e2cfaa" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:10:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lock "1e477d95-6072-4149-bb55-e30613e2cfaa" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:10:17 user nova-compute[73104]: INFO nova.compute.manager [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Shelve offloading
Aug 26 09:10:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:10:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:10:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:10:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:10:17 user nova-compute[73104]: DEBUG nova.compute.manager [req-5752dfe0-2ee1-4a98-8de5-b1ec255848f9 req-cfc1b244-9a76-4169-aad6-92cd8d3b809d service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Received event network-vif-unplugged-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:10:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5752dfe0-2ee1-4a98-8de5-b1ec255848f9 req-cfc1b244-9a76-4169-aad6-92cd8d3b809d service nova] Acquiring lock "1e477d95-6072-4149-bb55-e30613e2cfaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:10:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5752dfe0-2ee1-4a98-8de5-b1ec255848f9 req-cfc1b244-9a76-4169-aad6-92cd8d3b809d service nova] Lock "1e477d95-6072-4149-bb55-e30613e2cfaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:10:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5752dfe0-2ee1-4a98-8de5-b1ec255848f9 req-cfc1b244-9a76-4169-aad6-92cd8d3b809d service nova] Lock "1e477d95-6072-4149-bb55-e30613e2cfaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:10:17 user nova-compute[73104]: DEBUG nova.compute.manager [req-5752dfe0-2ee1-4a98-8de5-b1ec255848f9 req-cfc1b244-9a76-4169-aad6-92cd8d3b809d service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] No waiting events found dispatching network-vif-unplugged-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:10:17 user nova-compute[73104]: WARNING nova.compute.manager [req-5752dfe0-2ee1-4a98-8de5-b1ec255848f9 req-cfc1b244-9a76-4169-aad6-92cd8d3b809d service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Received unexpected event network-vif-unplugged-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 for instance with vm_state active and task_state shelving.
Aug 26 09:10:18 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Instance destroyed successfully.
Aug 26 09:10:18 user nova-compute[73104]: DEBUG nova.compute.manager [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:10:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Acquiring lock "refresh_cache-1e477d95-6072-4149-bb55-e30613e2cfaa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:10:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Acquired lock "refresh_cache-1e477d95-6072-4149-bb55-e30613e2cfaa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:10:18 user nova-compute[73104]: DEBUG nova.network.neutron [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 09:10:18 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:10:18 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:10:18 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Rebuilding the list of instances to heal {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 09:10:18 user nova-compute[73104]: DEBUG nova.network.neutron [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Updating instance_info_cache with network_info: [{"id": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "address": "fa:16:3e:10:11:1e", "network": {"id": "429edb63-d3bb-475a-8384-ec36138e73d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-495261383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc641323fbc4076a21019951c4edb8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee23340e-9a", "ovs_interfaceid": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:10:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Releasing lock "refresh_cache-1e477d95-6072-4149-bb55-e30613e2cfaa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:10:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-2c10f0ac-f63d-462d-a999-aa98eb6d91f2" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:10:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-2c10f0ac-f63d-462d-a999-aa98eb6d91f2" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:10:18 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 09:10:18 user nova-compute[73104]: DEBUG nova.objects.instance [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lazy-loading 'info_cache' on Instance uuid 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Updating instance_info_cache with network_info: [{"id": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "address": "fa:16:3e:f0:cc:d7", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e91d018-83", "ovs_interfaceid": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-2c10f0ac-f63d-462d-a999-aa98eb6d91f2" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:10:19 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Instance destroyed successfully.
Aug 26 09:10:19 user nova-compute[73104]: DEBUG nova.objects.instance [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lazy-loading 'resources' on Instance uuid 1e477d95-6072-4149-bb55-e30613e2cfaa {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:08:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-369140230',display_name='tempest-TestShelveInstance-server-369140230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-369140230',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDL7QTVnRtxNNYu9s2jtgBpLVjlOS2jaIWAbBzgzv2PeJEK37B8XddLYXxBBROkBAOa0C5F538LWNNpM9vdG2lZJ55HwWgj9Yfv0WIYEw7cY6X2u0zcjZsuXKaY+7d5XA==',key_name='tempest-TestShelveInstance-1332627145',keypairs=<?>,launch_index=0,launched_at=2023-08-26T09:08:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bfc641323fbc4076a21019951c4edb8e',ramdisk_id='',reservation_id='r-bkrqzvvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-488591318',owner_user_name='tempest-TestShelveInstance-488591318-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T09:08:41Z,user_data=None,user_id='10d0765b06cb4292bc08833c16abd334',uuid=1e477d95-6072-4149-bb55-e30613e2cfaa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "address": "fa:16:3e:10:11:1e", "network": {"id": "429edb63-d3bb-475a-8384-ec36138e73d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-495261383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc641323fbc4076a21019951c4edb8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee23340e-9a", "ovs_interfaceid": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Converting VIF {"id": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "address": "fa:16:3e:10:11:1e", "network": {"id": "429edb63-d3bb-475a-8384-ec36138e73d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-495261383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc641323fbc4076a21019951c4edb8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee23340e-9a", "ovs_interfaceid": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:11:1e,bridge_name='br-int',has_traffic_filtering=True,id=ee23340e-9aaf-4a0b-b212-0be8ff5c25d7,network=Network(429edb63-d3bb-475a-8384-ec36138e73d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee23340e-9a') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG os_vif [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:11:1e,bridge_name='br-int',has_traffic_filtering=True,id=ee23340e-9aaf-4a0b-b212-0be8ff5c25d7,network=Network(429edb63-d3bb-475a-8384-ec36138e73d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee23340e-9a') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee23340e-9a, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:10:19 user nova-compute[73104]: INFO os_vif [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:11:1e,bridge_name='br-int',has_traffic_filtering=True,id=ee23340e-9aaf-4a0b-b212-0be8ff5c25d7,network=Network(429edb63-d3bb-475a-8384-ec36138e73d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee23340e-9a')
Aug 26 09:10:19 user nova-compute[73104]: DEBUG nova.compute.manager [req-b514656e-7f89-4a20-81d8-ff2472c7aca3 req-7df3ef0d-0c94-4a21-a56f-1f517ae9a38c service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Received event network-changed-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG nova.compute.manager [req-b514656e-7f89-4a20-81d8-ff2472c7aca3 req-7df3ef0d-0c94-4a21-a56f-1f517ae9a38c service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Refreshing instance network info cache due to event network-changed-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b514656e-7f89-4a20-81d8-ff2472c7aca3 req-7df3ef0d-0c94-4a21-a56f-1f517ae9a38c service nova] Acquiring lock "refresh_cache-1e477d95-6072-4149-bb55-e30613e2cfaa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b514656e-7f89-4a20-81d8-ff2472c7aca3 req-7df3ef0d-0c94-4a21-a56f-1f517ae9a38c service nova] Acquired lock "refresh_cache-1e477d95-6072-4149-bb55-e30613e2cfaa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG nova.network.neutron [req-b514656e-7f89-4a20-81d8-ff2472c7aca3 req-7df3ef0d-0c94-4a21-a56f-1f517ae9a38c service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Refreshing network info cache for port ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTWXmYIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:10:19 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:10:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71d5139-47bd-4082-8f88-a352abbc9426]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65319b8-e31c-416e-8b0f-146dbe840757]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 (non-flash)
Aug 26 09:10:19 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 (non-flash)
Aug 26 09:10:19 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0c46a83a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133'): ({'sdc'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Removing single pathed devices sdc {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cc934a-f4e1-45ad-8802-e28e91d7ed41]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7a42d5-2729-42a9-b098-7c679c838588]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Flushing IO for device /dev/sdc {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5380a7a7-a35b-4bb1-8c0d-07f181e3506e]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1cd0e8-5064-4478-b2f8-f4c8a37b5455]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] SCSI volumes sdc have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b017b00-9a28-490e-aa18-0f3d4c0d6096]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a7d622-ae5b-4f8f-bda0-950c7e0117ae]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133, portal: 172.16.0.220,3260]
Aug 26 09:10:19 user nova-compute[73104]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133, portal: 172.16.0.220,3260] successful.
Aug 26 09:10:19 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b542a7-619c-48c0-be9a-1bd5b3e109d2]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] <== disconnect_volume: return (273ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 09:10:19 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Deleting instance files /opt/stack/data/nova/instances/1e477d95-6072-4149-bb55-e30613e2cfaa_del
Aug 26 09:10:19 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Deletion of /opt/stack/data/nova/instances/1e477d95-6072-4149-bb55-e30613e2cfaa_del complete
Aug 26 09:10:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG nova.compute.manager [req-083381b2-5ce1-4441-9819-8d0845a82808 req-d0c66d11-3194-43dc-a900-e6719457e2b2 service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Received event network-vif-plugged-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-083381b2-5ce1-4441-9819-8d0845a82808 req-d0c66d11-3194-43dc-a900-e6719457e2b2 service nova] Acquiring lock "1e477d95-6072-4149-bb55-e30613e2cfaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-083381b2-5ce1-4441-9819-8d0845a82808 req-d0c66d11-3194-43dc-a900-e6719457e2b2 service nova] Lock "1e477d95-6072-4149-bb55-e30613e2cfaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-083381b2-5ce1-4441-9819-8d0845a82808 req-d0c66d11-3194-43dc-a900-e6719457e2b2 service nova] Lock "1e477d95-6072-4149-bb55-e30613e2cfaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG nova.compute.manager [req-083381b2-5ce1-4441-9819-8d0845a82808 req-d0c66d11-3194-43dc-a900-e6719457e2b2 service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] No waiting events found dispatching network-vif-plugged-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:10:19 user nova-compute[73104]: WARNING nova.compute.manager [req-083381b2-5ce1-4441-9819-8d0845a82808 req-d0c66d11-3194-43dc-a900-e6719457e2b2 service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Received unexpected event network-vif-plugged-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 for instance with vm_state active and task_state shelving.
Aug 26 09:10:19 user nova-compute[73104]: DEBUG nova.network.neutron [req-b514656e-7f89-4a20-81d8-ff2472c7aca3 req-7df3ef0d-0c94-4a21-a56f-1f517ae9a38c service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Updated VIF entry in instance network info cache for port ee23340e-9aaf-4a0b-b212-0be8ff5c25d7. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG nova.network.neutron [req-b514656e-7f89-4a20-81d8-ff2472c7aca3 req-7df3ef0d-0c94-4a21-a56f-1f517ae9a38c service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Updating instance_info_cache with network_info: [{"id": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "address": "fa:16:3e:10:11:1e", "network": {"id": "429edb63-d3bb-475a-8384-ec36138e73d0", "bridge": null, "label": "tempest-TestShelveInstance-495261383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc641323fbc4076a21019951c4edb8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapee23340e-9a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b514656e-7f89-4a20-81d8-ff2472c7aca3 req-7df3ef0d-0c94-4a21-a56f-1f517ae9a38c service nova] Releasing lock "refresh_cache-1e477d95-6072-4149-bb55-e30613e2cfaa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:10:19 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:10:20 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Deleted allocations for instance 1e477d95-6072-4149-bb55-e30613e2cfaa
Aug 26 09:10:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:10:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:10:20 user nova-compute[73104]: DEBUG nova.objects.instance [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lazy-loading 'numa_topology' on Instance uuid 1e477d95-6072-4149-bb55-e30613e2cfaa {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:10:20 user nova-compute[73104]: DEBUG nova.objects.base [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Object Instance<1e477d95-6072-4149-bb55-e30613e2cfaa> lazy-loaded attributes: resources,numa_topology {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 09:10:20 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:10:20 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:10:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.181s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:10:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7875eb08-84ba-4e96-b2bd-fa1fe3631f4c tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lock "1e477d95-6072-4149-bb55-e30613e2cfaa" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.536s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:10:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:10:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:10:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:10:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:10:33 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693041018.1945915, 1e477d95-6072-4149-bb55-e30613e2cfaa => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:10:33 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] VM Stopped (Lifecycle Event)
Aug 26 09:10:33 user nova-compute[73104]: DEBUG nova.compute.manager [None req-4f089113-b0ba-4312-afd4-1ab6f3c88e72 None None] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:10:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:10:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:10:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:10:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:10:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:10:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:10:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:10:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:10:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:10:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:10:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:10:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "d473909b-b527-455c-9048-22e6616b6fb3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:10:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "d473909b-b527-455c-9048-22e6616b6fb3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:10:50 user nova-compute[73104]: DEBUG nova.compute.manager [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 09:10:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:10:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:10:50 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 09:10:50 user nova-compute[73104]: INFO nova.compute.claims [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Claim successful on node user
Aug 26 09:10:50 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:10:50 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:10:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.244s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:10:50 user nova-compute[73104]: DEBUG nova.compute.manager [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 09:10:50 user nova-compute[73104]: DEBUG nova.compute.manager [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 09:10:50 user nova-compute[73104]: DEBUG nova.network.neutron [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 09:10:50 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 09:10:50 user nova-compute[73104]: DEBUG nova.compute.manager [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 09:10:50 user nova-compute[73104]: INFO nova.virt.block_device [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Booting with volume 0ed6a6d9-5eae-4452-991b-59497b0bb492 at /dev/vda
Aug 26 09:10:51 user nova-compute[73104]: DEBUG nova.policy [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bae03c9c8a9a40b2af6bd1fefb3561d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52518aa77344432385cfc2b73c63aebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 09:10:51 user nova-compute[73104]: DEBUG os_brick.utils [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:10:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:10:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:10:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d04ce5-4dd9-47ed-9bc8-c23cb84b95f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:10:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:10:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:10:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bd6425-1ef4-45c9-af07-f6b3acc08b6e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:10:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:10:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:10:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcb6e94-b41d-4a02-a32f-24f0026215ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:10:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21a7123-811f-41df-98d2-bc611927add8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:10:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:10:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:10:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 09:10:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:10:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:10:51 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 09:10:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[990e6e8a-e69f-4892-b93d-e324b2b6c33c]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:10:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 09:10:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 09:10:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 09:10:51 user nova-compute[73104]: DEBUG os_brick.utils [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:10:51 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Updating existing volume attachment record: 6a35ac98-6d63-4471-a5a0-35e6a594f5c5 {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 09:10:51 user nova-compute[73104]: DEBUG nova.network.neutron [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Successfully created port: 2ed07331-5c24-4b78-9d63-b0aa7186af4a {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 09:10:52 user nova-compute[73104]: DEBUG nova.network.neutron [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Successfully updated port: 2ed07331-5c24-4b78-9d63-b0aa7186af4a {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 09:10:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "refresh_cache-d473909b-b527-455c-9048-22e6616b6fb3" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:10:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquired lock "refresh_cache-d473909b-b527-455c-9048-22e6616b6fb3" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:10:52 user nova-compute[73104]: DEBUG nova.network.neutron [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 09:10:52 user nova-compute[73104]: DEBUG nova.compute.manager [req-e0117be3-4afd-491c-a165-acbdb24dd33d req-0ba6885b-2678-4104-9fa9-4c95288179e6 service nova] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Received event network-changed-2ed07331-5c24-4b78-9d63-b0aa7186af4a {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:10:52 user nova-compute[73104]: DEBUG nova.compute.manager [req-e0117be3-4afd-491c-a165-acbdb24dd33d req-0ba6885b-2678-4104-9fa9-4c95288179e6 service nova] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Refreshing instance network info cache due to event network-changed-2ed07331-5c24-4b78-9d63-b0aa7186af4a. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:10:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e0117be3-4afd-491c-a165-acbdb24dd33d req-0ba6885b-2678-4104-9fa9-4c95288179e6 service nova] Acquiring lock "refresh_cache-d473909b-b527-455c-9048-22e6616b6fb3" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:10:52 user nova-compute[73104]: DEBUG nova.network.neutron [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 09:10:52 user nova-compute[73104]: DEBUG nova.network.neutron [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Updating instance_info_cache with network_info: [{"id": "2ed07331-5c24-4b78-9d63-b0aa7186af4a", "address": "fa:16:3e:b2:42:0e", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed07331-5c", "ovs_interfaceid": "2ed07331-5c24-4b78-9d63-b0aa7186af4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:10:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Releasing lock "refresh_cache-d473909b-b527-455c-9048-22e6616b6fb3" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:10:52 user nova-compute[73104]: DEBUG nova.compute.manager [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Instance network_info: |[{"id": "2ed07331-5c24-4b78-9d63-b0aa7186af4a", "address": "fa:16:3e:b2:42:0e", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed07331-5c", "ovs_interfaceid": "2ed07331-5c24-4b78-9d63-b0aa7186af4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 09:10:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e0117be3-4afd-491c-a165-acbdb24dd33d req-0ba6885b-2678-4104-9fa9-4c95288179e6 service nova] Acquired lock "refresh_cache-d473909b-b527-455c-9048-22e6616b6fb3" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:10:52 user nova-compute[73104]: DEBUG nova.network.neutron [req-e0117be3-4afd-491c-a165-acbdb24dd33d req-0ba6885b-2678-4104-9fa9-4c95288179e6 service nova] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Refreshing network info cache for port 2ed07331-5c24-4b78-9d63-b0aa7186af4a {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:10:53 user nova-compute[73104]: DEBUG nova.network.neutron [req-e0117be3-4afd-491c-a165-acbdb24dd33d req-0ba6885b-2678-4104-9fa9-4c95288179e6 service nova] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Updated VIF entry in instance network info cache for port 2ed07331-5c24-4b78-9d63-b0aa7186af4a. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:10:53 user nova-compute[73104]: DEBUG nova.network.neutron [req-e0117be3-4afd-491c-a165-acbdb24dd33d req-0ba6885b-2678-4104-9fa9-4c95288179e6 service nova] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Updating instance_info_cache with network_info: [{"id": "2ed07331-5c24-4b78-9d63-b0aa7186af4a", "address": "fa:16:3e:b2:42:0e", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed07331-5c", "ovs_interfaceid": "2ed07331-5c24-4b78-9d63-b0aa7186af4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:10:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e0117be3-4afd-491c-a165-acbdb24dd33d req-0ba6885b-2678-4104-9fa9-4c95288179e6 service nova] Releasing lock "refresh_cache-d473909b-b527-455c-9048-22e6616b6fb3" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:10:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:10:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG nova.compute.manager [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 09:11:01 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Creating image(s)
Aug 26 09:11:01 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Did not create local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Ensure instance console log exists: /opt/stack/data/nova/instances/d473909b-b527-455c-9048-22e6616b6fb3/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Start _get_guest_xml network_info=[{"id": "2ed07331-5c24-4b78-9d63-b0aa7186af4a", "address": "fa:16:3e:b2:42:0e", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed07331-5c", "ovs_interfaceid": "2ed07331-5c24-4b78-9d63-b0aa7186af4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '6a35ac98-6d63-4471-a5a0-35e6a594f5c5', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BAMdDLex', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd473909b-b527-455c-9048-22e6616b6fb3', 'attached_at': '', 'detached_at': '', 'volume_id': '0ed6a6d9-5eae-4452-991b-59497b0bb492', 'serial': '0ed6a6d9-5eae-4452-991b-59497b0bb492'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 09:11:01 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:11:01 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:11:01 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BAMdDLex', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:11:01 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:11:01 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:11:01 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:11:01 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:11:01 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0eb7810-dd7a-456c-949c-208d7898ecc1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 09:11:01 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[140f75f9-a723-4677-874c-fe98a584c5b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492] added
Aug 26 09:11:01 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[caaf9078-9b19-4093-a915-9fb76e48c7a0]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ba79ee-1486-4d10-a9c1-01d47bbb227a]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BAMdDLex {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BAMdDLex" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c153c9-48a7-4d72-9533-efee8861440e]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BAMdDLex'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b836ddc-dc11-4aad-8259-f4fcb452aa6e]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b0e665-cb31-4c06-beca-ec40c5bd36f7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 09:11:01 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 09:11:01 user nova-compute[73104]:  {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:11:01 user nova-compute[73104]: WARNING os_brick.initiator.connectors.iscsi [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 09:11:01 user nova-compute[73104]: 
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef354845-c4b3-4b56-af5c-a6cf1e31ea36]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492, portal: 172.16.0.220,3260]
Aug 26 09:11:01 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492, portal: 172.16.0.220,3260] successful.
Aug 26 09:11:01 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2315b224-37b7-4294-b4b2-ecaf72bf94df]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6afdb5-aab6-4c8a-961e-9edb6acdd048]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)
Aug 26 09:11:01 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)
Aug 26 09:11:01 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.030s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e4dff0-6891-422d-bf69-510742cefc8d]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:11:01 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 09:11:02 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 09:11:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BAMdDLex', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 09:11:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:11:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23532613665663238', 'path': '/dev/sdb'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:11:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532613665663238', 'path': '/dev/sdb'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 09:11:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:10:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-327636569',display_name='tempest-TestVolumeBootPattern-server-327636569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-327636569',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8fRBTEgWDKx34ZjNEBgV61oHsmnLZZP+YeQ0nSInYs/RyTZwfSiKB8KZ1aFHYupg5U+DrtEMSfZK0uHXz1ZYj79NAVQuNGFL8QjT4HEH9i5HLhublR/vgOebjTekyxMQ==',key_name='tempest-TestVolumeBootPattern-447823700',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52518aa77344432385cfc2b73c63aebe',ramdisk_id='',reservation_id='r-l01z614v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1466837638',owner_user_name='tempest-TestVolumeBootPattern-1466837638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:10:51Z,user_data=None,user_id='bae03c9c8a9a40b2af6bd1fefb3561d0',uuid=d473909b-b527-455c-9048-22e6616b6fb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ed07331-5c24-4b78-9d63-b0aa7186af4a", "address": "fa:16:3e:b2:42:0e", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed07331-5c", "ovs_interfaceid": "2ed07331-5c24-4b78-9d63-b0aa7186af4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 09:11:02 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converting VIF {"id": "2ed07331-5c24-4b78-9d63-b0aa7186af4a", "address": "fa:16:3e:b2:42:0e", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed07331-5c", "ovs_interfaceid": "2ed07331-5c24-4b78-9d63-b0aa7186af4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:11:02 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:42:0e,bridge_name='br-int',has_traffic_filtering=True,id=2ed07331-5c24-4b78-9d63-b0aa7186af4a,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ed07331-5c') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:11:02 user nova-compute[73104]: DEBUG nova.objects.instance [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lazy-loading 'pci_devices' on Instance uuid d473909b-b527-455c-9048-22e6616b6fb3 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:11:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] End _get_guest_xml xml=<domain type="kvm">
Aug 26 09:11:02 user nova-compute[73104]:   <uuid>d473909b-b527-455c-9048-22e6616b6fb3</uuid>
Aug 26 09:11:02 user nova-compute[73104]:   <name>instance-00000030</name>
Aug 26 09:11:02 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 09:11:02 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 09:11:02 user nova-compute[73104]:   <metadata>
Aug 26 09:11:02 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 09:11:02 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 09:11:02 user nova-compute[73104]:       <nova:name>tempest-TestVolumeBootPattern-server-327636569</nova:name>
Aug 26 09:11:02 user nova-compute[73104]:       <nova:creationTime>2023-08-26 09:11:01</nova:creationTime>
Aug 26 09:11:02 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 09:11:02 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 09:11:02 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 09:11:02 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 09:11:02 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 09:11:02 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 09:11:02 user nova-compute[73104]:       </nova:flavor>
Aug 26 09:11:02 user nova-compute[73104]:       <nova:owner>
Aug 26 09:11:02 user nova-compute[73104]:         <nova:user uuid="bae03c9c8a9a40b2af6bd1fefb3561d0">tempest-TestVolumeBootPattern-1466837638-project-member</nova:user>
Aug 26 09:11:02 user nova-compute[73104]:         <nova:project uuid="52518aa77344432385cfc2b73c63aebe">tempest-TestVolumeBootPattern-1466837638</nova:project>
Aug 26 09:11:02 user nova-compute[73104]:       </nova:owner>
Aug 26 09:11:02 user nova-compute[73104]:       <nova:ports>
Aug 26 09:11:02 user nova-compute[73104]:         <nova:port uuid="2ed07331-5c24-4b78-9d63-b0aa7186af4a">
Aug 26 09:11:02 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 09:11:02 user nova-compute[73104]:         </nova:port>
Aug 26 09:11:02 user nova-compute[73104]:       </nova:ports>
Aug 26 09:11:02 user nova-compute[73104]:     </nova:instance>
Aug 26 09:11:02 user nova-compute[73104]:   </metadata>
Aug 26 09:11:02 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 09:11:02 user nova-compute[73104]:     <system>
Aug 26 09:11:02 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 09:11:02 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 09:11:02 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 09:11:02 user nova-compute[73104]:       <entry name="serial">d473909b-b527-455c-9048-22e6616b6fb3</entry>
Aug 26 09:11:02 user nova-compute[73104]:       <entry name="uuid">d473909b-b527-455c-9048-22e6616b6fb3</entry>
Aug 26 09:11:02 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 09:11:02 user nova-compute[73104]:     </system>
Aug 26 09:11:02 user nova-compute[73104]:   </sysinfo>
Aug 26 09:11:02 user nova-compute[73104]:   <os>
Aug 26 09:11:02 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 09:11:02 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 09:11:02 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 09:11:02 user nova-compute[73104]:   </os>
Aug 26 09:11:02 user nova-compute[73104]:   <features>
Aug 26 09:11:02 user nova-compute[73104]:     <acpi/>
Aug 26 09:11:02 user nova-compute[73104]:     <apic/>
Aug 26 09:11:02 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 09:11:02 user nova-compute[73104]:   </features>
Aug 26 09:11:02 user nova-compute[73104]:   <clock offset="utc">
Aug 26 09:11:02 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 09:11:02 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 09:11:02 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 09:11:02 user nova-compute[73104]:   </clock>
Aug 26 09:11:02 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 09:11:02 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 09:11:02 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 09:11:02 user nova-compute[73104]:   </cpu>
Aug 26 09:11:02 user nova-compute[73104]:   <devices>
Aug 26 09:11:02 user nova-compute[73104]:     <disk type="block" device="disk">
Aug 26 09:11:02 user nova-compute[73104]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:11:02 user nova-compute[73104]:       <source dev="/dev/sdb"/>
Aug 26 09:11:02 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 09:11:02 user nova-compute[73104]:       <serial>0ed6a6d9-5eae-4452-991b-59497b0bb492</serial>
Aug 26 09:11:02 user nova-compute[73104]:     </disk>
Aug 26 09:11:02 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 09:11:02 user nova-compute[73104]:       <mac address="fa:16:3e:b2:42:0e"/>
Aug 26 09:11:02 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:11:02 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 09:11:02 user nova-compute[73104]:       <target dev="tap2ed07331-5c"/>
Aug 26 09:11:02 user nova-compute[73104]:     </interface>
Aug 26 09:11:02 user nova-compute[73104]:     <serial type="pty">
Aug 26 09:11:02 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/d473909b-b527-455c-9048-22e6616b6fb3/console.log" append="off"/>
Aug 26 09:11:02 user nova-compute[73104]:     </serial>
Aug 26 09:11:02 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 09:11:02 user nova-compute[73104]:     <video>
Aug 26 09:11:02 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:11:02 user nova-compute[73104]:     </video>
Aug 26 09:11:02 user nova-compute[73104]:     <rng model="virtio">
Aug 26 09:11:02 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 09:11:02 user nova-compute[73104]:     </rng>
Aug 26 09:11:02 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 09:11:02 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 09:11:02 user nova-compute[73104]:       <stats period="10"/>
Aug 26 09:11:02 user nova-compute[73104]:     </memballoon>
Aug 26 09:11:02 user nova-compute[73104]:   </devices>
Aug 26 09:11:02 user nova-compute[73104]: </domain>
Aug 26 09:11:02 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 09:11:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:10:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-327636569',display_name='tempest-TestVolumeBootPattern-server-327636569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-327636569',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8fRBTEgWDKx34ZjNEBgV61oHsmnLZZP+YeQ0nSInYs/RyTZwfSiKB8KZ1aFHYupg5U+DrtEMSfZK0uHXz1ZYj79NAVQuNGFL8QjT4HEH9i5HLhublR/vgOebjTekyxMQ==',key_name='tempest-TestVolumeBootPattern-447823700',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52518aa77344432385cfc2b73c63aebe',ramdisk_id='',reservation_id='r-l01z614v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1466837638',owner_user_name='tempest-TestVolumeBootPattern-1466837638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:10:51Z,user_data=None,user_id='bae03c9c8a9a40b2af6bd1fefb3561d0',uuid=d473909b-b527-455c-9048-22e6616b6fb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ed07331-5c24-4b78-9d63-b0aa7186af4a", "address": "fa:16:3e:b2:42:0e", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed07331-5c", "ovs_interfaceid": "2ed07331-5c24-4b78-9d63-b0aa7186af4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 09:11:02 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converting VIF {"id": "2ed07331-5c24-4b78-9d63-b0aa7186af4a", "address": "fa:16:3e:b2:42:0e", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed07331-5c", "ovs_interfaceid": "2ed07331-5c24-4b78-9d63-b0aa7186af4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:11:02 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:42:0e,bridge_name='br-int',has_traffic_filtering=True,id=2ed07331-5c24-4b78-9d63-b0aa7186af4a,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ed07331-5c') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:11:02 user nova-compute[73104]: DEBUG os_vif [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:42:0e,bridge_name='br-int',has_traffic_filtering=True,id=2ed07331-5c24-4b78-9d63-b0aa7186af4a,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ed07331-5c') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 09:11:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:11:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 09:11:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ed07331-5c, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:11:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2ed07331-5c, col_values=(('external_ids', {'iface-id': '2ed07331-5c24-4b78-9d63-b0aa7186af4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:42:0e', 'vm-uuid': 'd473909b-b527-455c-9048-22e6616b6fb3'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:11:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:11:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:02 user nova-compute[73104]: INFO os_vif [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:42:0e,bridge_name='br-int',has_traffic_filtering=True,id=2ed07331-5c24-4b78-9d63-b0aa7186af4a,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ed07331-5c')
Aug 26 09:11:03 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:11:03 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] No VIF found with MAC fa:16:3e:b2:42:0e, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 09:11:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:04 user nova-compute[73104]: DEBUG nova.compute.manager [req-b716341e-d22e-46b8-bd48-aac016d7d46e req-b9cd4c76-05ce-46d5-87fe-0d0aed58dd0d service nova] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Received event network-vif-plugged-2ed07331-5c24-4b78-9d63-b0aa7186af4a {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:11:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b716341e-d22e-46b8-bd48-aac016d7d46e req-b9cd4c76-05ce-46d5-87fe-0d0aed58dd0d service nova] Acquiring lock "d473909b-b527-455c-9048-22e6616b6fb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:11:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b716341e-d22e-46b8-bd48-aac016d7d46e req-b9cd4c76-05ce-46d5-87fe-0d0aed58dd0d service nova] Lock "d473909b-b527-455c-9048-22e6616b6fb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:11:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b716341e-d22e-46b8-bd48-aac016d7d46e req-b9cd4c76-05ce-46d5-87fe-0d0aed58dd0d service nova] Lock "d473909b-b527-455c-9048-22e6616b6fb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:11:04 user nova-compute[73104]: DEBUG nova.compute.manager [req-b716341e-d22e-46b8-bd48-aac016d7d46e req-b9cd4c76-05ce-46d5-87fe-0d0aed58dd0d service nova] [instance: d473909b-b527-455c-9048-22e6616b6fb3] No waiting events found dispatching network-vif-plugged-2ed07331-5c24-4b78-9d63-b0aa7186af4a {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:11:04 user nova-compute[73104]: WARNING nova.compute.manager [req-b716341e-d22e-46b8-bd48-aac016d7d46e req-b9cd4c76-05ce-46d5-87fe-0d0aed58dd0d service nova] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Received unexpected event network-vif-plugged-2ed07331-5c24-4b78-9d63-b0aa7186af4a for instance with vm_state building and task_state spawning.
Aug 26 09:11:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:06 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693041066.554779, d473909b-b527-455c-9048-22e6616b6fb3 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:11:06 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: d473909b-b527-455c-9048-22e6616b6fb3] VM Resumed (Lifecycle Event)
Aug 26 09:11:06 user nova-compute[73104]: DEBUG nova.compute.manager [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 09:11:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 09:11:06 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Instance spawned successfully.
Aug 26 09:11:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 09:11:06 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:11:06 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:11:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:11:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:11:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:11:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:11:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:11:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:11:06 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: d473909b-b527-455c-9048-22e6616b6fb3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 09:11:06 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693041066.5586414, d473909b-b527-455c-9048-22e6616b6fb3 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:11:06 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: d473909b-b527-455c-9048-22e6616b6fb3] VM Started (Lifecycle Event)
Aug 26 09:11:06 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:11:06 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:11:06 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: d473909b-b527-455c-9048-22e6616b6fb3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 09:11:06 user nova-compute[73104]: INFO nova.compute.manager [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Took 5.13 seconds to spawn the instance on the hypervisor.
Aug 26 09:11:06 user nova-compute[73104]: DEBUG nova.compute.manager [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:11:06 user nova-compute[73104]: INFO nova.compute.manager [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Took 16.19 seconds to build instance.
Aug 26 09:11:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-9e3f39d1-f654-4534-90d5-5d9599ee17c9 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "d473909b-b527-455c-9048-22e6616b6fb3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.284s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:11:06 user nova-compute[73104]: DEBUG nova.compute.manager [req-02db7357-4a83-49ba-8df9-1a8554d76ecc req-381bc7ce-7cb7-4be4-9aa3-fb7aad8c5b2c service nova] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Received event network-vif-plugged-2ed07331-5c24-4b78-9d63-b0aa7186af4a {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:11:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-02db7357-4a83-49ba-8df9-1a8554d76ecc req-381bc7ce-7cb7-4be4-9aa3-fb7aad8c5b2c service nova] Acquiring lock "d473909b-b527-455c-9048-22e6616b6fb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:11:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-02db7357-4a83-49ba-8df9-1a8554d76ecc req-381bc7ce-7cb7-4be4-9aa3-fb7aad8c5b2c service nova] Lock "d473909b-b527-455c-9048-22e6616b6fb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:11:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-02db7357-4a83-49ba-8df9-1a8554d76ecc req-381bc7ce-7cb7-4be4-9aa3-fb7aad8c5b2c service nova] Lock "d473909b-b527-455c-9048-22e6616b6fb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:11:06 user nova-compute[73104]: DEBUG nova.compute.manager [req-02db7357-4a83-49ba-8df9-1a8554d76ecc req-381bc7ce-7cb7-4be4-9aa3-fb7aad8c5b2c service nova] [instance: d473909b-b527-455c-9048-22e6616b6fb3] No waiting events found dispatching network-vif-plugged-2ed07331-5c24-4b78-9d63-b0aa7186af4a {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:11:06 user nova-compute[73104]: WARNING nova.compute.manager [req-02db7357-4a83-49ba-8df9-1a8554d76ecc req-381bc7ce-7cb7-4be4-9aa3-fb7aad8c5b2c service nova] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Received unexpected event network-vif-plugged-2ed07331-5c24-4b78-9d63-b0aa7186af4a for instance with vm_state active and task_state None.
Aug 26 09:11:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "91a80cff-7890-4379-812d-93a1312e89ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:11:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "91a80cff-7890-4379-812d-93a1312e89ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:11:10 user nova-compute[73104]: DEBUG nova.compute.manager [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 09:11:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:11:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:11:10 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 09:11:10 user nova-compute[73104]: INFO nova.compute.claims [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Claim successful on node user
Aug 26 09:11:11 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:11:11 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:11:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.279s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:11:11 user nova-compute[73104]: DEBUG nova.compute.manager [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 09:11:11 user nova-compute[73104]: DEBUG nova.compute.manager [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 09:11:11 user nova-compute[73104]: DEBUG nova.network.neutron [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 09:11:11 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 09:11:11 user nova-compute[73104]: DEBUG nova.compute.manager [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 09:11:11 user nova-compute[73104]: DEBUG nova.compute.manager [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 09:11:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 09:11:11 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Creating image(s)
Aug 26 09:11:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "/opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:11:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "/opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:11:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "/opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:11:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:11:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.186s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:11:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:11:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:11:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:11:11 user nova-compute[73104]: DEBUG nova.policy [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da4b6574d165418eaf2b8c8b84d6151f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7642d165474defadde34dabc11f842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 09:11:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.187s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:11:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:11:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk 1073741824" returned: 0 in 0.057s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:11:11 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:11:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:11:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.182s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:11:12 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Checking if we can resize image /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 09:11:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:11:12 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:11:12 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:11:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:11:12 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Cannot resize image /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 09:11:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 09:11:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Ensure instance console log exists: /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 09:11:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:11:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:11:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:11:12 user nova-compute[73104]: DEBUG nova.network.neutron [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Successfully created port: bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 09:11:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.network.neutron [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Successfully updated port: bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "refresh_cache-91a80cff-7890-4379-812d-93a1312e89ce" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquired lock "refresh_cache-91a80cff-7890-4379-812d-93a1312e89ce" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.network.neutron [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.compute.manager [req-aec401ea-6dd5-4729-acb4-2c25f4ef90a2 req-1ccbe943-3003-4804-b4a1-8842997d5027 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received event network-changed-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.compute.manager [req-aec401ea-6dd5-4729-acb4-2c25f4ef90a2 req-1ccbe943-3003-4804-b4a1-8842997d5027 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Refreshing instance network info cache due to event network-changed-bd4b382b-e0fc-4d71-a554-0985a3ecdc92. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-aec401ea-6dd5-4729-acb4-2c25f4ef90a2 req-1ccbe943-3003-4804-b4a1-8842997d5027 service nova] Acquiring lock "refresh_cache-91a80cff-7890-4379-812d-93a1312e89ce" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.network.neutron [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.network.neutron [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Updating instance_info_cache with network_info: [{"id": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "address": "fa:16:3e:09:9c:0d", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4b382b-e0", "ovs_interfaceid": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Releasing lock "refresh_cache-91a80cff-7890-4379-812d-93a1312e89ce" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.compute.manager [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Instance network_info: |[{"id": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "address": "fa:16:3e:09:9c:0d", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4b382b-e0", "ovs_interfaceid": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-aec401ea-6dd5-4729-acb4-2c25f4ef90a2 req-1ccbe943-3003-4804-b4a1-8842997d5027 service nova] Acquired lock "refresh_cache-91a80cff-7890-4379-812d-93a1312e89ce" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.network.neutron [req-aec401ea-6dd5-4729-acb4-2c25f4ef90a2 req-1ccbe943-3003-4804-b4a1-8842997d5027 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Refreshing network info cache for port bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Start _get_guest_xml network_info=[{"id": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "address": "fa:16:3e:09:9c:0d", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4b382b-e0", "ovs_interfaceid": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 09:11:13 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:11:13 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:11:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-610449647',display_name='tempest-ServerRescueNegativeTestJSON-server-610449647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-610449647',id=49,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZ21PFmAeWEv6gMElqhwF4yV9CGe2trYvz4xOHn+iIp4VodL+fOa8EV0yQ0NIqBqCjZgTOL7NE/HAkaYxxZbDjGcWBiUMQ44esb2PVkSUUIhbIlJKiiChZq8vE/UjbNuw==',key_name='tempest-keypair-189958290',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b7642d165474defadde34dabc11f842',ramdisk_id='',reservation_id='r-j9qm35ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-901062798',owner_user_name='tempest-ServerRescueNegativeTestJSON-901062798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:11:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da4b6574d165418eaf2b8c8b84d6151f',uuid=91a80cff-7890-4379-812d-93a1312e89ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "address": "fa:16:3e:09:9c:0d", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4b382b-e0", "ovs_interfaceid": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Converting VIF {"id": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "address": "fa:16:3e:09:9c:0d", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4b382b-e0", "ovs_interfaceid": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:9c:0d,bridge_name='br-int',has_traffic_filtering=True,id=bd4b382b-e0fc-4d71-a554-0985a3ecdc92,network=Network(fb2d19ab-1c79-4529-b058-e1b8c4fc8276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd4b382b-e0') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.objects.instance [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lazy-loading 'pci_devices' on Instance uuid 91a80cff-7890-4379-812d-93a1312e89ce {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] End _get_guest_xml xml=<domain type="kvm">
Aug 26 09:11:13 user nova-compute[73104]:   <uuid>91a80cff-7890-4379-812d-93a1312e89ce</uuid>
Aug 26 09:11:13 user nova-compute[73104]:   <name>instance-00000031</name>
Aug 26 09:11:13 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 09:11:13 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 09:11:13 user nova-compute[73104]:   <metadata>
Aug 26 09:11:13 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 09:11:13 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 09:11:13 user nova-compute[73104]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-610449647</nova:name>
Aug 26 09:11:13 user nova-compute[73104]:       <nova:creationTime>2023-08-26 09:11:13</nova:creationTime>
Aug 26 09:11:13 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 09:11:13 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 09:11:13 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 09:11:13 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 09:11:13 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 09:11:13 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 09:11:13 user nova-compute[73104]:       </nova:flavor>
Aug 26 09:11:13 user nova-compute[73104]:       <nova:owner>
Aug 26 09:11:13 user nova-compute[73104]:         <nova:user uuid="da4b6574d165418eaf2b8c8b84d6151f">tempest-ServerRescueNegativeTestJSON-901062798-project-member</nova:user>
Aug 26 09:11:13 user nova-compute[73104]:         <nova:project uuid="0b7642d165474defadde34dabc11f842">tempest-ServerRescueNegativeTestJSON-901062798</nova:project>
Aug 26 09:11:13 user nova-compute[73104]:       </nova:owner>
Aug 26 09:11:13 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 09:11:13 user nova-compute[73104]:       <nova:ports>
Aug 26 09:11:13 user nova-compute[73104]:         <nova:port uuid="bd4b382b-e0fc-4d71-a554-0985a3ecdc92">
Aug 26 09:11:13 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 09:11:13 user nova-compute[73104]:         </nova:port>
Aug 26 09:11:13 user nova-compute[73104]:       </nova:ports>
Aug 26 09:11:13 user nova-compute[73104]:     </nova:instance>
Aug 26 09:11:13 user nova-compute[73104]:   </metadata>
Aug 26 09:11:13 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 09:11:13 user nova-compute[73104]:     <system>
Aug 26 09:11:13 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 09:11:13 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 09:11:13 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 09:11:13 user nova-compute[73104]:       <entry name="serial">91a80cff-7890-4379-812d-93a1312e89ce</entry>
Aug 26 09:11:13 user nova-compute[73104]:       <entry name="uuid">91a80cff-7890-4379-812d-93a1312e89ce</entry>
Aug 26 09:11:13 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 09:11:13 user nova-compute[73104]:     </system>
Aug 26 09:11:13 user nova-compute[73104]:   </sysinfo>
Aug 26 09:11:13 user nova-compute[73104]:   <os>
Aug 26 09:11:13 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 09:11:13 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 09:11:13 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 09:11:13 user nova-compute[73104]:   </os>
Aug 26 09:11:13 user nova-compute[73104]:   <features>
Aug 26 09:11:13 user nova-compute[73104]:     <acpi/>
Aug 26 09:11:13 user nova-compute[73104]:     <apic/>
Aug 26 09:11:13 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 09:11:13 user nova-compute[73104]:   </features>
Aug 26 09:11:13 user nova-compute[73104]:   <clock offset="utc">
Aug 26 09:11:13 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 09:11:13 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 09:11:13 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 09:11:13 user nova-compute[73104]:   </clock>
Aug 26 09:11:13 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 09:11:13 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 09:11:13 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 09:11:13 user nova-compute[73104]:   </cpu>
Aug 26 09:11:13 user nova-compute[73104]:   <devices>
Aug 26 09:11:13 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 09:11:13 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 09:11:13 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk"/>
Aug 26 09:11:13 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 09:11:13 user nova-compute[73104]:     </disk>
Aug 26 09:11:13 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 09:11:13 user nova-compute[73104]:       <mac address="fa:16:3e:09:9c:0d"/>
Aug 26 09:11:13 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:11:13 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 09:11:13 user nova-compute[73104]:       <target dev="tapbd4b382b-e0"/>
Aug 26 09:11:13 user nova-compute[73104]:     </interface>
Aug 26 09:11:13 user nova-compute[73104]:     <serial type="pty">
Aug 26 09:11:13 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/console.log" append="off"/>
Aug 26 09:11:13 user nova-compute[73104]:     </serial>
Aug 26 09:11:13 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 09:11:13 user nova-compute[73104]:     <video>
Aug 26 09:11:13 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:11:13 user nova-compute[73104]:     </video>
Aug 26 09:11:13 user nova-compute[73104]:     <rng model="virtio">
Aug 26 09:11:13 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 09:11:13 user nova-compute[73104]:     </rng>
Aug 26 09:11:13 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 09:11:13 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 09:11:13 user nova-compute[73104]:       <stats period="10"/>
Aug 26 09:11:13 user nova-compute[73104]:     </memballoon>
Aug 26 09:11:13 user nova-compute[73104]:   </devices>
Aug 26 09:11:13 user nova-compute[73104]: </domain>
Aug 26 09:11:13 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:11:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-610449647',display_name='tempest-ServerRescueNegativeTestJSON-server-610449647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-610449647',id=49,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZ21PFmAeWEv6gMElqhwF4yV9CGe2trYvz4xOHn+iIp4VodL+fOa8EV0yQ0NIqBqCjZgTOL7NE/HAkaYxxZbDjGcWBiUMQ44esb2PVkSUUIhbIlJKiiChZq8vE/UjbNuw==',key_name='tempest-keypair-189958290',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b7642d165474defadde34dabc11f842',ramdisk_id='',reservation_id='r-j9qm35ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-901062798',owner_user_name='tempest-ServerRescueNegativeTestJSON-901062798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:11:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da4b6574d165418eaf2b8c8b84d6151f',uuid=91a80cff-7890-4379-812d-93a1312e89ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "address": "fa:16:3e:09:9c:0d", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4b382b-e0", "ovs_interfaceid": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Converting VIF {"id": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "address": "fa:16:3e:09:9c:0d", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4b382b-e0", "ovs_interfaceid": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:9c:0d,bridge_name='br-int',has_traffic_filtering=True,id=bd4b382b-e0fc-4d71-a554-0985a3ecdc92,network=Network(fb2d19ab-1c79-4529-b058-e1b8c4fc8276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd4b382b-e0') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG os_vif [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:9c:0d,bridge_name='br-int',has_traffic_filtering=True,id=bd4b382b-e0fc-4d71-a554-0985a3ecdc92,network=Network(fb2d19ab-1c79-4529-b058-e1b8c4fc8276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd4b382b-e0') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd4b382b-e0, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbd4b382b-e0, col_values=(('external_ids', {'iface-id': 'bd4b382b-e0fc-4d71-a554-0985a3ecdc92', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:9c:0d', 'vm-uuid': '91a80cff-7890-4379-812d-93a1312e89ce'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:13 user nova-compute[73104]: INFO os_vif [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:9c:0d,bridge_name='br-int',has_traffic_filtering=True,id=bd4b382b-e0fc-4d71-a554-0985a3ecdc92,network=Network(fb2d19ab-1c79-4529-b058-e1b8c4fc8276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd4b382b-e0')
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] No VIF found with MAC fa:16:3e:09:9c:0d, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.network.neutron [req-aec401ea-6dd5-4729-acb4-2c25f4ef90a2 req-1ccbe943-3003-4804-b4a1-8842997d5027 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Updated VIF entry in instance network info cache for port bd4b382b-e0fc-4d71-a554-0985a3ecdc92. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG nova.network.neutron [req-aec401ea-6dd5-4729-acb4-2c25f4ef90a2 req-1ccbe943-3003-4804-b4a1-8842997d5027 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Updating instance_info_cache with network_info: [{"id": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "address": "fa:16:3e:09:9c:0d", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4b382b-e0", "ovs_interfaceid": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:11:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-aec401ea-6dd5-4729-acb4-2c25f4ef90a2 req-1ccbe943-3003-4804-b4a1-8842997d5027 service nova] Releasing lock "refresh_cache-91a80cff-7890-4379-812d-93a1312e89ce" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:11:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:15 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:11:15 user nova-compute[73104]: DEBUG nova.compute.manager [req-3f38e91c-b4fd-432a-92a6-b9f65001cfa0 req-be244c0b-1034-4013-8f69-2890ecb7026a service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received event network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:11:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3f38e91c-b4fd-432a-92a6-b9f65001cfa0 req-be244c0b-1034-4013-8f69-2890ecb7026a service nova] Acquiring lock "91a80cff-7890-4379-812d-93a1312e89ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:11:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3f38e91c-b4fd-432a-92a6-b9f65001cfa0 req-be244c0b-1034-4013-8f69-2890ecb7026a service nova] Lock "91a80cff-7890-4379-812d-93a1312e89ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:11:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3f38e91c-b4fd-432a-92a6-b9f65001cfa0 req-be244c0b-1034-4013-8f69-2890ecb7026a service nova] Lock "91a80cff-7890-4379-812d-93a1312e89ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:11:15 user nova-compute[73104]: DEBUG nova.compute.manager [req-3f38e91c-b4fd-432a-92a6-b9f65001cfa0 req-be244c0b-1034-4013-8f69-2890ecb7026a service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] No waiting events found dispatching network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:11:15 user nova-compute[73104]: WARNING nova.compute.manager [req-3f38e91c-b4fd-432a-92a6-b9f65001cfa0 req-be244c0b-1034-4013-8f69-2890ecb7026a service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received unexpected event network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 for instance with vm_state building and task_state spawning.
Aug 26 09:11:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:16 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:11:16 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:11:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:11:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:11:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:11:16 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:11:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:11:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:11:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:11:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:11:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:11:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:11:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:11:17 user nova-compute[73104]: DEBUG nova.compute.manager [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 09:11:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 09:11:17 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693041077.057784, 91a80cff-7890-4379-812d-93a1312e89ce => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:11:17 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] VM Resumed (Lifecycle Event)
Aug 26 09:11:17 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Instance spawned successfully.
Aug 26 09:11:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 09:11:17 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:11:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:11:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:11:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:11:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:11:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:11:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:11:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:11:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:11:17 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:11:17 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 09:11:17 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693041077.0579906, 91a80cff-7890-4379-812d-93a1312e89ce => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:11:17 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] VM Started (Lifecycle Event)
Aug 26 09:11:17 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:11:17 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:11:17 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 09:11:17 user nova-compute[73104]: INFO nova.compute.manager [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Took 5.81 seconds to spawn the instance on the hypervisor.
Aug 26 09:11:17 user nova-compute[73104]: DEBUG nova.compute.manager [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:11:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:11:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:11:17 user nova-compute[73104]: DEBUG nova.compute.manager [req-83b98121-c53f-4590-837c-539fef2e4181 req-e2b13fee-d737-4d0b-af76-62be35887b45 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received event network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:11:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-83b98121-c53f-4590-837c-539fef2e4181 req-e2b13fee-d737-4d0b-af76-62be35887b45 service nova] Acquiring lock "91a80cff-7890-4379-812d-93a1312e89ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:11:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-83b98121-c53f-4590-837c-539fef2e4181 req-e2b13fee-d737-4d0b-af76-62be35887b45 service nova] Lock "91a80cff-7890-4379-812d-93a1312e89ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:11:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-83b98121-c53f-4590-837c-539fef2e4181 req-e2b13fee-d737-4d0b-af76-62be35887b45 service nova] Lock "91a80cff-7890-4379-812d-93a1312e89ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:11:17 user nova-compute[73104]: DEBUG nova.compute.manager [req-83b98121-c53f-4590-837c-539fef2e4181 req-e2b13fee-d737-4d0b-af76-62be35887b45 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] No waiting events found dispatching network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:11:17 user nova-compute[73104]: WARNING nova.compute.manager [req-83b98121-c53f-4590-837c-539fef2e4181 req-e2b13fee-d737-4d0b-af76-62be35887b45 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received unexpected event network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 for instance with vm_state building and task_state spawning.
Aug 26 09:11:17 user nova-compute[73104]: INFO nova.compute.manager [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Took 6.47 seconds to build instance.
Aug 26 09:11:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-cc455f8a-38a4-45a1-b258-e2b7ff7fb3cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "91a80cff-7890-4379-812d-93a1312e89ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.575s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:11:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:11:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:11:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:11:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:11:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:11:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf088ee3-5c28-4513-84f1-6fd264d10310/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:11:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf088ee3-5c28-4513-84f1-6fd264d10310/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:11:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf088ee3-5c28-4513-84f1-6fd264d10310/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:11:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf088ee3-5c28-4513-84f1-6fd264d10310/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:11:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 09:11:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:18 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:11:18 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:11:18 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8250MB free_disk=24.083248138427734GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:11:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:11:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.005s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:11:18 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:11:18 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 432a66be-853d-42d7-8622-0417ef36045c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:11:18 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance cf088ee3-5c28-4513-84f1-6fd264d10310 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:11:18 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance d473909b-b527-455c-9048-22e6616b6fb3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:11:18 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 91a80cff-7890-4379-812d-93a1312e89ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:11:18 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:11:18 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:11:19 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:11:19 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:11:19 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:11:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.311s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:11:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:20 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:11:20 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:11:20 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:11:20 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:11:20 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:11:20 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:11:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-432a66be-853d-42d7-8622-0417ef36045c" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:11:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-432a66be-853d-42d7-8622-0417ef36045c" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:11:20 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 09:11:20 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Updating instance_info_cache with network_info: [{"id": "52b25498-8470-454f-9cf5-4989ec64751a", "address": "fa:16:3e:76:d4:93", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b25498-84", "ovs_interfaceid": "52b25498-8470-454f-9cf5-4989ec64751a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:11:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-432a66be-853d-42d7-8622-0417ef36045c" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:11:20 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 09:11:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:26 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:11:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-00c56dba-887c-488b-b6af-bd240aebcc7d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Acquiring lock "cf088ee3-5c28-4513-84f1-6fd264d10310" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:11:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-00c56dba-887c-488b-b6af-bd240aebcc7d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lock "cf088ee3-5c28-4513-84f1-6fd264d10310" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:11:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-00c56dba-887c-488b-b6af-bd240aebcc7d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Acquiring lock "cf088ee3-5c28-4513-84f1-6fd264d10310-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:11:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-00c56dba-887c-488b-b6af-bd240aebcc7d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lock "cf088ee3-5c28-4513-84f1-6fd264d10310-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:11:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-00c56dba-887c-488b-b6af-bd240aebcc7d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lock "cf088ee3-5c28-4513-84f1-6fd264d10310-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:11:40 user nova-compute[73104]: INFO nova.compute.manager [None req-00c56dba-887c-488b-b6af-bd240aebcc7d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Terminating instance
Aug 26 09:11:40 user nova-compute[73104]: DEBUG nova.compute.manager [None req-00c56dba-887c-488b-b6af-bd240aebcc7d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 09:11:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:41 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:41 user nova-compute[73104]: DEBUG nova.compute.manager [req-6265f118-748b-4562-808e-c6add7ced695 req-77daef21-fc21-4e03-8e7e-8a274909e25e service nova] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Received event network-vif-unplugged-2c2b84cc-5d88-422b-a31b-03de78040082 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:11:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6265f118-748b-4562-808e-c6add7ced695 req-77daef21-fc21-4e03-8e7e-8a274909e25e service nova] Acquiring lock "cf088ee3-5c28-4513-84f1-6fd264d10310-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:11:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6265f118-748b-4562-808e-c6add7ced695 req-77daef21-fc21-4e03-8e7e-8a274909e25e service nova] Lock "cf088ee3-5c28-4513-84f1-6fd264d10310-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:11:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-6265f118-748b-4562-808e-c6add7ced695 req-77daef21-fc21-4e03-8e7e-8a274909e25e service nova] Lock "cf088ee3-5c28-4513-84f1-6fd264d10310-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:11:41 user nova-compute[73104]: DEBUG nova.compute.manager [req-6265f118-748b-4562-808e-c6add7ced695 req-77daef21-fc21-4e03-8e7e-8a274909e25e service nova] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] No waiting events found dispatching network-vif-unplugged-2c2b84cc-5d88-422b-a31b-03de78040082 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:11:41 user nova-compute[73104]: DEBUG nova.compute.manager [req-6265f118-748b-4562-808e-c6add7ced695 req-77daef21-fc21-4e03-8e7e-8a274909e25e service nova] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Received event network-vif-unplugged-2c2b84cc-5d88-422b-a31b-03de78040082 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 09:11:41 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Instance destroyed successfully.
Aug 26 09:11:41 user nova-compute[73104]: DEBUG nova.objects.instance [None req-00c56dba-887c-488b-b6af-bd240aebcc7d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lazy-loading 'resources' on Instance uuid cf088ee3-5c28-4513-84f1-6fd264d10310 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:11:41 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-00c56dba-887c-488b-b6af-bd240aebcc7d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:09:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-351270687',display_name='tempest-VolumesActionsTest-instance-351270687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-351270687',id=47,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T09:09:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc656fac68304c889f4cf1998dd28b83',ramdisk_id='',reservation_id='r-21dh1zow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-23958363',owner_user_name='tempest-VolumesActionsTest-23958363-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T09:09:57Z,user_data=None,user_id='13393bcc881a4c35864d1c9ee251c9de',uuid=cf088ee3-5c28-4513-84f1-6fd264d10310,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c2b84cc-5d88-422b-a31b-03de78040082", "address": "fa:16:3e:a0:ee:44", "network": {"id": "407926d8-ed1c-4bcb-9c52-b3f1494996ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-46889385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc656fac68304c889f4cf1998dd28b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2b84cc-5d", "ovs_interfaceid": "2c2b84cc-5d88-422b-a31b-03de78040082", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 09:11:41 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-00c56dba-887c-488b-b6af-bd240aebcc7d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Converting VIF {"id": "2c2b84cc-5d88-422b-a31b-03de78040082", "address": "fa:16:3e:a0:ee:44", "network": {"id": "407926d8-ed1c-4bcb-9c52-b3f1494996ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-46889385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc656fac68304c889f4cf1998dd28b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2b84cc-5d", "ovs_interfaceid": "2c2b84cc-5d88-422b-a31b-03de78040082", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:11:41 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-00c56dba-887c-488b-b6af-bd240aebcc7d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:ee:44,bridge_name='br-int',has_traffic_filtering=True,id=2c2b84cc-5d88-422b-a31b-03de78040082,network=Network(407926d8-ed1c-4bcb-9c52-b3f1494996ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2b84cc-5d') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:11:41 user nova-compute[73104]: DEBUG os_vif [None req-00c56dba-887c-488b-b6af-bd240aebcc7d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:ee:44,bridge_name='br-int',has_traffic_filtering=True,id=2c2b84cc-5d88-422b-a31b-03de78040082,network=Network(407926d8-ed1c-4bcb-9c52-b3f1494996ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2b84cc-5d') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 09:11:41 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:41 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c2b84cc-5d, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:11:41 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:41 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:11:41 user nova-compute[73104]: INFO os_vif [None req-00c56dba-887c-488b-b6af-bd240aebcc7d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:ee:44,bridge_name='br-int',has_traffic_filtering=True,id=2c2b84cc-5d88-422b-a31b-03de78040082,network=Network(407926d8-ed1c-4bcb-9c52-b3f1494996ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2b84cc-5d')
Aug 26 09:11:41 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-00c56dba-887c-488b-b6af-bd240aebcc7d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Deleting instance files /opt/stack/data/nova/instances/cf088ee3-5c28-4513-84f1-6fd264d10310_del
Aug 26 09:11:41 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-00c56dba-887c-488b-b6af-bd240aebcc7d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Deletion of /opt/stack/data/nova/instances/cf088ee3-5c28-4513-84f1-6fd264d10310_del complete
Aug 26 09:11:41 user nova-compute[73104]: INFO nova.compute.manager [None req-00c56dba-887c-488b-b6af-bd240aebcc7d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Took 0.65 seconds to destroy the instance on the hypervisor.
Aug 26 09:11:41 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-00c56dba-887c-488b-b6af-bd240aebcc7d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 09:11:41 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 09:11:41 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 09:11:42 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:11:42 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Took 0.55 seconds to deallocate network for instance.
Aug 26 09:11:42 user nova-compute[73104]: DEBUG nova.compute.manager [req-bc55babe-5ca6-4496-99cb-51122fddb29b req-e343b5fa-d60b-4639-92bb-10a7a62451d5 service nova] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Received event network-vif-deleted-2c2b84cc-5d88-422b-a31b-03de78040082 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:11:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-00c56dba-887c-488b-b6af-bd240aebcc7d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:11:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-00c56dba-887c-488b-b6af-bd240aebcc7d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:11:42 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-00c56dba-887c-488b-b6af-bd240aebcc7d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:11:42 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-00c56dba-887c-488b-b6af-bd240aebcc7d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:11:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-00c56dba-887c-488b-b6af-bd240aebcc7d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:11:42 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-00c56dba-887c-488b-b6af-bd240aebcc7d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Deleted allocations for instance cf088ee3-5c28-4513-84f1-6fd264d10310
Aug 26 09:11:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-00c56dba-887c-488b-b6af-bd240aebcc7d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lock "cf088ee3-5c28-4513-84f1-6fd264d10310" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.574s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:11:43 user nova-compute[73104]: DEBUG nova.compute.manager [req-938d0877-85d8-45a9-834a-d2071301e059 req-264dd66a-2208-4d58-b274-5e1f2ca18dd6 service nova] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Received event network-vif-plugged-2c2b84cc-5d88-422b-a31b-03de78040082 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:11:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-938d0877-85d8-45a9-834a-d2071301e059 req-264dd66a-2208-4d58-b274-5e1f2ca18dd6 service nova] Acquiring lock "cf088ee3-5c28-4513-84f1-6fd264d10310-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:11:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-938d0877-85d8-45a9-834a-d2071301e059 req-264dd66a-2208-4d58-b274-5e1f2ca18dd6 service nova] Lock "cf088ee3-5c28-4513-84f1-6fd264d10310-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:11:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-938d0877-85d8-45a9-834a-d2071301e059 req-264dd66a-2208-4d58-b274-5e1f2ca18dd6 service nova] Lock "cf088ee3-5c28-4513-84f1-6fd264d10310-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:11:43 user nova-compute[73104]: DEBUG nova.compute.manager [req-938d0877-85d8-45a9-834a-d2071301e059 req-264dd66a-2208-4d58-b274-5e1f2ca18dd6 service nova] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] No waiting events found dispatching network-vif-plugged-2c2b84cc-5d88-422b-a31b-03de78040082 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:11:43 user nova-compute[73104]: WARNING nova.compute.manager [req-938d0877-85d8-45a9-834a-d2071301e059 req-264dd66a-2208-4d58-b274-5e1f2ca18dd6 service nova] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Received unexpected event network-vif-plugged-2c2b84cc-5d88-422b-a31b-03de78040082 for instance with vm_state deleted and task_state None.
Aug 26 09:11:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:51 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:56 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693041101.4340045, cf088ee3-5c28-4513-84f1-6fd264d10310 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:11:56 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] VM Stopped (Lifecycle Event)
Aug 26 09:11:56 user nova-compute[73104]: DEBUG nova.compute.manager [None req-ba7cd510-08fb-441e-ac7e-06ec1a257ca9 None None] [instance: cf088ee3-5c28-4513-84f1-6fd264d10310] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:11:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:11:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:11:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:11:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:11:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:11:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:01 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Acquiring lock "1e477d95-6072-4149-bb55-e30613e2cfaa" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:12:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lock "1e477d95-6072-4149-bb55-e30613e2cfaa" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:12:08 user nova-compute[73104]: INFO nova.compute.manager [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Unshelving
Aug 26 09:12:08 user nova-compute[73104]: INFO nova.virt.block_device [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Booting with volume 96d3f62d-a2b6-4867-afb0-275ea8604133 at /dev/vda
Aug 26 09:12:08 user nova-compute[73104]: DEBUG os_brick.utils [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:12:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:12:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc16377-6361-4827-8450-5fd211323891]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:12:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:12:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2280ef-50e0-479b-961b-4eb09b5fad88]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:12:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:12:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6231edcc-90e7-40f4-b814-d1e954879db4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:12:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3852353b-f700-4329-a7b9-3fe07341afe3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:12:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:12:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 09:12:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:12:09 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 09:12:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9b89d7-36cf-4d35-bcd3-f0a77e2c766c]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:12:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 09:12:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 09:12:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 09:12:09 user nova-compute[73104]: DEBUG os_brick.utils [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:12:09 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Updating existing volume attachment record: 1ec87db6-ea2e-4772-9f63-6942eb319258 {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 09:12:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:14 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:12:14 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:12:16 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:12:16 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:12:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:12:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:12:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:12:16 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:12:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:12:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:12:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:12:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:12:16 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:12:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:12:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:12:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:12:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:12:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 09:12:18 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:12:18 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:12:18 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8324MB free_disk=24.082122802734375GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:12:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:12:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:12:18 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:12:18 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 432a66be-853d-42d7-8622-0417ef36045c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:12:18 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance d473909b-b527-455c-9048-22e6616b6fb3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:12:18 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 91a80cff-7890-4379-812d-93a1312e89ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:12:18 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 1e477d95-6072-4149-bb55-e30613e2cfaa has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 26 09:12:18 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:12:18 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:12:18 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:12:18 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:12:18 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:12:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.316s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:12:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:12:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:12:19 user nova-compute[73104]: DEBUG nova.objects.instance [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lazy-loading 'pci_requests' on Instance uuid 1e477d95-6072-4149-bb55-e30613e2cfaa {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:12:19 user nova-compute[73104]: DEBUG nova.objects.instance [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lazy-loading 'numa_topology' on Instance uuid 1e477d95-6072-4149-bb55-e30613e2cfaa {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:12:19 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 09:12:19 user nova-compute[73104]: INFO nova.compute.claims [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Claim successful on node user
Aug 26 09:12:19 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:12:19 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:12:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.283s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:12:19 user nova-compute[73104]: INFO nova.network.neutron [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Updating port ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 26 09:12:19 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:12:19 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:12:19 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:12:20 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:12:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Acquiring lock "refresh_cache-1e477d95-6072-4149-bb55-e30613e2cfaa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:12:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Acquired lock "refresh_cache-1e477d95-6072-4149-bb55-e30613e2cfaa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:12:20 user nova-compute[73104]: DEBUG nova.network.neutron [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 09:12:20 user nova-compute[73104]: DEBUG nova.compute.manager [req-b4407490-35f5-4424-a1f5-6292094b38c9 req-b6300669-6fdf-4fef-8846-f22ce0532936 service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Received event network-changed-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:12:20 user nova-compute[73104]: DEBUG nova.compute.manager [req-b4407490-35f5-4424-a1f5-6292094b38c9 req-b6300669-6fdf-4fef-8846-f22ce0532936 service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Refreshing instance network info cache due to event network-changed-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:12:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b4407490-35f5-4424-a1f5-6292094b38c9 req-b6300669-6fdf-4fef-8846-f22ce0532936 service nova] Acquiring lock "refresh_cache-1e477d95-6072-4149-bb55-e30613e2cfaa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:12:20 user nova-compute[73104]: DEBUG nova.network.neutron [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Updating instance_info_cache with network_info: [{"id": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "address": "fa:16:3e:10:11:1e", "network": {"id": "429edb63-d3bb-475a-8384-ec36138e73d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-495261383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc641323fbc4076a21019951c4edb8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee23340e-9a", "ovs_interfaceid": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:12:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Releasing lock "refresh_cache-1e477d95-6072-4149-bb55-e30613e2cfaa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:12:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 09:12:20 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Creating image(s)
Aug 26 09:12:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Did not create local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 09:12:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Ensure instance console log exists: /opt/stack/data/nova/instances/1e477d95-6072-4149-bb55-e30613e2cfaa/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 09:12:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:12:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:12:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:12:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Start _get_guest_xml network_info=[{"id": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "address": "fa:16:3e:10:11:1e", "network": {"id": "429edb63-d3bb-475a-8384-ec36138e73d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-495261383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc641323fbc4076a21019951c4edb8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee23340e-9a", "ovs_interfaceid": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '1ec87db6-ea2e-4772-9f63-6942eb319258', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTWXmYIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1e477d95-6072-4149-bb55-e30613e2cfaa', 'attached_at': '', 'detached_at': '', 'volume_id': '96d3f62d-a2b6-4867-afb0-275ea8604133', 'serial': '96d3f62d-a2b6-4867-afb0-275ea8604133'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 09:12:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b4407490-35f5-4424-a1f5-6292094b38c9 req-b6300669-6fdf-4fef-8846-f22ce0532936 service nova] Acquired lock "refresh_cache-1e477d95-6072-4149-bb55-e30613e2cfaa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:12:20 user nova-compute[73104]: DEBUG nova.network.neutron [req-b4407490-35f5-4424-a1f5-6292094b38c9 req-b6300669-6fdf-4fef-8846-f22ce0532936 service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Refreshing network info cache for port ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:12:20 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:12:20 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:12:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 09:12:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 09:12:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 09:12:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 09:12:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 09:12:20 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 09:12:20 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 09:12:20 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 09:12:20 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 09:12:20 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 09:12:20 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 09:12:20 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 09:12:20 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 09:12:20 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 09:12:20 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 09:12:20 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 09:12:20 user nova-compute[73104]: DEBUG nova.objects.instance [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1e477d95-6072-4149-bb55-e30613e2cfaa {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:12:20 user nova-compute[73104]: DEBUG nova.objects.base [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Object Instance<1e477d95-6072-4149-bb55-e30613e2cfaa> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTWXmYIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:12:21 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:12:21 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:12:21 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:12:21 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:12:21 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9ac971-5544-407c-b888-5ff055bf94d6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 09:12:21 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6e9d16-6ba7-4076-8442-4e4aeb4d5929]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133] added
Aug 26 09:12:21 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15ffa7a-2977-4b89-8482-3f1db7e5a273]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d34ae89-c176-49f0-b6c1-6b405d1a5f0c]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qTWXmYIo {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qTWXmYIo" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9b98f3-1221-4a26-b3b6-9aa782aa8e28]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qTWXmYIo'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[82cc1547-d965-4178-af28-9c0b8a2b113e]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[264992d2-b9e7-48f4-99ef-c321bb1655d7]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)
Aug 26 09:12:21 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)
Aug 26 09:12:21 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacd97c1-2aa9-4f44-affc-cd7c66ba6354]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133, portal: 172.16.0.220,3260]
Aug 26 09:12:21 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133, portal: 172.16.0.220,3260] successful.
Aug 26 09:12:21 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9412734d-20da-4ca4-ab4b-a920405e9fd8]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-1e477d95-6072-4149-bb55-e30613e2cfaa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef496f59-56fd-4444-8a61-8f7412246a40]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)
Aug 26 09:12:21 user nova-compute[73104]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 (non-flash)
Aug 26 09:12:21 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)
Aug 26 09:12:21 user nova-compute[73104]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 (non-flash)
Aug 26 09:12:21 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[379fdc25-9298-43eb-9efb-9e490f04f993]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: None {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG nova.network.neutron [req-b4407490-35f5-4424-a1f5-6292094b38c9 req-b6300669-6fdf-4fef-8846-f22ce0532936 service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Updated VIF entry in instance network info cache for port ee23340e-9aaf-4a0b-b212-0be8ff5c25d7. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG nova.network.neutron [req-b4407490-35f5-4424-a1f5-6292094b38c9 req-b6300669-6fdf-4fef-8846-f22ce0532936 service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Updating instance_info_cache with network_info: [{"id": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "address": "fa:16:3e:10:11:1e", "network": {"id": "429edb63-d3bb-475a-8384-ec36138e73d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-495261383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc641323fbc4076a21019951c4edb8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee23340e-9a", "ovs_interfaceid": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b4407490-35f5-4424-a1f5-6292094b38c9 req-b6300669-6fdf-4fef-8846-f22ce0532936 service nova] Releasing lock "refresh_cache-1e477d95-6072-4149-bb55-e30613e2cfaa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-1e477d95-6072-4149-bb55-e30613e2cfaa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Updating instance_info_cache with network_info: [{"id": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "address": "fa:16:3e:10:11:1e", "network": {"id": "429edb63-d3bb-475a-8384-ec36138e73d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-495261383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc641323fbc4076a21019951c4edb8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee23340e-9a", "ovs_interfaceid": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-1e477d95-6072-4149-bb55-e30613e2cfaa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:12:21 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 09:12:22 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 09:12:22 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTWXmYIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 09:12:22 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:12:22 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23363303232393334', 'path': '/dev/sdc'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:12:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363303232393334', 'path': '/dev/sdc'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 09:12:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T09:08:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-369140230',display_name='tempest-TestShelveInstance-server-369140230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-369140230',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1332627145',keypairs=<?>,launch_index=0,launched_at=2023-08-26T09:08:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bfc641323fbc4076a21019951c4edb8e',ramdisk_id='',reservation_id='r-bkrqzvvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-488591318',owner_user_name='tempest-TestShelveInstance-488591318-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T09:12:09Z,user_data=None,user_id='10d0765b06cb4292bc08833c16abd334',uuid=1e477d95-6072-4149-bb55-e30613e2cfaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "address": "fa:16:3e:10:11:1e", "network": {"id": "429edb63-d3bb-475a-8384-ec36138e73d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-495261383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc641323fbc4076a21019951c4edb8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee23340e-9a", "ovs_interfaceid": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 09:12:22 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Converting VIF {"id": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "address": "fa:16:3e:10:11:1e", "network": {"id": "429edb63-d3bb-475a-8384-ec36138e73d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-495261383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc641323fbc4076a21019951c4edb8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee23340e-9a", "ovs_interfaceid": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:12:22 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:11:1e,bridge_name='br-int',has_traffic_filtering=True,id=ee23340e-9aaf-4a0b-b212-0be8ff5c25d7,network=Network(429edb63-d3bb-475a-8384-ec36138e73d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee23340e-9a') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:12:22 user nova-compute[73104]: DEBUG nova.objects.instance [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e477d95-6072-4149-bb55-e30613e2cfaa {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:12:22 user nova-compute[73104]: DEBUG nova.objects.base [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Object Instance<1e477d95-6072-4149-bb55-e30613e2cfaa> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 09:12:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] End _get_guest_xml xml=<domain type="kvm">
Aug 26 09:12:22 user nova-compute[73104]:   <uuid>1e477d95-6072-4149-bb55-e30613e2cfaa</uuid>
Aug 26 09:12:22 user nova-compute[73104]:   <name>instance-0000002e</name>
Aug 26 09:12:22 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 09:12:22 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 09:12:22 user nova-compute[73104]:   <metadata>
Aug 26 09:12:22 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 09:12:22 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 09:12:22 user nova-compute[73104]:       <nova:name>tempest-TestShelveInstance-server-369140230</nova:name>
Aug 26 09:12:22 user nova-compute[73104]:       <nova:creationTime>2023-08-26 09:12:20</nova:creationTime>
Aug 26 09:12:22 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 09:12:22 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 09:12:22 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 09:12:22 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 09:12:22 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 09:12:22 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 09:12:22 user nova-compute[73104]:       </nova:flavor>
Aug 26 09:12:22 user nova-compute[73104]:       <nova:owner>
Aug 26 09:12:22 user nova-compute[73104]:         <nova:user uuid="10d0765b06cb4292bc08833c16abd334">tempest-TestShelveInstance-488591318-project-member</nova:user>
Aug 26 09:12:22 user nova-compute[73104]:         <nova:project uuid="bfc641323fbc4076a21019951c4edb8e">tempest-TestShelveInstance-488591318</nova:project>
Aug 26 09:12:22 user nova-compute[73104]:       </nova:owner>
Aug 26 09:12:22 user nova-compute[73104]:       <nova:ports>
Aug 26 09:12:22 user nova-compute[73104]:         <nova:port uuid="ee23340e-9aaf-4a0b-b212-0be8ff5c25d7">
Aug 26 09:12:22 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 09:12:22 user nova-compute[73104]:         </nova:port>
Aug 26 09:12:22 user nova-compute[73104]:       </nova:ports>
Aug 26 09:12:22 user nova-compute[73104]:     </nova:instance>
Aug 26 09:12:22 user nova-compute[73104]:   </metadata>
Aug 26 09:12:22 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 09:12:22 user nova-compute[73104]:     <system>
Aug 26 09:12:22 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 09:12:22 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 09:12:22 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 09:12:22 user nova-compute[73104]:       <entry name="serial">1e477d95-6072-4149-bb55-e30613e2cfaa</entry>
Aug 26 09:12:22 user nova-compute[73104]:       <entry name="uuid">1e477d95-6072-4149-bb55-e30613e2cfaa</entry>
Aug 26 09:12:22 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 09:12:22 user nova-compute[73104]:     </system>
Aug 26 09:12:22 user nova-compute[73104]:   </sysinfo>
Aug 26 09:12:22 user nova-compute[73104]:   <os>
Aug 26 09:12:22 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 09:12:22 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 09:12:22 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 09:12:22 user nova-compute[73104]:   </os>
Aug 26 09:12:22 user nova-compute[73104]:   <features>
Aug 26 09:12:22 user nova-compute[73104]:     <acpi/>
Aug 26 09:12:22 user nova-compute[73104]:     <apic/>
Aug 26 09:12:22 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 09:12:22 user nova-compute[73104]:   </features>
Aug 26 09:12:22 user nova-compute[73104]:   <clock offset="utc">
Aug 26 09:12:22 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 09:12:22 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 09:12:22 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 09:12:22 user nova-compute[73104]:   </clock>
Aug 26 09:12:22 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 09:12:22 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 09:12:22 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 09:12:22 user nova-compute[73104]:   </cpu>
Aug 26 09:12:22 user nova-compute[73104]:   <devices>
Aug 26 09:12:22 user nova-compute[73104]:     <disk type="block" device="disk">
Aug 26 09:12:22 user nova-compute[73104]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:12:22 user nova-compute[73104]:       <source dev="/dev/sdc"/>
Aug 26 09:12:22 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 09:12:22 user nova-compute[73104]:       <serial>96d3f62d-a2b6-4867-afb0-275ea8604133</serial>
Aug 26 09:12:22 user nova-compute[73104]:     </disk>
Aug 26 09:12:22 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 09:12:22 user nova-compute[73104]:       <mac address="fa:16:3e:10:11:1e"/>
Aug 26 09:12:22 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:12:22 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 09:12:22 user nova-compute[73104]:       <target dev="tapee23340e-9a"/>
Aug 26 09:12:22 user nova-compute[73104]:     </interface>
Aug 26 09:12:22 user nova-compute[73104]:     <serial type="pty">
Aug 26 09:12:22 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/1e477d95-6072-4149-bb55-e30613e2cfaa/console.log" append="off"/>
Aug 26 09:12:22 user nova-compute[73104]:     </serial>
Aug 26 09:12:22 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 09:12:22 user nova-compute[73104]:     <video>
Aug 26 09:12:22 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:12:22 user nova-compute[73104]:     </video>
Aug 26 09:12:22 user nova-compute[73104]:     <rng model="virtio">
Aug 26 09:12:22 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 09:12:22 user nova-compute[73104]:     </rng>
Aug 26 09:12:22 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 09:12:22 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 09:12:22 user nova-compute[73104]:       <stats period="10"/>
Aug 26 09:12:22 user nova-compute[73104]:     </memballoon>
Aug 26 09:12:22 user nova-compute[73104]:   </devices>
Aug 26 09:12:22 user nova-compute[73104]: </domain>
Aug 26 09:12:22 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 09:12:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T09:08:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-369140230',display_name='tempest-TestShelveInstance-server-369140230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-369140230',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1332627145',keypairs=<?>,launch_index=0,launched_at=2023-08-26T09:08:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bfc641323fbc4076a21019951c4edb8e',ramdisk_id='',reservation_id='r-bkrqzvvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-488591318',owner_user_name='tempest-TestShelveInstance-488591318-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T09:12:09Z,user_data=None,user_id='10d0765b06cb4292bc08833c16abd334',uuid=1e477d95-6072-4149-bb55-e30613e2cfaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "address": "fa:16:3e:10:11:1e", "network": {"id": "429edb63-d3bb-475a-8384-ec36138e73d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-495261383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc641323fbc4076a21019951c4edb8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee23340e-9a", "ovs_interfaceid": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 09:12:22 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Converting VIF {"id": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "address": "fa:16:3e:10:11:1e", "network": {"id": "429edb63-d3bb-475a-8384-ec36138e73d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-495261383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc641323fbc4076a21019951c4edb8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee23340e-9a", "ovs_interfaceid": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:12:22 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:11:1e,bridge_name='br-int',has_traffic_filtering=True,id=ee23340e-9aaf-4a0b-b212-0be8ff5c25d7,network=Network(429edb63-d3bb-475a-8384-ec36138e73d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee23340e-9a') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:12:22 user nova-compute[73104]: DEBUG os_vif [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:11:1e,bridge_name='br-int',has_traffic_filtering=True,id=ee23340e-9aaf-4a0b-b212-0be8ff5c25d7,network=Network(429edb63-d3bb-475a-8384-ec36138e73d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee23340e-9a') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 09:12:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:12:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 09:12:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee23340e-9a, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:12:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapee23340e-9a, col_values=(('external_ids', {'iface-id': 'ee23340e-9aaf-4a0b-b212-0be8ff5c25d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:11:1e', 'vm-uuid': '1e477d95-6072-4149-bb55-e30613e2cfaa'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:12:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:12:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:22 user nova-compute[73104]: INFO os_vif [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:11:1e,bridge_name='br-int',has_traffic_filtering=True,id=ee23340e-9aaf-4a0b-b212-0be8ff5c25d7,network=Network(429edb63-d3bb-475a-8384-ec36138e73d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee23340e-9a')
Aug 26 09:12:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:12:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] No VIF found with MAC fa:16:3e:10:11:1e, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 09:12:22 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:12:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-1615225d-0bbf-495e-b85d-a99443ab678e req-28392cf5-f851-4cb3-bea1-f5ff3617e81f service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Received event network-vif-plugged-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:12:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1615225d-0bbf-495e-b85d-a99443ab678e req-28392cf5-f851-4cb3-bea1-f5ff3617e81f service nova] Acquiring lock "1e477d95-6072-4149-bb55-e30613e2cfaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:12:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1615225d-0bbf-495e-b85d-a99443ab678e req-28392cf5-f851-4cb3-bea1-f5ff3617e81f service nova] Lock "1e477d95-6072-4149-bb55-e30613e2cfaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:12:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1615225d-0bbf-495e-b85d-a99443ab678e req-28392cf5-f851-4cb3-bea1-f5ff3617e81f service nova] Lock "1e477d95-6072-4149-bb55-e30613e2cfaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:12:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-1615225d-0bbf-495e-b85d-a99443ab678e req-28392cf5-f851-4cb3-bea1-f5ff3617e81f service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] No waiting events found dispatching network-vif-plugged-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:12:23 user nova-compute[73104]: WARNING nova.compute.manager [req-1615225d-0bbf-495e-b85d-a99443ab678e req-28392cf5-f851-4cb3-bea1-f5ff3617e81f service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Received unexpected event network-vif-plugged-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 09:12:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:25 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693041145.7569547, 1e477d95-6072-4149-bb55-e30613e2cfaa => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:12:25 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] VM Resumed (Lifecycle Event)
Aug 26 09:12:25 user nova-compute[73104]: DEBUG nova.compute.manager [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 09:12:25 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 09:12:25 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Instance spawned successfully.
Aug 26 09:12:25 user nova-compute[73104]: DEBUG nova.compute.manager [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:12:25 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:12:25 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:12:25 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 09:12:25 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693041145.758352, 1e477d95-6072-4149-bb55-e30613e2cfaa => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:12:25 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] VM Started (Lifecycle Event)
Aug 26 09:12:25 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:12:25 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:12:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-450407d3-cca7-4675-9dfd-deaa5d6f8a30 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lock "1e477d95-6072-4149-bb55-e30613e2cfaa" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.044s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:12:25 user nova-compute[73104]: DEBUG nova.compute.manager [req-a870b7a9-9c12-434e-89e0-ddeb6a56cba9 req-35283541-fb4f-4979-904d-c274d1f47dc1 service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Received event network-vif-plugged-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:12:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a870b7a9-9c12-434e-89e0-ddeb6a56cba9 req-35283541-fb4f-4979-904d-c274d1f47dc1 service nova] Acquiring lock "1e477d95-6072-4149-bb55-e30613e2cfaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:12:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a870b7a9-9c12-434e-89e0-ddeb6a56cba9 req-35283541-fb4f-4979-904d-c274d1f47dc1 service nova] Lock "1e477d95-6072-4149-bb55-e30613e2cfaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:12:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-a870b7a9-9c12-434e-89e0-ddeb6a56cba9 req-35283541-fb4f-4979-904d-c274d1f47dc1 service nova] Lock "1e477d95-6072-4149-bb55-e30613e2cfaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:12:25 user nova-compute[73104]: DEBUG nova.compute.manager [req-a870b7a9-9c12-434e-89e0-ddeb6a56cba9 req-35283541-fb4f-4979-904d-c274d1f47dc1 service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] No waiting events found dispatching network-vif-plugged-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:12:25 user nova-compute[73104]: WARNING nova.compute.manager [req-a870b7a9-9c12-434e-89e0-ddeb6a56cba9 req-35283541-fb4f-4979-904d-c274d1f47dc1 service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Received unexpected event network-vif-plugged-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 for instance with vm_state active and task_state None.
Aug 26 09:12:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Acquiring lock "2802b2cd-793d-4ed1-9863-c059cb3c098f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:12:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lock "2802b2cd-793d-4ed1-9863-c059cb3c098f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:12:32 user nova-compute[73104]: DEBUG nova.compute.manager [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 09:12:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:12:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:12:32 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 09:12:32 user nova-compute[73104]: INFO nova.compute.claims [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Claim successful on node user
Aug 26 09:12:32 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:12:32 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:12:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.281s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:12:32 user nova-compute[73104]: DEBUG nova.compute.manager [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 09:12:32 user nova-compute[73104]: DEBUG nova.compute.manager [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 09:12:32 user nova-compute[73104]: DEBUG nova.network.neutron [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 09:12:32 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 09:12:32 user nova-compute[73104]: DEBUG nova.compute.manager [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 09:12:32 user nova-compute[73104]: DEBUG nova.policy [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13393bcc881a4c35864d1c9ee251c9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc656fac68304c889f4cf1998dd28b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 09:12:32 user nova-compute[73104]: DEBUG nova.compute.manager [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 09:12:32 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 09:12:32 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Creating image(s)
Aug 26 09:12:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Acquiring lock "/opt/stack/data/nova/instances/2802b2cd-793d-4ed1-9863-c059cb3c098f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:12:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lock "/opt/stack/data/nova/instances/2802b2cd-793d-4ed1-9863-c059cb3c098f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:12:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lock "/opt/stack/data/nova/instances/2802b2cd-793d-4ed1-9863-c059cb3c098f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:12:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.176s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:12:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:12:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:12:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.210s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:12:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/2802b2cd-793d-4ed1-9863-c059cb3c098f/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/2802b2cd-793d-4ed1-9863-c059cb3c098f/disk 1073741824" returned: 0 in 0.049s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:12:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:12:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:33 user nova-compute[73104]: DEBUG nova.network.neutron [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Successfully created port: 9fffc936-fe3c-4fb0-8979-c908a32f5784 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 09:12:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.183s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:12:33 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2802b2cd-793d-4ed1-9863-c059cb3c098f/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 09:12:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2802b2cd-793d-4ed1-9863-c059cb3c098f/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:33 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2802b2cd-793d-4ed1-9863-c059cb3c098f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:12:33 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Cannot resize image /opt/stack/data/nova/instances/2802b2cd-793d-4ed1-9863-c059cb3c098f/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 09:12:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 09:12:33 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Ensure instance console log exists: /opt/stack/data/nova/instances/2802b2cd-793d-4ed1-9863-c059cb3c098f/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 09:12:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:12:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:12:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:12:34 user nova-compute[73104]: DEBUG nova.network.neutron [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Successfully updated port: 9fffc936-fe3c-4fb0-8979-c908a32f5784 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 09:12:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Acquiring lock "refresh_cache-2802b2cd-793d-4ed1-9863-c059cb3c098f" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:12:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Acquired lock "refresh_cache-2802b2cd-793d-4ed1-9863-c059cb3c098f" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:12:34 user nova-compute[73104]: DEBUG nova.network.neutron [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 09:12:34 user nova-compute[73104]: DEBUG nova.compute.manager [req-3002f697-ff01-40af-91d3-69c0861a486e req-cc20c16d-a669-416d-a5ab-3e4d90a3b876 service nova] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Received event network-changed-9fffc936-fe3c-4fb0-8979-c908a32f5784 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:12:34 user nova-compute[73104]: DEBUG nova.compute.manager [req-3002f697-ff01-40af-91d3-69c0861a486e req-cc20c16d-a669-416d-a5ab-3e4d90a3b876 service nova] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Refreshing instance network info cache due to event network-changed-9fffc936-fe3c-4fb0-8979-c908a32f5784. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:12:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3002f697-ff01-40af-91d3-69c0861a486e req-cc20c16d-a669-416d-a5ab-3e4d90a3b876 service nova] Acquiring lock "refresh_cache-2802b2cd-793d-4ed1-9863-c059cb3c098f" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:12:34 user nova-compute[73104]: DEBUG nova.network.neutron [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG nova.network.neutron [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Updating instance_info_cache with network_info: [{"id": "9fffc936-fe3c-4fb0-8979-c908a32f5784", "address": "fa:16:3e:88:b5:30", "network": {"id": "407926d8-ed1c-4bcb-9c52-b3f1494996ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-46889385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc656fac68304c889f4cf1998dd28b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fffc936-fe", "ovs_interfaceid": "9fffc936-fe3c-4fb0-8979-c908a32f5784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Releasing lock "refresh_cache-2802b2cd-793d-4ed1-9863-c059cb3c098f" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Instance network_info: |[{"id": "9fffc936-fe3c-4fb0-8979-c908a32f5784", "address": "fa:16:3e:88:b5:30", "network": {"id": "407926d8-ed1c-4bcb-9c52-b3f1494996ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-46889385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc656fac68304c889f4cf1998dd28b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fffc936-fe", "ovs_interfaceid": "9fffc936-fe3c-4fb0-8979-c908a32f5784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3002f697-ff01-40af-91d3-69c0861a486e req-cc20c16d-a669-416d-a5ab-3e4d90a3b876 service nova] Acquired lock "refresh_cache-2802b2cd-793d-4ed1-9863-c059cb3c098f" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG nova.network.neutron [req-3002f697-ff01-40af-91d3-69c0861a486e req-cc20c16d-a669-416d-a5ab-3e4d90a3b876 service nova] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Refreshing network info cache for port 9fffc936-fe3c-4fb0-8979-c908a32f5784 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Start _get_guest_xml network_info=[{"id": "9fffc936-fe3c-4fb0-8979-c908a32f5784", "address": "fa:16:3e:88:b5:30", "network": {"id": "407926d8-ed1c-4bcb-9c52-b3f1494996ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-46889385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc656fac68304c889f4cf1998dd28b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fffc936-fe", "ovs_interfaceid": "9fffc936-fe3c-4fb0-8979-c908a32f5784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 09:12:35 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:12:35 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:12:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:12:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-817337037',display_name='tempest-VolumesActionsTest-instance-817337037',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-817337037',id=50,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc656fac68304c889f4cf1998dd28b83',ramdisk_id='',reservation_id='r-bajlzi20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-23958363',owner_user_name='tempest-VolumesActionsTest-23958363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:12:33Z,user_data=None,user_id='13393bcc881a4c35864d1c9ee251c9de',uuid=2802b2cd-793d-4ed1-9863-c059cb3c098f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fffc936-fe3c-4fb0-8979-c908a32f5784", "address": "fa:16:3e:88:b5:30", "network": {"id": "407926d8-ed1c-4bcb-9c52-b3f1494996ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-46889385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc656fac68304c889f4cf1998dd28b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fffc936-fe", "ovs_interfaceid": "9fffc936-fe3c-4fb0-8979-c908a32f5784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Converting VIF {"id": "9fffc936-fe3c-4fb0-8979-c908a32f5784", "address": "fa:16:3e:88:b5:30", "network": {"id": "407926d8-ed1c-4bcb-9c52-b3f1494996ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-46889385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc656fac68304c889f4cf1998dd28b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fffc936-fe", "ovs_interfaceid": "9fffc936-fe3c-4fb0-8979-c908a32f5784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:b5:30,bridge_name='br-int',has_traffic_filtering=True,id=9fffc936-fe3c-4fb0-8979-c908a32f5784,network=Network(407926d8-ed1c-4bcb-9c52-b3f1494996ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fffc936-fe') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG nova.objects.instance [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lazy-loading 'pci_devices' on Instance uuid 2802b2cd-793d-4ed1-9863-c059cb3c098f {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] End _get_guest_xml xml=<domain type="kvm">
Aug 26 09:12:35 user nova-compute[73104]:   <uuid>2802b2cd-793d-4ed1-9863-c059cb3c098f</uuid>
Aug 26 09:12:35 user nova-compute[73104]:   <name>instance-00000032</name>
Aug 26 09:12:35 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 09:12:35 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 09:12:35 user nova-compute[73104]:   <metadata>
Aug 26 09:12:35 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 09:12:35 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 09:12:35 user nova-compute[73104]:       <nova:name>tempest-VolumesActionsTest-instance-817337037</nova:name>
Aug 26 09:12:35 user nova-compute[73104]:       <nova:creationTime>2023-08-26 09:12:35</nova:creationTime>
Aug 26 09:12:35 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 09:12:35 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 09:12:35 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 09:12:35 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 09:12:35 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 09:12:35 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 09:12:35 user nova-compute[73104]:       </nova:flavor>
Aug 26 09:12:35 user nova-compute[73104]:       <nova:owner>
Aug 26 09:12:35 user nova-compute[73104]:         <nova:user uuid="13393bcc881a4c35864d1c9ee251c9de">tempest-VolumesActionsTest-23958363-project-member</nova:user>
Aug 26 09:12:35 user nova-compute[73104]:         <nova:project uuid="fc656fac68304c889f4cf1998dd28b83">tempest-VolumesActionsTest-23958363</nova:project>
Aug 26 09:12:35 user nova-compute[73104]:       </nova:owner>
Aug 26 09:12:35 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 09:12:35 user nova-compute[73104]:       <nova:ports>
Aug 26 09:12:35 user nova-compute[73104]:         <nova:port uuid="9fffc936-fe3c-4fb0-8979-c908a32f5784">
Aug 26 09:12:35 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 09:12:35 user nova-compute[73104]:         </nova:port>
Aug 26 09:12:35 user nova-compute[73104]:       </nova:ports>
Aug 26 09:12:35 user nova-compute[73104]:     </nova:instance>
Aug 26 09:12:35 user nova-compute[73104]:   </metadata>
Aug 26 09:12:35 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 09:12:35 user nova-compute[73104]:     <system>
Aug 26 09:12:35 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 09:12:35 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 09:12:35 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 09:12:35 user nova-compute[73104]:       <entry name="serial">2802b2cd-793d-4ed1-9863-c059cb3c098f</entry>
Aug 26 09:12:35 user nova-compute[73104]:       <entry name="uuid">2802b2cd-793d-4ed1-9863-c059cb3c098f</entry>
Aug 26 09:12:35 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 09:12:35 user nova-compute[73104]:     </system>
Aug 26 09:12:35 user nova-compute[73104]:   </sysinfo>
Aug 26 09:12:35 user nova-compute[73104]:   <os>
Aug 26 09:12:35 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 09:12:35 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 09:12:35 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 09:12:35 user nova-compute[73104]:   </os>
Aug 26 09:12:35 user nova-compute[73104]:   <features>
Aug 26 09:12:35 user nova-compute[73104]:     <acpi/>
Aug 26 09:12:35 user nova-compute[73104]:     <apic/>
Aug 26 09:12:35 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 09:12:35 user nova-compute[73104]:   </features>
Aug 26 09:12:35 user nova-compute[73104]:   <clock offset="utc">
Aug 26 09:12:35 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 09:12:35 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 09:12:35 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 09:12:35 user nova-compute[73104]:   </clock>
Aug 26 09:12:35 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 09:12:35 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 09:12:35 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 09:12:35 user nova-compute[73104]:   </cpu>
Aug 26 09:12:35 user nova-compute[73104]:   <devices>
Aug 26 09:12:35 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 09:12:35 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 09:12:35 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/2802b2cd-793d-4ed1-9863-c059cb3c098f/disk"/>
Aug 26 09:12:35 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 09:12:35 user nova-compute[73104]:     </disk>
Aug 26 09:12:35 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 09:12:35 user nova-compute[73104]:       <mac address="fa:16:3e:88:b5:30"/>
Aug 26 09:12:35 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:12:35 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 09:12:35 user nova-compute[73104]:       <target dev="tap9fffc936-fe"/>
Aug 26 09:12:35 user nova-compute[73104]:     </interface>
Aug 26 09:12:35 user nova-compute[73104]:     <serial type="pty">
Aug 26 09:12:35 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/2802b2cd-793d-4ed1-9863-c059cb3c098f/console.log" append="off"/>
Aug 26 09:12:35 user nova-compute[73104]:     </serial>
Aug 26 09:12:35 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 09:12:35 user nova-compute[73104]:     <video>
Aug 26 09:12:35 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:12:35 user nova-compute[73104]:     </video>
Aug 26 09:12:35 user nova-compute[73104]:     <rng model="virtio">
Aug 26 09:12:35 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 09:12:35 user nova-compute[73104]:     </rng>
Aug 26 09:12:35 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 09:12:35 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 09:12:35 user nova-compute[73104]:       <stats period="10"/>
Aug 26 09:12:35 user nova-compute[73104]:     </memballoon>
Aug 26 09:12:35 user nova-compute[73104]:   </devices>
Aug 26 09:12:35 user nova-compute[73104]: </domain>
Aug 26 09:12:35 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:12:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-817337037',display_name='tempest-VolumesActionsTest-instance-817337037',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-817337037',id=50,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc656fac68304c889f4cf1998dd28b83',ramdisk_id='',reservation_id='r-bajlzi20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-23958363',owner_user_name='tempest-VolumesActionsTest-23958363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:12:33Z,user_data=None,user_id='13393bcc881a4c35864d1c9ee251c9de',uuid=2802b2cd-793d-4ed1-9863-c059cb3c098f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fffc936-fe3c-4fb0-8979-c908a32f5784", "address": "fa:16:3e:88:b5:30", "network": {"id": "407926d8-ed1c-4bcb-9c52-b3f1494996ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-46889385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc656fac68304c889f4cf1998dd28b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fffc936-fe", "ovs_interfaceid": "9fffc936-fe3c-4fb0-8979-c908a32f5784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Converting VIF {"id": "9fffc936-fe3c-4fb0-8979-c908a32f5784", "address": "fa:16:3e:88:b5:30", "network": {"id": "407926d8-ed1c-4bcb-9c52-b3f1494996ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-46889385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc656fac68304c889f4cf1998dd28b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fffc936-fe", "ovs_interfaceid": "9fffc936-fe3c-4fb0-8979-c908a32f5784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:b5:30,bridge_name='br-int',has_traffic_filtering=True,id=9fffc936-fe3c-4fb0-8979-c908a32f5784,network=Network(407926d8-ed1c-4bcb-9c52-b3f1494996ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fffc936-fe') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG os_vif [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:b5:30,bridge_name='br-int',has_traffic_filtering=True,id=9fffc936-fe3c-4fb0-8979-c908a32f5784,network=Network(407926d8-ed1c-4bcb-9c52-b3f1494996ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fffc936-fe') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9fffc936-fe, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9fffc936-fe, col_values=(('external_ids', {'iface-id': '9fffc936-fe3c-4fb0-8979-c908a32f5784', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:b5:30', 'vm-uuid': '2802b2cd-793d-4ed1-9863-c059cb3c098f'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:35 user nova-compute[73104]: INFO os_vif [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:b5:30,bridge_name='br-int',has_traffic_filtering=True,id=9fffc936-fe3c-4fb0-8979-c908a32f5784,network=Network(407926d8-ed1c-4bcb-9c52-b3f1494996ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fffc936-fe')
Aug 26 09:12:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] No VIF found with MAC fa:16:3e:88:b5:30, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG nova.network.neutron [req-3002f697-ff01-40af-91d3-69c0861a486e req-cc20c16d-a669-416d-a5ab-3e4d90a3b876 service nova] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Updated VIF entry in instance network info cache for port 9fffc936-fe3c-4fb0-8979-c908a32f5784. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG nova.network.neutron [req-3002f697-ff01-40af-91d3-69c0861a486e req-cc20c16d-a669-416d-a5ab-3e4d90a3b876 service nova] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Updating instance_info_cache with network_info: [{"id": "9fffc936-fe3c-4fb0-8979-c908a32f5784", "address": "fa:16:3e:88:b5:30", "network": {"id": "407926d8-ed1c-4bcb-9c52-b3f1494996ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-46889385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc656fac68304c889f4cf1998dd28b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fffc936-fe", "ovs_interfaceid": "9fffc936-fe3c-4fb0-8979-c908a32f5784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:12:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3002f697-ff01-40af-91d3-69c0861a486e req-cc20c16d-a669-416d-a5ab-3e4d90a3b876 service nova] Releasing lock "refresh_cache-2802b2cd-793d-4ed1-9863-c059cb3c098f" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:12:36 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:36 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:36 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:36 user nova-compute[73104]: DEBUG nova.compute.manager [req-620b523c-9cbd-4afd-806f-d4c3eda1ece2 req-a8ea1dfd-c880-4598-a1aa-dfbfa9488608 service nova] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Received event network-vif-plugged-9fffc936-fe3c-4fb0-8979-c908a32f5784 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:12:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-620b523c-9cbd-4afd-806f-d4c3eda1ece2 req-a8ea1dfd-c880-4598-a1aa-dfbfa9488608 service nova] Acquiring lock "2802b2cd-793d-4ed1-9863-c059cb3c098f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:12:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-620b523c-9cbd-4afd-806f-d4c3eda1ece2 req-a8ea1dfd-c880-4598-a1aa-dfbfa9488608 service nova] Lock "2802b2cd-793d-4ed1-9863-c059cb3c098f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:12:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-620b523c-9cbd-4afd-806f-d4c3eda1ece2 req-a8ea1dfd-c880-4598-a1aa-dfbfa9488608 service nova] Lock "2802b2cd-793d-4ed1-9863-c059cb3c098f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:12:36 user nova-compute[73104]: DEBUG nova.compute.manager [req-620b523c-9cbd-4afd-806f-d4c3eda1ece2 req-a8ea1dfd-c880-4598-a1aa-dfbfa9488608 service nova] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] No waiting events found dispatching network-vif-plugged-9fffc936-fe3c-4fb0-8979-c908a32f5784 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:12:36 user nova-compute[73104]: WARNING nova.compute.manager [req-620b523c-9cbd-4afd-806f-d4c3eda1ece2 req-a8ea1dfd-c880-4598-a1aa-dfbfa9488608 service nova] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Received unexpected event network-vif-plugged-9fffc936-fe3c-4fb0-8979-c908a32f5784 for instance with vm_state building and task_state spawning.
Aug 26 09:12:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:37 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:12:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:12:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:12:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:12:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:12:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:12:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:12:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Verify base images {{(pid=73104) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 26 09:12:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Image id e28116ef-1f27-40e2-be41-f8cc5c10ee86 yields fingerprint a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 {{(pid=73104) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 26 09:12:37 user nova-compute[73104]: INFO nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] image e28116ef-1f27-40e2-be41-f8cc5c10ee86 at (/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5): checking
Aug 26 09:12:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] image e28116ef-1f27-40e2-be41-f8cc5c10ee86 at (/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5): image is in use {{(pid=73104) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 26 09:12:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=73104) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 26 09:12:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] 2802b2cd-793d-4ed1-9863-c059cb3c098f is a valid instance name {{(pid=73104) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 26 09:12:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] 2802b2cd-793d-4ed1-9863-c059cb3c098f has a disk file {{(pid=73104) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 26 09:12:37 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2802b2cd-793d-4ed1-9863-c059cb3c098f/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:37 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2802b2cd-793d-4ed1-9863-c059cb3c098f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:12:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 2802b2cd-793d-4ed1-9863-c059cb3c098f is backed by a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 {{(pid=73104) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 26 09:12:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] 1e477d95-6072-4149-bb55-e30613e2cfaa is a valid instance name {{(pid=73104) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 26 09:12:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 is a valid instance name {{(pid=73104) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 26 09:12:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 has a disk file {{(pid=73104) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 26 09:12:37 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:37 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:12:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 is backed by a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 {{(pid=73104) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 26 09:12:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] d473909b-b527-455c-9048-22e6616b6fb3 is a valid instance name {{(pid=73104) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 26 09:12:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] 432a66be-853d-42d7-8622-0417ef36045c is a valid instance name {{(pid=73104) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 26 09:12:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] 432a66be-853d-42d7-8622-0417ef36045c has a disk file {{(pid=73104) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 26 09:12:37 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:37 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:12:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 432a66be-853d-42d7-8622-0417ef36045c is backed by a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 {{(pid=73104) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 26 09:12:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] 91a80cff-7890-4379-812d-93a1312e89ce is a valid instance name {{(pid=73104) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 26 09:12:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] 91a80cff-7890-4379-812d-93a1312e89ce has a disk file {{(pid=73104) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 26 09:12:37 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:12:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 91a80cff-7890-4379-812d-93a1312e89ce is backed by a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 {{(pid=73104) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 26 09:12:38 user nova-compute[73104]: WARNING nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2b98aa7479d9550bbbb80268225eb2f28f8188c6
Aug 26 09:12:38 user nova-compute[73104]: WARNING nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/24498f0cb1430b6c450a18c2c9154b7ac4b9878f
Aug 26 09:12:38 user nova-compute[73104]: WARNING nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/44cb1fa5c00d8d1d4cd98702e1537f28f822a859
Aug 26 09:12:38 user nova-compute[73104]: WARNING nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/bf1ce7c6ad730b661c6512df2e2024b1720f8631
Aug 26 09:12:38 user nova-compute[73104]: WARNING nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/723a2d742fb8e6519c885d60345d692e8ce81fb0
Aug 26 09:12:38 user nova-compute[73104]: WARNING nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a2744857c1476c7db99e5b5528f47ee510e5f09e
Aug 26 09:12:38 user nova-compute[73104]: WARNING nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/68d231f55e691c5ea3845d5aaa824fe28b7caec4
Aug 26 09:12:38 user nova-compute[73104]: WARNING nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/16d4df834f1df9b20ea6cd960f458c49daabe537
Aug 26 09:12:38 user nova-compute[73104]: WARNING nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9f56b1bd37eb486652c6cd4f0de383960874322f
Aug 26 09:12:38 user nova-compute[73104]: INFO nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Active base files: /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5
Aug 26 09:12:38 user nova-compute[73104]: INFO nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Removable base files: /opt/stack/data/nova/instances/_base/2b98aa7479d9550bbbb80268225eb2f28f8188c6 /opt/stack/data/nova/instances/_base/24498f0cb1430b6c450a18c2c9154b7ac4b9878f /opt/stack/data/nova/instances/_base/44cb1fa5c00d8d1d4cd98702e1537f28f822a859 /opt/stack/data/nova/instances/_base/bf1ce7c6ad730b661c6512df2e2024b1720f8631 /opt/stack/data/nova/instances/_base/723a2d742fb8e6519c885d60345d692e8ce81fb0 /opt/stack/data/nova/instances/_base/a2744857c1476c7db99e5b5528f47ee510e5f09e /opt/stack/data/nova/instances/_base/68d231f55e691c5ea3845d5aaa824fe28b7caec4 /opt/stack/data/nova/instances/_base/16d4df834f1df9b20ea6cd960f458c49daabe537 /opt/stack/data/nova/instances/_base/9f56b1bd37eb486652c6cd4f0de383960874322f
Aug 26 09:12:38 user nova-compute[73104]: INFO nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2b98aa7479d9550bbbb80268225eb2f28f8188c6
Aug 26 09:12:38 user nova-compute[73104]: INFO nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/24498f0cb1430b6c450a18c2c9154b7ac4b9878f
Aug 26 09:12:38 user nova-compute[73104]: INFO nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/44cb1fa5c00d8d1d4cd98702e1537f28f822a859
Aug 26 09:12:38 user nova-compute[73104]: INFO nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bf1ce7c6ad730b661c6512df2e2024b1720f8631
Aug 26 09:12:38 user nova-compute[73104]: INFO nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/723a2d742fb8e6519c885d60345d692e8ce81fb0
Aug 26 09:12:38 user nova-compute[73104]: INFO nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a2744857c1476c7db99e5b5528f47ee510e5f09e
Aug 26 09:12:38 user nova-compute[73104]: INFO nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/68d231f55e691c5ea3845d5aaa824fe28b7caec4
Aug 26 09:12:38 user nova-compute[73104]: INFO nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/16d4df834f1df9b20ea6cd960f458c49daabe537
Aug 26 09:12:38 user nova-compute[73104]: INFO nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9f56b1bd37eb486652c6cd4f0de383960874322f
Aug 26 09:12:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Verification complete {{(pid=73104) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 26 09:12:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Verify swap images {{(pid=73104) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 26 09:12:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.imagecache [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Verify ephemeral images {{(pid=73104) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 26 09:12:38 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693041158.6276088, 2802b2cd-793d-4ed1-9863-c059cb3c098f => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:12:38 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] VM Resumed (Lifecycle Event)
Aug 26 09:12:38 user nova-compute[73104]: DEBUG nova.compute.manager [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 09:12:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 09:12:38 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Instance spawned successfully.
Aug 26 09:12:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 09:12:38 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:12:38 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:12:38 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 09:12:38 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693041158.638427, 2802b2cd-793d-4ed1-9863-c059cb3c098f => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:12:38 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] VM Started (Lifecycle Event)
Aug 26 09:12:38 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:12:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:12:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:12:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:12:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:12:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:12:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:12:38 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:12:38 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 09:12:38 user nova-compute[73104]: DEBUG nova.compute.manager [req-06a36aff-a490-4b3d-874d-5ad4d1e68e30 req-a473dbd6-6d8a-4fec-91ff-4a23222bb5c4 service nova] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Received event network-vif-plugged-9fffc936-fe3c-4fb0-8979-c908a32f5784 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:12:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-06a36aff-a490-4b3d-874d-5ad4d1e68e30 req-a473dbd6-6d8a-4fec-91ff-4a23222bb5c4 service nova] Acquiring lock "2802b2cd-793d-4ed1-9863-c059cb3c098f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:12:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-06a36aff-a490-4b3d-874d-5ad4d1e68e30 req-a473dbd6-6d8a-4fec-91ff-4a23222bb5c4 service nova] Lock "2802b2cd-793d-4ed1-9863-c059cb3c098f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:12:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-06a36aff-a490-4b3d-874d-5ad4d1e68e30 req-a473dbd6-6d8a-4fec-91ff-4a23222bb5c4 service nova] Lock "2802b2cd-793d-4ed1-9863-c059cb3c098f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:12:38 user nova-compute[73104]: DEBUG nova.compute.manager [req-06a36aff-a490-4b3d-874d-5ad4d1e68e30 req-a473dbd6-6d8a-4fec-91ff-4a23222bb5c4 service nova] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] No waiting events found dispatching network-vif-plugged-9fffc936-fe3c-4fb0-8979-c908a32f5784 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:12:38 user nova-compute[73104]: WARNING nova.compute.manager [req-06a36aff-a490-4b3d-874d-5ad4d1e68e30 req-a473dbd6-6d8a-4fec-91ff-4a23222bb5c4 service nova] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Received unexpected event network-vif-plugged-9fffc936-fe3c-4fb0-8979-c908a32f5784 for instance with vm_state building and task_state spawning.
Aug 26 09:12:38 user nova-compute[73104]: INFO nova.compute.manager [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Took 5.86 seconds to spawn the instance on the hypervisor.
Aug 26 09:12:38 user nova-compute[73104]: DEBUG nova.compute.manager [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:12:38 user nova-compute[73104]: INFO nova.compute.manager [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Took 6.49 seconds to build instance.
Aug 26 09:12:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-bec5c1bc-aea8-404b-8e12-4642b57b69b2 tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lock "2802b2cd-793d-4ed1-9863-c059cb3c098f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.577s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:12:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:42 user nova-compute[73104]: DEBUG nova.compute.manager [req-f8fdbe8f-51cc-47dd-b45e-03decd7a388f req-eb1eafbc-744e-40bc-a92b-be855eca93bc service nova] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Received event network-changed-2ed07331-5c24-4b78-9d63-b0aa7186af4a {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:12:42 user nova-compute[73104]: DEBUG nova.compute.manager [req-f8fdbe8f-51cc-47dd-b45e-03decd7a388f req-eb1eafbc-744e-40bc-a92b-be855eca93bc service nova] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Refreshing instance network info cache due to event network-changed-2ed07331-5c24-4b78-9d63-b0aa7186af4a. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:12:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f8fdbe8f-51cc-47dd-b45e-03decd7a388f req-eb1eafbc-744e-40bc-a92b-be855eca93bc service nova] Acquiring lock "refresh_cache-d473909b-b527-455c-9048-22e6616b6fb3" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:12:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f8fdbe8f-51cc-47dd-b45e-03decd7a388f req-eb1eafbc-744e-40bc-a92b-be855eca93bc service nova] Acquired lock "refresh_cache-d473909b-b527-455c-9048-22e6616b6fb3" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:12:42 user nova-compute[73104]: DEBUG nova.network.neutron [req-f8fdbe8f-51cc-47dd-b45e-03decd7a388f req-eb1eafbc-744e-40bc-a92b-be855eca93bc service nova] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Refreshing network info cache for port 2ed07331-5c24-4b78-9d63-b0aa7186af4a {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:12:43 user nova-compute[73104]: DEBUG nova.network.neutron [req-f8fdbe8f-51cc-47dd-b45e-03decd7a388f req-eb1eafbc-744e-40bc-a92b-be855eca93bc service nova] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Updated VIF entry in instance network info cache for port 2ed07331-5c24-4b78-9d63-b0aa7186af4a. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:12:43 user nova-compute[73104]: DEBUG nova.network.neutron [req-f8fdbe8f-51cc-47dd-b45e-03decd7a388f req-eb1eafbc-744e-40bc-a92b-be855eca93bc service nova] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Updating instance_info_cache with network_info: [{"id": "2ed07331-5c24-4b78-9d63-b0aa7186af4a", "address": "fa:16:3e:b2:42:0e", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed07331-5c", "ovs_interfaceid": "2ed07331-5c24-4b78-9d63-b0aa7186af4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:12:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f8fdbe8f-51cc-47dd-b45e-03decd7a388f req-eb1eafbc-744e-40bc-a92b-be855eca93bc service nova] Releasing lock "refresh_cache-d473909b-b527-455c-9048-22e6616b6fb3" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:12:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:50 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "8612ce65-8d6a-4bfc-86fd-be6094c61c35" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:12:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "8612ce65-8d6a-4bfc-86fd-be6094c61c35" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:12:57 user nova-compute[73104]: DEBUG nova.compute.manager [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 09:12:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:12:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:12:57 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 09:12:57 user nova-compute[73104]: INFO nova.compute.claims [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Claim successful on node user
Aug 26 09:12:57 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:12:57 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:12:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.335s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:12:57 user nova-compute[73104]: DEBUG nova.compute.manager [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 09:12:58 user nova-compute[73104]: DEBUG nova.compute.manager [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 09:12:58 user nova-compute[73104]: DEBUG nova.network.neutron [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 09:12:58 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 09:12:58 user nova-compute[73104]: DEBUG nova.compute.manager [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 09:12:58 user nova-compute[73104]: INFO nova.virt.block_device [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Booting with volume cde2f987-c9a9-45c3-80c2-6a4fbeede22d at /dev/vda
Aug 26 09:12:58 user nova-compute[73104]: DEBUG nova.policy [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bae03c9c8a9a40b2af6bd1fefb3561d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52518aa77344432385cfc2b73c63aebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 09:12:58 user nova-compute[73104]: DEBUG os_brick.utils [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:12:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:12:58 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e58ee29-f264-4e38-9395-9cf017c90874]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:12:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:12:58 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[188cb2ca-2929-4225-b748-4fe7578dc735]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:12:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:12:58 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f2990f-2087-4839-8e5c-746264f4886e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:12:58 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dfdcd0-522f-4c86-8c30-0b5a1be0b347]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:12:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:12:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 09:12:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:12:58 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:12:58 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 09:12:58 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa1a6a7-7317-4a9c-bc90-d0d1ece5d5bd]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:12:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 09:12:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 09:12:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 09:12:58 user nova-compute[73104]: DEBUG os_brick.utils [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:12:58 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Updating existing volume attachment record: 26b360ce-4393-4c2d-a700-f07f1fac4238 {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 09:12:58 user nova-compute[73104]: DEBUG nova.network.neutron [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Successfully created port: d7920842-6125-4174-b78b-ba0cca099169 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 09:12:59 user nova-compute[73104]: DEBUG nova.network.neutron [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Successfully updated port: d7920842-6125-4174-b78b-ba0cca099169 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 09:12:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "refresh_cache-8612ce65-8d6a-4bfc-86fd-be6094c61c35" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:12:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquired lock "refresh_cache-8612ce65-8d6a-4bfc-86fd-be6094c61c35" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:12:59 user nova-compute[73104]: DEBUG nova.network.neutron [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 09:12:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:12:59 user nova-compute[73104]: DEBUG nova.compute.manager [req-70edd597-c576-4be6-92f2-eae25733cab2 req-ae446167-05c9-44ad-9779-e98d4cf0d278 service nova] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Received event network-changed-d7920842-6125-4174-b78b-ba0cca099169 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:12:59 user nova-compute[73104]: DEBUG nova.compute.manager [req-70edd597-c576-4be6-92f2-eae25733cab2 req-ae446167-05c9-44ad-9779-e98d4cf0d278 service nova] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Refreshing instance network info cache due to event network-changed-d7920842-6125-4174-b78b-ba0cca099169. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:12:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-70edd597-c576-4be6-92f2-eae25733cab2 req-ae446167-05c9-44ad-9779-e98d4cf0d278 service nova] Acquiring lock "refresh_cache-8612ce65-8d6a-4bfc-86fd-be6094c61c35" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:12:59 user nova-compute[73104]: DEBUG nova.network.neutron [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 09:13:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:00 user nova-compute[73104]: DEBUG nova.network.neutron [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Updating instance_info_cache with network_info: [{"id": "d7920842-6125-4174-b78b-ba0cca099169", "address": "fa:16:3e:81:e4:85", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7920842-61", "ovs_interfaceid": "d7920842-6125-4174-b78b-ba0cca099169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:13:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Releasing lock "refresh_cache-8612ce65-8d6a-4bfc-86fd-be6094c61c35" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:13:00 user nova-compute[73104]: DEBUG nova.compute.manager [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Instance network_info: |[{"id": "d7920842-6125-4174-b78b-ba0cca099169", "address": "fa:16:3e:81:e4:85", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7920842-61", "ovs_interfaceid": "d7920842-6125-4174-b78b-ba0cca099169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 09:13:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-70edd597-c576-4be6-92f2-eae25733cab2 req-ae446167-05c9-44ad-9779-e98d4cf0d278 service nova] Acquired lock "refresh_cache-8612ce65-8d6a-4bfc-86fd-be6094c61c35" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:13:00 user nova-compute[73104]: DEBUG nova.network.neutron [req-70edd597-c576-4be6-92f2-eae25733cab2 req-ae446167-05c9-44ad-9779-e98d4cf0d278 service nova] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Refreshing network info cache for port d7920842-6125-4174-b78b-ba0cca099169 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:13:00 user nova-compute[73104]: DEBUG nova.network.neutron [req-70edd597-c576-4be6-92f2-eae25733cab2 req-ae446167-05c9-44ad-9779-e98d4cf0d278 service nova] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Updated VIF entry in instance network info cache for port d7920842-6125-4174-b78b-ba0cca099169. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:13:00 user nova-compute[73104]: DEBUG nova.network.neutron [req-70edd597-c576-4be6-92f2-eae25733cab2 req-ae446167-05c9-44ad-9779-e98d4cf0d278 service nova] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Updating instance_info_cache with network_info: [{"id": "d7920842-6125-4174-b78b-ba0cca099169", "address": "fa:16:3e:81:e4:85", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7920842-61", "ovs_interfaceid": "d7920842-6125-4174-b78b-ba0cca099169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:13:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-70edd597-c576-4be6-92f2-eae25733cab2 req-ae446167-05c9-44ad-9779-e98d4cf0d278 service nova] Releasing lock "refresh_cache-8612ce65-8d6a-4bfc-86fd-be6094c61c35" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:13:02 user nova-compute[73104]: DEBUG nova.compute.manager [req-62ea730b-de95-45f6-a94d-a550cb6db79c req-a3cc81d2-b0f1-437c-8708-8fa8ff923c96 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received event network-changed-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:13:02 user nova-compute[73104]: DEBUG nova.compute.manager [req-62ea730b-de95-45f6-a94d-a550cb6db79c req-a3cc81d2-b0f1-437c-8708-8fa8ff923c96 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Refreshing instance network info cache due to event network-changed-bd4b382b-e0fc-4d71-a554-0985a3ecdc92. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:13:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-62ea730b-de95-45f6-a94d-a550cb6db79c req-a3cc81d2-b0f1-437c-8708-8fa8ff923c96 service nova] Acquiring lock "refresh_cache-91a80cff-7890-4379-812d-93a1312e89ce" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:13:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-62ea730b-de95-45f6-a94d-a550cb6db79c req-a3cc81d2-b0f1-437c-8708-8fa8ff923c96 service nova] Acquired lock "refresh_cache-91a80cff-7890-4379-812d-93a1312e89ce" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:13:02 user nova-compute[73104]: DEBUG nova.network.neutron [req-62ea730b-de95-45f6-a94d-a550cb6db79c req-a3cc81d2-b0f1-437c-8708-8fa8ff923c96 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Refreshing network info cache for port bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:13:02 user nova-compute[73104]: DEBUG nova.network.neutron [req-62ea730b-de95-45f6-a94d-a550cb6db79c req-a3cc81d2-b0f1-437c-8708-8fa8ff923c96 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Updated VIF entry in instance network info cache for port bd4b382b-e0fc-4d71-a554-0985a3ecdc92. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:13:02 user nova-compute[73104]: DEBUG nova.network.neutron [req-62ea730b-de95-45f6-a94d-a550cb6db79c req-a3cc81d2-b0f1-437c-8708-8fa8ff923c96 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Updating instance_info_cache with network_info: [{"id": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "address": "fa:16:3e:09:9c:0d", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4b382b-e0", "ovs_interfaceid": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:13:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-62ea730b-de95-45f6-a94d-a550cb6db79c req-a3cc81d2-b0f1-437c-8708-8fa8ff923c96 service nova] Releasing lock "refresh_cache-91a80cff-7890-4379-812d-93a1312e89ce" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:13:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "91a80cff-7890-4379-812d-93a1312e89ce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:13:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "91a80cff-7890-4379-812d-93a1312e89ce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:13:03 user nova-compute[73104]: DEBUG nova.objects.instance [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lazy-loading 'flavor' on Instance uuid 91a80cff-7890-4379-812d-93a1312e89ce {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:13:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "91a80cff-7890-4379-812d-93a1312e89ce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:13:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "91a80cff-7890-4379-812d-93a1312e89ce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:13:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "91a80cff-7890-4379-812d-93a1312e89ce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:13:03 user nova-compute[73104]: INFO nova.compute.manager [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Attaching volume 314792be-7d74-4b09-b296-1a880cc72d99 to /dev/vdb
Aug 26 09:13:03 user nova-compute[73104]: DEBUG os_brick.utils [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:13:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:03 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[30705a83-b6b6-4413-b951-f1ea61567b30]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:13:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:03 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2431e863-d81f-4213-9d9c-55ca3f4d4f9e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:13:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:03 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c3d328-62bb-42c2-bad1-634f04f1a48b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:13:03 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eccb792-7f20-40d1-91d2-f74af76e2afe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:13:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:13:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 09:13:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:03 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:13:03 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 09:13:03 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e285f8b3-7e4b-47f8-b107-1da182ddd001]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:13:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 09:13:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 09:13:03 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 09:13:03 user nova-compute[73104]: DEBUG os_brick.utils [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:13:03 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Updating existing volume attachment record: c14cc4f2-eace-4f91-8f48-b90a914cc274 {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 09:13:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG nova.compute.manager [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 09:13:09 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Creating image(s)
Aug 26 09:13:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Did not create local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Ensure instance console log exists: /opt/stack/data/nova/instances/8612ce65-8d6a-4bfc-86fd-be6094c61c35/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Start _get_guest_xml network_info=[{"id": "d7920842-6125-4174-b78b-ba0cca099169", "address": "fa:16:3e:81:e4:85", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7920842-61", "ovs_interfaceid": "d7920842-6125-4174-b78b-ba0cca099169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '26b360ce-4393-4c2d-a700-f07f1fac4238', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DcxJsPEr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8612ce65-8d6a-4bfc-86fd-be6094c61c35', 'attached_at': '', 'detached_at': '', 'volume_id': 'cde2f987-c9a9-45c3-80c2-6a4fbeede22d', 'serial': 'cde2f987-c9a9-45c3-80c2-6a4fbeede22d'}, 'device_type': 'disk', 'volume_type': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 09:13:09 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:13:09 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:13:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DcxJsPEr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:13:09 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:13:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:13:09 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:13:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:13:09 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e199ce-32f0-4e9e-80a7-f35e0bd876e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 09:13:09 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[234bfeea-c29d-4adc-a9af-e2aa0ee4a254]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d] added
Aug 26 09:13:09 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d448f5-4c5f-4c06-8e7a-1e7066fcb43a]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e00c47-276f-4f86-b780-8af733c580e7]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DcxJsPEr {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DcxJsPEr" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee07df6d-a782-4196-9e83-bfbd959c9a31]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DcxJsPEr'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78eb3fa-e1c3-4084-888a-1529fe6ee1ec]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c9340b-4b90-4542-96e7-b3361bee671c]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)
Aug 26 09:13:09 user nova-compute[73104]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 (non-flash)
Aug 26 09:13:09 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)
Aug 26 09:13:09 user nova-compute[73104]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 (non-flash)
Aug 26 09:13:09 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d -p 172.16.0.220:3260 --login" returned: 0 in 0.134s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf12b16-8ae5-44d3-b406-b19c44f224c4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d, portal: 172.16.0.220,3260]
Aug 26 09:13:09 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d, portal: 172.16.0.220,3260] successful.
Aug 26 09:13:09 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1449c85e-e16c-4d0d-922f-add0064c9c5c]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7b16ba-3c83-4996-bc4b-601e2d51a2f5]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)
Aug 26 09:13:09 user nova-compute[73104]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 (non-flash)
Aug 26 09:13:09 user nova-compute[73104]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d (non-flash)
Aug 26 09:13:09 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)
Aug 26 09:13:09 user nova-compute[73104]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 (non-flash)
Aug 26 09:13:09 user nova-compute[73104]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d (non-flash)
Aug 26 09:13:09 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[966824cd-5a4a-4a5b-b10c-aa3c1cefec0c]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DcxJsPEr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 09:13:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:13:10 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23033376132316266', 'path': '/dev/sdd'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:13:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033376132316266', 'path': '/dev/sdd'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 09:13:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:12:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1312322311',display_name='tempest-TestVolumeBootPattern-server-1312322311',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1312322311',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8fRBTEgWDKx34ZjNEBgV61oHsmnLZZP+YeQ0nSInYs/RyTZwfSiKB8KZ1aFHYupg5U+DrtEMSfZK0uHXz1ZYj79NAVQuNGFL8QjT4HEH9i5HLhublR/vgOebjTekyxMQ==',key_name='tempest-TestVolumeBootPattern-447823700',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52518aa77344432385cfc2b73c63aebe',ramdisk_id='',reservation_id='r-nzxsamir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1466837638',owner_user_name='tempest-TestVolumeBootPattern-1466837638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:12:58Z,user_data=None,user_id='bae03c9c8a9a40b2af6bd1fefb3561d0',uuid=8612ce65-8d6a-4bfc-86fd-be6094c61c35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7920842-6125-4174-b78b-ba0cca099169", "address": "fa:16:3e:81:e4:85", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7920842-61", "ovs_interfaceid": "d7920842-6125-4174-b78b-ba0cca099169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 09:13:10 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converting VIF {"id": "d7920842-6125-4174-b78b-ba0cca099169", "address": "fa:16:3e:81:e4:85", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7920842-61", "ovs_interfaceid": "d7920842-6125-4174-b78b-ba0cca099169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:13:10 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:e4:85,bridge_name='br-int',has_traffic_filtering=True,id=d7920842-6125-4174-b78b-ba0cca099169,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7920842-61') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:13:10 user nova-compute[73104]: DEBUG nova.objects.instance [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lazy-loading 'pci_devices' on Instance uuid 8612ce65-8d6a-4bfc-86fd-be6094c61c35 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:13:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] End _get_guest_xml xml=<domain type="kvm">
Aug 26 09:13:10 user nova-compute[73104]:   <uuid>8612ce65-8d6a-4bfc-86fd-be6094c61c35</uuid>
Aug 26 09:13:10 user nova-compute[73104]:   <name>instance-00000033</name>
Aug 26 09:13:10 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 09:13:10 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 09:13:10 user nova-compute[73104]:   <metadata>
Aug 26 09:13:10 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 09:13:10 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 09:13:10 user nova-compute[73104]:       <nova:name>tempest-TestVolumeBootPattern-server-1312322311</nova:name>
Aug 26 09:13:10 user nova-compute[73104]:       <nova:creationTime>2023-08-26 09:13:09</nova:creationTime>
Aug 26 09:13:10 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 09:13:10 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 09:13:10 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 09:13:10 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 09:13:10 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 09:13:10 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 09:13:10 user nova-compute[73104]:       </nova:flavor>
Aug 26 09:13:10 user nova-compute[73104]:       <nova:owner>
Aug 26 09:13:10 user nova-compute[73104]:         <nova:user uuid="bae03c9c8a9a40b2af6bd1fefb3561d0">tempest-TestVolumeBootPattern-1466837638-project-member</nova:user>
Aug 26 09:13:10 user nova-compute[73104]:         <nova:project uuid="52518aa77344432385cfc2b73c63aebe">tempest-TestVolumeBootPattern-1466837638</nova:project>
Aug 26 09:13:10 user nova-compute[73104]:       </nova:owner>
Aug 26 09:13:10 user nova-compute[73104]:       <nova:ports>
Aug 26 09:13:10 user nova-compute[73104]:         <nova:port uuid="d7920842-6125-4174-b78b-ba0cca099169">
Aug 26 09:13:10 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 09:13:10 user nova-compute[73104]:         </nova:port>
Aug 26 09:13:10 user nova-compute[73104]:       </nova:ports>
Aug 26 09:13:10 user nova-compute[73104]:     </nova:instance>
Aug 26 09:13:10 user nova-compute[73104]:   </metadata>
Aug 26 09:13:10 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 09:13:10 user nova-compute[73104]:     <system>
Aug 26 09:13:10 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 09:13:10 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 09:13:10 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 09:13:10 user nova-compute[73104]:       <entry name="serial">8612ce65-8d6a-4bfc-86fd-be6094c61c35</entry>
Aug 26 09:13:10 user nova-compute[73104]:       <entry name="uuid">8612ce65-8d6a-4bfc-86fd-be6094c61c35</entry>
Aug 26 09:13:10 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 09:13:10 user nova-compute[73104]:     </system>
Aug 26 09:13:10 user nova-compute[73104]:   </sysinfo>
Aug 26 09:13:10 user nova-compute[73104]:   <os>
Aug 26 09:13:10 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 09:13:10 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 09:13:10 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 09:13:10 user nova-compute[73104]:   </os>
Aug 26 09:13:10 user nova-compute[73104]:   <features>
Aug 26 09:13:10 user nova-compute[73104]:     <acpi/>
Aug 26 09:13:10 user nova-compute[73104]:     <apic/>
Aug 26 09:13:10 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 09:13:10 user nova-compute[73104]:   </features>
Aug 26 09:13:10 user nova-compute[73104]:   <clock offset="utc">
Aug 26 09:13:10 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 09:13:10 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 09:13:10 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 09:13:10 user nova-compute[73104]:   </clock>
Aug 26 09:13:10 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 09:13:10 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 09:13:10 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 09:13:10 user nova-compute[73104]:   </cpu>
Aug 26 09:13:10 user nova-compute[73104]:   <devices>
Aug 26 09:13:10 user nova-compute[73104]:     <disk type="block" device="disk">
Aug 26 09:13:10 user nova-compute[73104]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:13:10 user nova-compute[73104]:       <source dev="/dev/sdd"/>
Aug 26 09:13:10 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 09:13:10 user nova-compute[73104]:       <serial>cde2f987-c9a9-45c3-80c2-6a4fbeede22d</serial>
Aug 26 09:13:10 user nova-compute[73104]:     </disk>
Aug 26 09:13:10 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 09:13:10 user nova-compute[73104]:       <mac address="fa:16:3e:81:e4:85"/>
Aug 26 09:13:10 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:13:10 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 09:13:10 user nova-compute[73104]:       <target dev="tapd7920842-61"/>
Aug 26 09:13:10 user nova-compute[73104]:     </interface>
Aug 26 09:13:10 user nova-compute[73104]:     <serial type="pty">
Aug 26 09:13:10 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/8612ce65-8d6a-4bfc-86fd-be6094c61c35/console.log" append="off"/>
Aug 26 09:13:10 user nova-compute[73104]:     </serial>
Aug 26 09:13:10 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 09:13:10 user nova-compute[73104]:     <video>
Aug 26 09:13:10 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:13:10 user nova-compute[73104]:     </video>
Aug 26 09:13:10 user nova-compute[73104]:     <rng model="virtio">
Aug 26 09:13:10 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 09:13:10 user nova-compute[73104]:     </rng>
Aug 26 09:13:10 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 09:13:10 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 09:13:10 user nova-compute[73104]:       <stats period="10"/>
Aug 26 09:13:10 user nova-compute[73104]:     </memballoon>
Aug 26 09:13:10 user nova-compute[73104]:   </devices>
Aug 26 09:13:10 user nova-compute[73104]: </domain>
Aug 26 09:13:10 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 09:13:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:12:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1312322311',display_name='tempest-TestVolumeBootPattern-server-1312322311',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1312322311',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8fRBTEgWDKx34ZjNEBgV61oHsmnLZZP+YeQ0nSInYs/RyTZwfSiKB8KZ1aFHYupg5U+DrtEMSfZK0uHXz1ZYj79NAVQuNGFL8QjT4HEH9i5HLhublR/vgOebjTekyxMQ==',key_name='tempest-TestVolumeBootPattern-447823700',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52518aa77344432385cfc2b73c63aebe',ramdisk_id='',reservation_id='r-nzxsamir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1466837638',owner_user_name='tempest-TestVolumeBootPattern-1466837638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:12:58Z,user_data=None,user_id='bae03c9c8a9a40b2af6bd1fefb3561d0',uuid=8612ce65-8d6a-4bfc-86fd-be6094c61c35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7920842-6125-4174-b78b-ba0cca099169", "address": "fa:16:3e:81:e4:85", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7920842-61", "ovs_interfaceid": "d7920842-6125-4174-b78b-ba0cca099169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 09:13:10 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converting VIF {"id": "d7920842-6125-4174-b78b-ba0cca099169", "address": "fa:16:3e:81:e4:85", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7920842-61", "ovs_interfaceid": "d7920842-6125-4174-b78b-ba0cca099169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:13:10 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:e4:85,bridge_name='br-int',has_traffic_filtering=True,id=d7920842-6125-4174-b78b-ba0cca099169,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7920842-61') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:13:10 user nova-compute[73104]: DEBUG os_vif [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:e4:85,bridge_name='br-int',has_traffic_filtering=True,id=d7920842-6125-4174-b78b-ba0cca099169,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7920842-61') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 09:13:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:13:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 09:13:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7920842-61, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:13:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd7920842-61, col_values=(('external_ids', {'iface-id': 'd7920842-6125-4174-b78b-ba0cca099169', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:e4:85', 'vm-uuid': '8612ce65-8d6a-4bfc-86fd-be6094c61c35'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:13:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:13:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:10 user nova-compute[73104]: INFO os_vif [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:e4:85,bridge_name='br-int',has_traffic_filtering=True,id=d7920842-6125-4174-b78b-ba0cca099169,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7920842-61')
Aug 26 09:13:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:13:10 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] No VIF found with MAC fa:16:3e:81:e4:85, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 09:13:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:12 user nova-compute[73104]: DEBUG nova.compute.manager [req-d288a94f-6b51-4e11-9aaf-17477a275205 req-7b696566-0ee1-4406-8daf-2f7e5d98d5cb service nova] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Received event network-vif-plugged-d7920842-6125-4174-b78b-ba0cca099169 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:13:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d288a94f-6b51-4e11-9aaf-17477a275205 req-7b696566-0ee1-4406-8daf-2f7e5d98d5cb service nova] Acquiring lock "8612ce65-8d6a-4bfc-86fd-be6094c61c35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:13:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d288a94f-6b51-4e11-9aaf-17477a275205 req-7b696566-0ee1-4406-8daf-2f7e5d98d5cb service nova] Lock "8612ce65-8d6a-4bfc-86fd-be6094c61c35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:13:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d288a94f-6b51-4e11-9aaf-17477a275205 req-7b696566-0ee1-4406-8daf-2f7e5d98d5cb service nova] Lock "8612ce65-8d6a-4bfc-86fd-be6094c61c35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:13:12 user nova-compute[73104]: DEBUG nova.compute.manager [req-d288a94f-6b51-4e11-9aaf-17477a275205 req-7b696566-0ee1-4406-8daf-2f7e5d98d5cb service nova] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] No waiting events found dispatching network-vif-plugged-d7920842-6125-4174-b78b-ba0cca099169 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:13:12 user nova-compute[73104]: WARNING nova.compute.manager [req-d288a94f-6b51-4e11-9aaf-17477a275205 req-7b696566-0ee1-4406-8daf-2f7e5d98d5cb service nova] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Received unexpected event network-vif-plugged-d7920842-6125-4174-b78b-ba0cca099169 for instance with vm_state building and task_state spawning.
Aug 26 09:13:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:14 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693041194.3814185, 8612ce65-8d6a-4bfc-86fd-be6094c61c35 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:13:14 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] VM Resumed (Lifecycle Event)
Aug 26 09:13:14 user nova-compute[73104]: DEBUG nova.compute.manager [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 09:13:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 09:13:14 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Instance spawned successfully.
Aug 26 09:13:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 09:13:14 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:13:14 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:13:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:13:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:13:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:13:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:13:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:13:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:13:14 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 09:13:14 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693041194.386562, 8612ce65-8d6a-4bfc-86fd-be6094c61c35 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:13:14 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] VM Started (Lifecycle Event)
Aug 26 09:13:14 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:13:14 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:13:14 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 09:13:14 user nova-compute[73104]: INFO nova.compute.manager [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Took 5.20 seconds to spawn the instance on the hypervisor.
Aug 26 09:13:14 user nova-compute[73104]: DEBUG nova.compute.manager [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:13:14 user nova-compute[73104]: DEBUG nova.compute.manager [req-db08fb18-3631-40c2-a77e-61b6cfd0ab36 req-c84849fd-2492-453e-ae1f-a0756c8d8a21 service nova] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Received event network-vif-plugged-d7920842-6125-4174-b78b-ba0cca099169 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:13:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-db08fb18-3631-40c2-a77e-61b6cfd0ab36 req-c84849fd-2492-453e-ae1f-a0756c8d8a21 service nova] Acquiring lock "8612ce65-8d6a-4bfc-86fd-be6094c61c35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:13:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-db08fb18-3631-40c2-a77e-61b6cfd0ab36 req-c84849fd-2492-453e-ae1f-a0756c8d8a21 service nova] Lock "8612ce65-8d6a-4bfc-86fd-be6094c61c35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:13:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-db08fb18-3631-40c2-a77e-61b6cfd0ab36 req-c84849fd-2492-453e-ae1f-a0756c8d8a21 service nova] Lock "8612ce65-8d6a-4bfc-86fd-be6094c61c35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:13:14 user nova-compute[73104]: DEBUG nova.compute.manager [req-db08fb18-3631-40c2-a77e-61b6cfd0ab36 req-c84849fd-2492-453e-ae1f-a0756c8d8a21 service nova] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] No waiting events found dispatching network-vif-plugged-d7920842-6125-4174-b78b-ba0cca099169 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:13:14 user nova-compute[73104]: WARNING nova.compute.manager [req-db08fb18-3631-40c2-a77e-61b6cfd0ab36 req-c84849fd-2492-453e-ae1f-a0756c8d8a21 service nova] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Received unexpected event network-vif-plugged-d7920842-6125-4174-b78b-ba0cca099169 for instance with vm_state building and task_state spawning.
Aug 26 09:13:14 user nova-compute[73104]: INFO nova.compute.manager [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Took 17.06 seconds to build instance.
Aug 26 09:13:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-65baffe4-e68a-46d0-9a64-b1c671175480 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "8612ce65-8d6a-4bfc-86fd-be6094c61c35" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.153s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:13:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 09:13:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DzYosgSl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:13:14 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:13:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:13:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:13:14 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:13:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:13:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:13:14 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 09:13:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f3786f-e0fe-4ab1-81a5-43f382580a43]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:13:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 09:13:14 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:13:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[602728cf-e86e-43f7-8bbf-4859df304d90]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:13:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99] added
Aug 26 09:13:14 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:13:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6660221f-1c4e-47d5-a90a-a07688353433]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06bcf5d-aaa6-4b90-92c7-31ef0ebd29e8]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DzYosgSl {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DzYosgSl" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a88aed-16f2-49a3-b2f0-652a346be12f]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DzYosgSl'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[30412434-bb0c-4b3d-a955-1714639d7bb6]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e315b4e-004c-4027-86f7-555472e61d77]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)
Aug 26 09:13:15 user nova-compute[73104]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 (non-flash)
Aug 26 09:13:15 user nova-compute[73104]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d (non-flash)
Aug 26 09:13:15 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)
Aug 26 09:13:15 user nova-compute[73104]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 (non-flash)
Aug 26 09:13:15 user nova-compute[73104]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d (non-flash)
Aug 26 09:13:15 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5893f8a0-1764-4b68-976e-8c7c50fcca7a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99, portal: 172.16.0.220,3260]
Aug 26 09:13:15 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99, portal: 172.16.0.220,3260] successful.
Aug 26 09:13:15 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7be91a-c332-4aca-af4a-5c96f6ee758e]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b374b830-898b-430d-8a2c-eb074a5c3edf]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)
Aug 26 09:13:15 user nova-compute[73104]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 (non-flash)
Aug 26 09:13:15 user nova-compute[73104]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d (non-flash)
Aug 26 09:13:15 user nova-compute[73104]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 (non-flash)
Aug 26 09:13:15 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)
Aug 26 09:13:15 user nova-compute[73104]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 (non-flash)
Aug 26 09:13:15 user nova-compute[73104]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d (non-flash)
Aug 26 09:13:15 user nova-compute[73104]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 (non-flash)
Aug 26 09:13:15 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] HCTL ('36', '-', '-', 0) found on session 56 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb41f395-06c0-43a8-a5d2-56016871df14]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Searching for a device in session 56 and hctl ['36', '*', '*', 0] yield: None {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 09:13:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:16 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:13:16 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73104) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 09:13:16 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Searching for a device in session 56 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 09:13:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DzYosgSl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 09:13:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:13:16 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23239663461363137', 'path': '/dev/sde'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:13:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239663461363137', 'path': '/dev/sde'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 09:13:16 user nova-compute[73104]: DEBUG nova.objects.instance [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lazy-loading 'flavor' on Instance uuid 91a80cff-7890-4379-812d-93a1312e89ce {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:13:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 09:13:16 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:13:16 user nova-compute[73104]:   <source dev="/dev/sde"/>
Aug 26 09:13:16 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:13:16 user nova-compute[73104]:   <serial>314792be-7d74-4b09-b296-1a880cc72d99</serial>
Aug 26 09:13:16 user nova-compute[73104]: </disk>
Aug 26 09:13:16 user nova-compute[73104]:  {{(pid=73104) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 09:13:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:13:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:13:16 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] No VIF found with MAC fa:16:3e:09:9c:0d, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 09:13:16 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-0d129285-7a8c-4441-9997-8b4a2ec000f0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "91a80cff-7890-4379-812d-93a1312e89ce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.186s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:13:17 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:13:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:13:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:13:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:13:17 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:13:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 09:13:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 09:13:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:18 user nova-compute[73104]: INFO nova.compute.manager [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Rescuing
Aug 26 09:13:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "refresh_cache-91a80cff-7890-4379-812d-93a1312e89ce" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:13:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquired lock "refresh_cache-91a80cff-7890-4379-812d-93a1312e89ce" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:13:18 user nova-compute[73104]: DEBUG nova.network.neutron [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 09:13:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:18 user nova-compute[73104]: DEBUG nova.network.neutron [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Updating instance_info_cache with network_info: [{"id": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "address": "fa:16:3e:09:9c:0d", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4b382b-e0", "ovs_interfaceid": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:13:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Releasing lock "refresh_cache-91a80cff-7890-4379-812d-93a1312e89ce" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:13:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 09:13:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:19 user nova-compute[73104]: DEBUG nova.compute.manager [req-8dd64917-a629-4083-b110-9772d3ab3a2c req-be6f5b6c-3726-4cb1-b937-90d4dd753e66 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received event network-vif-unplugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:13:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-8dd64917-a629-4083-b110-9772d3ab3a2c req-be6f5b6c-3726-4cb1-b937-90d4dd753e66 service nova] Acquiring lock "91a80cff-7890-4379-812d-93a1312e89ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:13:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-8dd64917-a629-4083-b110-9772d3ab3a2c req-be6f5b6c-3726-4cb1-b937-90d4dd753e66 service nova] Lock "91a80cff-7890-4379-812d-93a1312e89ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:13:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-8dd64917-a629-4083-b110-9772d3ab3a2c req-be6f5b6c-3726-4cb1-b937-90d4dd753e66 service nova] Lock "91a80cff-7890-4379-812d-93a1312e89ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:13:19 user nova-compute[73104]: DEBUG nova.compute.manager [req-8dd64917-a629-4083-b110-9772d3ab3a2c req-be6f5b6c-3726-4cb1-b937-90d4dd753e66 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] No waiting events found dispatching network-vif-unplugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:13:19 user nova-compute[73104]: WARNING nova.compute.manager [req-8dd64917-a629-4083-b110-9772d3ab3a2c req-be6f5b6c-3726-4cb1-b937-90d4dd753e66 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received unexpected event network-vif-unplugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 for instance with vm_state active and task_state rescuing.
Aug 26 09:13:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2802b2cd-793d-4ed1-9863-c059cb3c098f/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2802b2cd-793d-4ed1-9863-c059cb3c098f/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2802b2cd-793d-4ed1-9863-c059cb3c098f/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2802b2cd-793d-4ed1-9863-c059cb3c098f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 09:13:19 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Instance destroyed successfully.
Aug 26 09:13:19 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Attempting rescue
Aug 26 09:13:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73104) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 09:13:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Instance directory exists: not creating {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 09:13:19 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Creating image(s)
Aug 26 09:13:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "/opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:13:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "/opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:13:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "/opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.023s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:13:19 user nova-compute[73104]: DEBUG nova.objects.instance [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lazy-loading 'trusted_certs' on Instance uuid 91a80cff-7890-4379-812d-93a1312e89ce {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:13:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:20 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:13:20 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=7975MB free_disk=24.042301177978516GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.184s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk.rescue {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk.rescue" returned: 0 in 0.050s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.objects.instance [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lazy-loading 'migration_context' on Instance uuid 91a80cff-7890-4379-812d-93a1312e89ce {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 432a66be-853d-42d7-8622-0417ef36045c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance d473909b-b527-455c-9048-22e6616b6fb3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 91a80cff-7890-4379-812d-93a1312e89ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 1e477d95-6072-4149-bb55-e30613e2cfaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 2802b2cd-793d-4ed1-9863-c059cb3c098f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 8612ce65-8d6a-4bfc-86fd-be6094c61c35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.objects.base [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Object Instance<91a80cff-7890-4379-812d-93a1312e89ce> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Start _get_guest_xml network_info=[{"id": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "address": "fa:16:3e:09:9c:0d", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "vif_mac": "fa:16:3e:09:9c:0d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4b382b-e0", "ovs_interfaceid": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.objects.instance [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lazy-loading 'resources' on Instance uuid 91a80cff-7890-4379-812d-93a1312e89ce {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.objects.base [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Object Instance<91a80cff-7890-4379-812d-93a1312e89ce> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.objects.instance [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lazy-loading 'numa_topology' on Instance uuid 91a80cff-7890-4379-812d-93a1312e89ce {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Refreshing inventories for resource provider 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.objects.base [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Object Instance<91a80cff-7890-4379-812d-93a1312e89ce> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 09:13:20 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:13:20 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.objects.instance [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lazy-loading 'vcpu_model' on Instance uuid 91a80cff-7890-4379-812d-93a1312e89ce {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Updating ProviderTree inventory for provider 8a2a2397-4d47-4524-8146-84db4225a812 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Updating inventory in ProviderTree for provider 8a2a2397-4d47-4524-8146-84db4225a812 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.objects.base [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Object Instance<91a80cff-7890-4379-812d-93a1312e89ce> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:11:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-610449647',display_name='tempest-ServerRescueNegativeTestJSON-server-610449647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-610449647',id=49,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZ21PFmAeWEv6gMElqhwF4yV9CGe2trYvz4xOHn+iIp4VodL+fOa8EV0yQ0NIqBqCjZgTOL7NE/HAkaYxxZbDjGcWBiUMQ44esb2PVkSUUIhbIlJKiiChZq8vE/UjbNuw==',key_name='tempest-keypair-189958290',keypairs=<?>,launch_index=0,launched_at=2023-08-26T09:11:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b7642d165474defadde34dabc11f842',ramdisk_id='',reservation_id='r-j9qm35ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-901062798',owner_user_name='tempest-ServerRescueNegativeTestJSON-901062798-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:11:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da4b6574d165418eaf2b8c8b84d6151f',uuid=91a80cff-7890-4379-812d-93a1312e89ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "address": "fa:16:3e:09:9c:0d", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "vif_mac": "fa:16:3e:09:9c:0d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4b382b-e0", "ovs_interfaceid": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Converting VIF {"id": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "address": "fa:16:3e:09:9c:0d", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "vif_mac": "fa:16:3e:09:9c:0d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4b382b-e0", "ovs_interfaceid": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:9c:0d,bridge_name='br-int',has_traffic_filtering=True,id=bd4b382b-e0fc-4d71-a554-0985a3ecdc92,network=Network(fb2d19ab-1c79-4529-b058-e1b8c4fc8276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd4b382b-e0') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.objects.instance [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lazy-loading 'pci_devices' on Instance uuid 91a80cff-7890-4379-812d-93a1312e89ce {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Refreshing aggregate associations for resource provider 8a2a2397-4d47-4524-8146-84db4225a812, aggregates: None {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.objects.base [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Object Instance<91a80cff-7890-4379-812d-93a1312e89ce> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73104) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] End _get_guest_xml xml=<domain type="kvm">
Aug 26 09:13:20 user nova-compute[73104]:   <uuid>91a80cff-7890-4379-812d-93a1312e89ce</uuid>
Aug 26 09:13:20 user nova-compute[73104]:   <name>instance-00000031</name>
Aug 26 09:13:20 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 09:13:20 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 09:13:20 user nova-compute[73104]:   <metadata>
Aug 26 09:13:20 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 09:13:20 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 09:13:20 user nova-compute[73104]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-610449647</nova:name>
Aug 26 09:13:20 user nova-compute[73104]:       <nova:creationTime>2023-08-26 09:13:20</nova:creationTime>
Aug 26 09:13:20 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 09:13:20 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 09:13:20 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 09:13:20 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 09:13:20 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 09:13:20 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 09:13:20 user nova-compute[73104]:       </nova:flavor>
Aug 26 09:13:20 user nova-compute[73104]:       <nova:owner>
Aug 26 09:13:20 user nova-compute[73104]:         <nova:user uuid="da4b6574d165418eaf2b8c8b84d6151f">tempest-ServerRescueNegativeTestJSON-901062798-project-member</nova:user>
Aug 26 09:13:20 user nova-compute[73104]:         <nova:project uuid="0b7642d165474defadde34dabc11f842">tempest-ServerRescueNegativeTestJSON-901062798</nova:project>
Aug 26 09:13:20 user nova-compute[73104]:       </nova:owner>
Aug 26 09:13:20 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 09:13:20 user nova-compute[73104]:       <nova:ports>
Aug 26 09:13:20 user nova-compute[73104]:         <nova:port uuid="bd4b382b-e0fc-4d71-a554-0985a3ecdc92">
Aug 26 09:13:20 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 09:13:20 user nova-compute[73104]:         </nova:port>
Aug 26 09:13:20 user nova-compute[73104]:       </nova:ports>
Aug 26 09:13:20 user nova-compute[73104]:     </nova:instance>
Aug 26 09:13:20 user nova-compute[73104]:   </metadata>
Aug 26 09:13:20 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 09:13:20 user nova-compute[73104]:     <system>
Aug 26 09:13:20 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 09:13:20 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 09:13:20 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 09:13:20 user nova-compute[73104]:       <entry name="serial">91a80cff-7890-4379-812d-93a1312e89ce</entry>
Aug 26 09:13:20 user nova-compute[73104]:       <entry name="uuid">91a80cff-7890-4379-812d-93a1312e89ce</entry>
Aug 26 09:13:20 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 09:13:20 user nova-compute[73104]:     </system>
Aug 26 09:13:20 user nova-compute[73104]:   </sysinfo>
Aug 26 09:13:20 user nova-compute[73104]:   <os>
Aug 26 09:13:20 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 09:13:20 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 09:13:20 user nova-compute[73104]:   </os>
Aug 26 09:13:20 user nova-compute[73104]:   <features>
Aug 26 09:13:20 user nova-compute[73104]:     <acpi/>
Aug 26 09:13:20 user nova-compute[73104]:     <apic/>
Aug 26 09:13:20 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 09:13:20 user nova-compute[73104]:   </features>
Aug 26 09:13:20 user nova-compute[73104]:   <clock offset="utc">
Aug 26 09:13:20 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 09:13:20 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 09:13:20 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 09:13:20 user nova-compute[73104]:   </clock>
Aug 26 09:13:20 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 09:13:20 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 09:13:20 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 09:13:20 user nova-compute[73104]:   </cpu>
Aug 26 09:13:20 user nova-compute[73104]:   <devices>
Aug 26 09:13:20 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 09:13:20 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 09:13:20 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk.rescue"/>
Aug 26 09:13:20 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 09:13:20 user nova-compute[73104]:     </disk>
Aug 26 09:13:20 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 09:13:20 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 09:13:20 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk"/>
Aug 26 09:13:20 user nova-compute[73104]:       <target dev="vdb" bus="virtio"/>
Aug 26 09:13:20 user nova-compute[73104]:     </disk>
Aug 26 09:13:20 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 09:13:20 user nova-compute[73104]:       <mac address="fa:16:3e:09:9c:0d"/>
Aug 26 09:13:20 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:13:20 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 09:13:20 user nova-compute[73104]:       <target dev="tapbd4b382b-e0"/>
Aug 26 09:13:20 user nova-compute[73104]:     </interface>
Aug 26 09:13:20 user nova-compute[73104]:     <serial type="pty">
Aug 26 09:13:20 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/console.log" append="off"/>
Aug 26 09:13:20 user nova-compute[73104]:     </serial>
Aug 26 09:13:20 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 09:13:20 user nova-compute[73104]:     <video>
Aug 26 09:13:20 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:13:20 user nova-compute[73104]:     </video>
Aug 26 09:13:20 user nova-compute[73104]:     <rng model="virtio">
Aug 26 09:13:20 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 09:13:20 user nova-compute[73104]:     </rng>
Aug 26 09:13:20 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 09:13:20 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 09:13:20 user nova-compute[73104]:       <stats period="10"/>
Aug 26 09:13:20 user nova-compute[73104]:     </memballoon>
Aug 26 09:13:20 user nova-compute[73104]:   </devices>
Aug 26 09:13:20 user nova-compute[73104]: </domain>
Aug 26 09:13:20 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 09:13:20 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Instance destroyed successfully.
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Refreshing trait associations for resource provider 8a2a2397-4d47-4524-8146-84db4225a812, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] No VIF found with MAC fa:16:3e:09:9c:0d, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.607s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:13:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:21 user nova-compute[73104]: DEBUG nova.compute.manager [req-b013c590-6c83-4f34-9439-5e9eefb28806 req-61d34fe0-3a9e-4dc3-8cd7-bda01b1064d0 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received event network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:13:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b013c590-6c83-4f34-9439-5e9eefb28806 req-61d34fe0-3a9e-4dc3-8cd7-bda01b1064d0 service nova] Acquiring lock "91a80cff-7890-4379-812d-93a1312e89ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:13:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b013c590-6c83-4f34-9439-5e9eefb28806 req-61d34fe0-3a9e-4dc3-8cd7-bda01b1064d0 service nova] Lock "91a80cff-7890-4379-812d-93a1312e89ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:13:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b013c590-6c83-4f34-9439-5e9eefb28806 req-61d34fe0-3a9e-4dc3-8cd7-bda01b1064d0 service nova] Lock "91a80cff-7890-4379-812d-93a1312e89ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:13:21 user nova-compute[73104]: DEBUG nova.compute.manager [req-b013c590-6c83-4f34-9439-5e9eefb28806 req-61d34fe0-3a9e-4dc3-8cd7-bda01b1064d0 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] No waiting events found dispatching network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:13:21 user nova-compute[73104]: WARNING nova.compute.manager [req-b013c590-6c83-4f34-9439-5e9eefb28806 req-61d34fe0-3a9e-4dc3-8cd7-bda01b1064d0 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received unexpected event network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 for instance with vm_state active and task_state rescuing.
Aug 26 09:13:21 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:13:21 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:13:21 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Didn't find any instances for network info cache update. {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 09:13:21 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:13:21 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:13:21 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:13:21 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:13:21 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:13:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-e046df6d-71cd-4199-862e-6ed67203cf29 req-ec032019-7efc-4c68-b414-aa11aa4ad260 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received event network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:13:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e046df6d-71cd-4199-862e-6ed67203cf29 req-ec032019-7efc-4c68-b414-aa11aa4ad260 service nova] Acquiring lock "91a80cff-7890-4379-812d-93a1312e89ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:13:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e046df6d-71cd-4199-862e-6ed67203cf29 req-ec032019-7efc-4c68-b414-aa11aa4ad260 service nova] Lock "91a80cff-7890-4379-812d-93a1312e89ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:13:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e046df6d-71cd-4199-862e-6ed67203cf29 req-ec032019-7efc-4c68-b414-aa11aa4ad260 service nova] Lock "91a80cff-7890-4379-812d-93a1312e89ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:13:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-e046df6d-71cd-4199-862e-6ed67203cf29 req-ec032019-7efc-4c68-b414-aa11aa4ad260 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] No waiting events found dispatching network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:13:23 user nova-compute[73104]: WARNING nova.compute.manager [req-e046df6d-71cd-4199-862e-6ed67203cf29 req-ec032019-7efc-4c68-b414-aa11aa4ad260 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received unexpected event network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 for instance with vm_state active and task_state rescuing.
Aug 26 09:13:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-e046df6d-71cd-4199-862e-6ed67203cf29 req-ec032019-7efc-4c68-b414-aa11aa4ad260 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received event network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:13:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e046df6d-71cd-4199-862e-6ed67203cf29 req-ec032019-7efc-4c68-b414-aa11aa4ad260 service nova] Acquiring lock "91a80cff-7890-4379-812d-93a1312e89ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:13:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e046df6d-71cd-4199-862e-6ed67203cf29 req-ec032019-7efc-4c68-b414-aa11aa4ad260 service nova] Lock "91a80cff-7890-4379-812d-93a1312e89ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:13:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e046df6d-71cd-4199-862e-6ed67203cf29 req-ec032019-7efc-4c68-b414-aa11aa4ad260 service nova] Lock "91a80cff-7890-4379-812d-93a1312e89ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:13:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-e046df6d-71cd-4199-862e-6ed67203cf29 req-ec032019-7efc-4c68-b414-aa11aa4ad260 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] No waiting events found dispatching network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:13:23 user nova-compute[73104]: WARNING nova.compute.manager [req-e046df6d-71cd-4199-862e-6ed67203cf29 req-ec032019-7efc-4c68-b414-aa11aa4ad260 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received unexpected event network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 for instance with vm_state active and task_state rescuing.
Aug 26 09:13:23 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:13:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Removed pending event for 91a80cff-7890-4379-812d-93a1312e89ce due to event {{(pid=73104) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 09:13:23 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693041203.8963914, 91a80cff-7890-4379-812d-93a1312e89ce => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:13:23 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] VM Resumed (Lifecycle Event)
Aug 26 09:13:23 user nova-compute[73104]: DEBUG nova.compute.manager [None req-92b8deeb-6f32-4ac2-a55e-29f359b0406e tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:13:23 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:13:23 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:13:23 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 09:13:23 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693041203.8991265, 91a80cff-7890-4379-812d-93a1312e89ce => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:13:23 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] VM Started (Lifecycle Event)
Aug 26 09:13:23 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:13:23 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:13:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:25 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:27 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:13:28 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:13:28 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Triggering sync for uuid 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 {{(pid=73104) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 09:13:28 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Triggering sync for uuid 432a66be-853d-42d7-8622-0417ef36045c {{(pid=73104) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 09:13:28 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Triggering sync for uuid 1e477d95-6072-4149-bb55-e30613e2cfaa {{(pid=73104) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 09:13:28 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Triggering sync for uuid d473909b-b527-455c-9048-22e6616b6fb3 {{(pid=73104) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 09:13:28 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Triggering sync for uuid 91a80cff-7890-4379-812d-93a1312e89ce {{(pid=73104) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 09:13:28 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Triggering sync for uuid 2802b2cd-793d-4ed1-9863-c059cb3c098f {{(pid=73104) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 09:13:28 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Triggering sync for uuid 8612ce65-8d6a-4bfc-86fd-be6094c61c35 {{(pid=73104) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 09:13:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:13:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:13:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "432a66be-853d-42d7-8622-0417ef36045c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:13:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "432a66be-853d-42d7-8622-0417ef36045c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:13:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "1e477d95-6072-4149-bb55-e30613e2cfaa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:13:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "1e477d95-6072-4149-bb55-e30613e2cfaa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:13:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "d473909b-b527-455c-9048-22e6616b6fb3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:13:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "d473909b-b527-455c-9048-22e6616b6fb3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:13:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "91a80cff-7890-4379-812d-93a1312e89ce" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:13:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "91a80cff-7890-4379-812d-93a1312e89ce" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:13:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "2802b2cd-793d-4ed1-9863-c059cb3c098f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:13:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "2802b2cd-793d-4ed1-9863-c059cb3c098f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:13:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "8612ce65-8d6a-4bfc-86fd-be6094c61c35" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:13:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "8612ce65-8d6a-4bfc-86fd-be6094c61c35" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:13:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "432a66be-853d-42d7-8622-0417ef36045c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:13:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "1e477d95-6072-4149-bb55-e30613e2cfaa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:13:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:13:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "91a80cff-7890-4379-812d-93a1312e89ce" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:13:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "2802b2cd-793d-4ed1-9863-c059cb3c098f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:13:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "d473909b-b527-455c-9048-22e6616b6fb3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:13:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "8612ce65-8d6a-4bfc-86fd-be6094c61c35" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:13:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:31 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:13:31 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Cleaning up deleted instances {{(pid=73104) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 09:13:31 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] There are 0 instances to clean {{(pid=73104) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 09:13:33 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:13:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:35 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:50 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:13:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:14:00 user nova-compute[73104]: DEBUG nova.compute.manager [req-e128679f-ff5b-4d6b-956f-b966d60edf73 req-d6f2bb6a-7f99-4cd4-b6c1-77364d044bfb service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Received event network-changed-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:14:00 user nova-compute[73104]: DEBUG nova.compute.manager [req-e128679f-ff5b-4d6b-956f-b966d60edf73 req-d6f2bb6a-7f99-4cd4-b6c1-77364d044bfb service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Refreshing instance network info cache due to event network-changed-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:14:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e128679f-ff5b-4d6b-956f-b966d60edf73 req-d6f2bb6a-7f99-4cd4-b6c1-77364d044bfb service nova] Acquiring lock "refresh_cache-1e477d95-6072-4149-bb55-e30613e2cfaa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:14:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e128679f-ff5b-4d6b-956f-b966d60edf73 req-d6f2bb6a-7f99-4cd4-b6c1-77364d044bfb service nova] Acquired lock "refresh_cache-1e477d95-6072-4149-bb55-e30613e2cfaa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:14:00 user nova-compute[73104]: DEBUG nova.network.neutron [req-e128679f-ff5b-4d6b-956f-b966d60edf73 req-d6f2bb6a-7f99-4cd4-b6c1-77364d044bfb service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Refreshing network info cache for port ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:14:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Acquiring lock "1e477d95-6072-4149-bb55-e30613e2cfaa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:14:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lock "1e477d95-6072-4149-bb55-e30613e2cfaa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:14:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Acquiring lock "1e477d95-6072-4149-bb55-e30613e2cfaa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:14:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lock "1e477d95-6072-4149-bb55-e30613e2cfaa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:14:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lock "1e477d95-6072-4149-bb55-e30613e2cfaa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:14:00 user nova-compute[73104]: INFO nova.compute.manager [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Terminating instance
Aug 26 09:14:00 user nova-compute[73104]: DEBUG nova.compute.manager [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 09:14:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:14:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:14:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:14:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:14:00 user nova-compute[73104]: DEBUG nova.compute.manager [req-d2f290a6-7bd8-4908-ad06-8ad66865d634 req-07db8e0a-b6ad-430f-9f63-828c712acb1c service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Received event network-vif-unplugged-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:14:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d2f290a6-7bd8-4908-ad06-8ad66865d634 req-07db8e0a-b6ad-430f-9f63-828c712acb1c service nova] Acquiring lock "1e477d95-6072-4149-bb55-e30613e2cfaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:14:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d2f290a6-7bd8-4908-ad06-8ad66865d634 req-07db8e0a-b6ad-430f-9f63-828c712acb1c service nova] Lock "1e477d95-6072-4149-bb55-e30613e2cfaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:14:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d2f290a6-7bd8-4908-ad06-8ad66865d634 req-07db8e0a-b6ad-430f-9f63-828c712acb1c service nova] Lock "1e477d95-6072-4149-bb55-e30613e2cfaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:14:00 user nova-compute[73104]: DEBUG nova.compute.manager [req-d2f290a6-7bd8-4908-ad06-8ad66865d634 req-07db8e0a-b6ad-430f-9f63-828c712acb1c service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] No waiting events found dispatching network-vif-unplugged-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:14:00 user nova-compute[73104]: DEBUG nova.compute.manager [req-d2f290a6-7bd8-4908-ad06-8ad66865d634 req-07db8e0a-b6ad-430f-9f63-828c712acb1c service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Received event network-vif-unplugged-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 09:14:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:14:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:14:00 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Instance destroyed successfully.
Aug 26 09:14:00 user nova-compute[73104]: DEBUG nova.objects.instance [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lazy-loading 'resources' on Instance uuid 1e477d95-6072-4149-bb55-e30613e2cfaa {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:14:00 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T09:08:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-369140230',display_name='tempest-TestShelveInstance-server-369140230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-369140230',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDL7QTVnRtxNNYu9s2jtgBpLVjlOS2jaIWAbBzgzv2PeJEK37B8XddLYXxBBROkBAOa0C5F538LWNNpM9vdG2lZJ55HwWgj9Yfv0WIYEw7cY6X2u0zcjZsuXKaY+7d5XA==',key_name='tempest-TestShelveInstance-1332627145',keypairs=<?>,launch_index=0,launched_at=2023-08-26T09:12:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bfc641323fbc4076a21019951c4edb8e',ramdisk_id='',reservation_id='r-bkrqzvvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-488591318',owner_user_name='tempest-TestShelveInstance-488591318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T09:12:26Z,user_data=None,user_id='10d0765b06cb4292bc08833c16abd334',uuid=1e477d95-6072-4149-bb55-e30613e2cfaa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "address": "fa:16:3e:10:11:1e", "network": {"id": "429edb63-d3bb-475a-8384-ec36138e73d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-495261383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc641323fbc4076a21019951c4edb8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee23340e-9a", "ovs_interfaceid": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 09:14:00 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Converting VIF {"id": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "address": "fa:16:3e:10:11:1e", "network": {"id": "429edb63-d3bb-475a-8384-ec36138e73d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-495261383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc641323fbc4076a21019951c4edb8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee23340e-9a", "ovs_interfaceid": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:14:00 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:11:1e,bridge_name='br-int',has_traffic_filtering=True,id=ee23340e-9aaf-4a0b-b212-0be8ff5c25d7,network=Network(429edb63-d3bb-475a-8384-ec36138e73d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee23340e-9a') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:14:00 user nova-compute[73104]: DEBUG os_vif [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:11:1e,bridge_name='br-int',has_traffic_filtering=True,id=ee23340e-9aaf-4a0b-b212-0be8ff5c25d7,network=Network(429edb63-d3bb-475a-8384-ec36138e73d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee23340e-9a') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 09:14:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:14:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee23340e-9a, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:14:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:14:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:14:00 user nova-compute[73104]: INFO os_vif [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:11:1e,bridge_name='br-int',has_traffic_filtering=True,id=ee23340e-9aaf-4a0b-b212-0be8ff5c25d7,network=Network(429edb63-d3bb-475a-8384-ec36138e73d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee23340e-9a')
Aug 26 09:14:00 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 09:14:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTWXmYIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:14:00 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:14:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:14:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:14:00 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 09:14:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d12e04c-ac00-491a-95d7-f7ce113db05e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[758a9491-3ae4-4313-9d97-ce612f707e9a]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)
Aug 26 09:14:01 user nova-compute[73104]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 (non-flash)
Aug 26 09:14:01 user nova-compute[73104]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d (non-flash)
Aug 26 09:14:01 user nova-compute[73104]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 (non-flash)
Aug 26 09:14:01 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)
Aug 26 09:14:01 user nova-compute[73104]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 (non-flash)
Aug 26 09:14:01 user nova-compute[73104]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d (non-flash)
Aug 26 09:14:01 user nova-compute[73104]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 (non-flash)
Aug 26 09:14:01 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0c4187be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133'): ({'sdc'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Removing single pathed devices sdc {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG nova.network.neutron [req-e128679f-ff5b-4d6b-956f-b966d60edf73 req-d6f2bb6a-7f99-4cd4-b6c1-77364d044bfb service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Updated VIF entry in instance network info cache for port ee23340e-9aaf-4a0b-b212-0be8ff5c25d7. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG nova.network.neutron [req-e128679f-ff5b-4d6b-956f-b966d60edf73 req-d6f2bb6a-7f99-4cd4-b6c1-77364d044bfb service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Updating instance_info_cache with network_info: [{"id": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "address": "fa:16:3e:10:11:1e", "network": {"id": "429edb63-d3bb-475a-8384-ec36138e73d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-495261383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc641323fbc4076a21019951c4edb8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee23340e-9a", "ovs_interfaceid": "ee23340e-9aaf-4a0b-b212-0be8ff5c25d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1f2e98-e1c5-4245-931a-dacdf6d040ff]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e128679f-ff5b-4d6b-956f-b966d60edf73 req-d6f2bb6a-7f99-4cd4-b6c1-77364d044bfb service nova] Releasing lock "refresh_cache-1e477d95-6072-4149-bb55-e30613e2cfaa" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b201e7-9b1d-44b0-a7db-d33d7d426df8]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Flushing IO for device /dev/sdc {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a23e04-770e-44f9-bd4e-e54661707708]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dd5843-a364-4d00-a8c0-dac8b20dfb90]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] SCSI volumes sdc have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_166ebc02', '/dev/disk/by-id/scsi-1SCST_BIO166ebc02-3c02293490b027c9', '/dev/disk/by-id/scsi-23363303232393334') {{(pid=84263) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcf8388-f29a-4c03-b36b-65099151ed51]: (4, None) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[254fe989-ffe5-47fb-b7f0-e1c58bf6124c]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[48049e47-7d9d-467e-b9b6-0af9257abf80]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133, portal: 172.16.0.220,3260]
Aug 26 09:14:01 user nova-compute[73104]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133, portal: 172.16.0.220,3260] successful.
Aug 26 09:14:01 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d3f62d-a2b6-4867-afb0-275ea8604133 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc714f1-8e8d-4e00-a730-811231d087ef]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] <== disconnect_volume: return (322ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 09:14:01 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Deleting instance files /opt/stack/data/nova/instances/1e477d95-6072-4149-bb55-e30613e2cfaa_del
Aug 26 09:14:01 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Deletion of /opt/stack/data/nova/instances/1e477d95-6072-4149-bb55-e30613e2cfaa_del complete
Aug 26 09:14:01 user nova-compute[73104]: INFO nova.compute.manager [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 26 09:14:01 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 09:14:01 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:14:01 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Took 0.57 seconds to deallocate network for instance.
Aug 26 09:14:02 user nova-compute[73104]: DEBUG nova.compute.manager [req-aa76768e-69e5-4d41-8e1d-eff8624ad340 req-85d96e2d-7df9-4c36-ab5c-1db6a16c088a service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Received event network-vif-deleted-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:14:02 user nova-compute[73104]: DEBUG nova.compute.manager [req-3706cd5a-b7bf-402b-a477-01ec2eb50f74 req-0a60d836-4758-45c7-b3ff-fd0b2e8145e7 service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Received event network-vif-plugged-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:14:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3706cd5a-b7bf-402b-a477-01ec2eb50f74 req-0a60d836-4758-45c7-b3ff-fd0b2e8145e7 service nova] Acquiring lock "1e477d95-6072-4149-bb55-e30613e2cfaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:14:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3706cd5a-b7bf-402b-a477-01ec2eb50f74 req-0a60d836-4758-45c7-b3ff-fd0b2e8145e7 service nova] Lock "1e477d95-6072-4149-bb55-e30613e2cfaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:14:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3706cd5a-b7bf-402b-a477-01ec2eb50f74 req-0a60d836-4758-45c7-b3ff-fd0b2e8145e7 service nova] Lock "1e477d95-6072-4149-bb55-e30613e2cfaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:14:02 user nova-compute[73104]: DEBUG nova.compute.manager [req-3706cd5a-b7bf-402b-a477-01ec2eb50f74 req-0a60d836-4758-45c7-b3ff-fd0b2e8145e7 service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] No waiting events found dispatching network-vif-plugged-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:14:02 user nova-compute[73104]: WARNING nova.compute.manager [req-3706cd5a-b7bf-402b-a477-01ec2eb50f74 req-0a60d836-4758-45c7-b3ff-fd0b2e8145e7 service nova] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Received unexpected event network-vif-plugged-ee23340e-9aaf-4a0b-b212-0be8ff5c25d7 for instance with vm_state active and task_state deleting.
Aug 26 09:14:02 user nova-compute[73104]: INFO nova.compute.manager [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Took 0.77 seconds to detach 1 volumes for instance.
Aug 26 09:14:02 user nova-compute[73104]: DEBUG nova.compute.manager [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Deleting volume: 96d3f62d-a2b6-4867-afb0-275ea8604133 {{(pid=73104) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 09:14:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:14:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:14:03 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:14:03 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:14:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:14:03 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Deleted allocations for instance 1e477d95-6072-4149-bb55-e30613e2cfaa
Aug 26 09:14:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-5edd9e20-7bb9-4039-a12d-1d2960f16a26 tempest-TestShelveInstance-488591318 tempest-TestShelveInstance-488591318-project-member] Lock "1e477d95-6072-4149-bb55-e30613e2cfaa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.067s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:14:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:14:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:14:15 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:14:15 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:14:15 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693041240.935098, 1e477d95-6072-4149-bb55-e30613e2cfaa => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:14:15 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] VM Stopped (Lifecycle Event)
Aug 26 09:14:15 user nova-compute[73104]: DEBUG nova.compute.manager [None req-3fb23437-82b7-44e5-86b9-75e4246a2d48 None None] [instance: 1e477d95-6072-4149-bb55-e30613e2cfaa] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:14:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:14:17 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:14:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:14:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:14:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:14:17 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:14:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 09:14:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:14:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:14:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:14:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:14:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 09:14:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:14:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:14:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:14:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:14:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:14:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:14:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:14:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:14:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:14:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:14:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:14:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:14:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2802b2cd-793d-4ed1-9863-c059cb3c098f/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:14:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2802b2cd-793d-4ed1-9863-c059cb3c098f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:14:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2802b2cd-793d-4ed1-9863-c059cb3c098f/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:14:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2802b2cd-793d-4ed1-9863-c059cb3c098f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:14:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 09:14:19 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:14:19 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:14:19 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8079MB free_disk=24.04010772705078GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:14:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:14:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:14:19 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:14:19 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 432a66be-853d-42d7-8622-0417ef36045c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:14:19 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance d473909b-b527-455c-9048-22e6616b6fb3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:14:19 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 91a80cff-7890-4379-812d-93a1312e89ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:14:19 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 2802b2cd-793d-4ed1-9863-c059cb3c098f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:14:19 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 8612ce65-8d6a-4bfc-86fd-be6094c61c35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:14:19 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:14:19 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:14:19 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:14:19 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:14:19 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:14:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.315s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:14:20 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:14:20 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:14:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:14:21 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:14:21 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b648611b-99fd-4da6-8618-e51ebbe68f9d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Acquiring lock "2802b2cd-793d-4ed1-9863-c059cb3c098f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b648611b-99fd-4da6-8618-e51ebbe68f9d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lock "2802b2cd-793d-4ed1-9863-c059cb3c098f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b648611b-99fd-4da6-8618-e51ebbe68f9d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Acquiring lock "2802b2cd-793d-4ed1-9863-c059cb3c098f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b648611b-99fd-4da6-8618-e51ebbe68f9d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lock "2802b2cd-793d-4ed1-9863-c059cb3c098f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b648611b-99fd-4da6-8618-e51ebbe68f9d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lock "2802b2cd-793d-4ed1-9863-c059cb3c098f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:14:23 user nova-compute[73104]: INFO nova.compute.manager [None req-b648611b-99fd-4da6-8618-e51ebbe68f9d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Terminating instance
Aug 26 09:14:23 user nova-compute[73104]: DEBUG nova.compute.manager [None req-b648611b-99fd-4da6-8618-e51ebbe68f9d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Rebuilding the list of instances to heal {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Skipping network cache update for instance because it is being deleted. {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-c49d23a6-186e-496c-af4a-b54c9cdb1d74 req-699f09c8-258f-4149-9788-c8cba82063bb service nova] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Received event network-vif-unplugged-9fffc936-fe3c-4fb0-8979-c908a32f5784 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c49d23a6-186e-496c-af4a-b54c9cdb1d74 req-699f09c8-258f-4149-9788-c8cba82063bb service nova] Acquiring lock "2802b2cd-793d-4ed1-9863-c059cb3c098f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c49d23a6-186e-496c-af4a-b54c9cdb1d74 req-699f09c8-258f-4149-9788-c8cba82063bb service nova] Lock "2802b2cd-793d-4ed1-9863-c059cb3c098f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-c49d23a6-186e-496c-af4a-b54c9cdb1d74 req-699f09c8-258f-4149-9788-c8cba82063bb service nova] Lock "2802b2cd-793d-4ed1-9863-c059cb3c098f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-c49d23a6-186e-496c-af4a-b54c9cdb1d74 req-699f09c8-258f-4149-9788-c8cba82063bb service nova] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] No waiting events found dispatching network-vif-unplugged-9fffc936-fe3c-4fb0-8979-c908a32f5784 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG nova.compute.manager [req-c49d23a6-186e-496c-af4a-b54c9cdb1d74 req-699f09c8-258f-4149-9788-c8cba82063bb service nova] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Received event network-vif-unplugged-9fffc936-fe3c-4fb0-8979-c908a32f5784 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-2c10f0ac-f63d-462d-a999-aa98eb6d91f2" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-2c10f0ac-f63d-462d-a999-aa98eb6d91f2" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG nova.objects.instance [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lazy-loading 'info_cache' on Instance uuid 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Updating instance_info_cache with network_info: [{"id": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "address": "fa:16:3e:f0:cc:d7", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e91d018-83", "ovs_interfaceid": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-2c10f0ac-f63d-462d-a999-aa98eb6d91f2" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:14:23 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Instance destroyed successfully.
Aug 26 09:14:23 user nova-compute[73104]: DEBUG nova.objects.instance [None req-b648611b-99fd-4da6-8618-e51ebbe68f9d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lazy-loading 'resources' on Instance uuid 2802b2cd-793d-4ed1-9863-c059cb3c098f {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-b648611b-99fd-4da6-8618-e51ebbe68f9d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:12:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-817337037',display_name='tempest-VolumesActionsTest-instance-817337037',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-817337037',id=50,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T09:12:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc656fac68304c889f4cf1998dd28b83',ramdisk_id='',reservation_id='r-bajlzi20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-23958363',owner_user_name='tempest-VolumesActionsTest-23958363-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T09:12:39Z,user_data=None,user_id='13393bcc881a4c35864d1c9ee251c9de',uuid=2802b2cd-793d-4ed1-9863-c059cb3c098f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9fffc936-fe3c-4fb0-8979-c908a32f5784", "address": "fa:16:3e:88:b5:30", "network": {"id": "407926d8-ed1c-4bcb-9c52-b3f1494996ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-46889385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc656fac68304c889f4cf1998dd28b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fffc936-fe", "ovs_interfaceid": "9fffc936-fe3c-4fb0-8979-c908a32f5784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-b648611b-99fd-4da6-8618-e51ebbe68f9d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Converting VIF {"id": "9fffc936-fe3c-4fb0-8979-c908a32f5784", "address": "fa:16:3e:88:b5:30", "network": {"id": "407926d8-ed1c-4bcb-9c52-b3f1494996ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-46889385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc656fac68304c889f4cf1998dd28b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fffc936-fe", "ovs_interfaceid": "9fffc936-fe3c-4fb0-8979-c908a32f5784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-b648611b-99fd-4da6-8618-e51ebbe68f9d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:b5:30,bridge_name='br-int',has_traffic_filtering=True,id=9fffc936-fe3c-4fb0-8979-c908a32f5784,network=Network(407926d8-ed1c-4bcb-9c52-b3f1494996ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fffc936-fe') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG os_vif [None req-b648611b-99fd-4da6-8618-e51ebbe68f9d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:b5:30,bridge_name='br-int',has_traffic_filtering=True,id=9fffc936-fe3c-4fb0-8979-c908a32f5784,network=Network(407926d8-ed1c-4bcb-9c52-b3f1494996ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fffc936-fe') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9fffc936-fe, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:14:23 user nova-compute[73104]: INFO os_vif [None req-b648611b-99fd-4da6-8618-e51ebbe68f9d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:b5:30,bridge_name='br-int',has_traffic_filtering=True,id=9fffc936-fe3c-4fb0-8979-c908a32f5784,network=Network(407926d8-ed1c-4bcb-9c52-b3f1494996ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fffc936-fe')
Aug 26 09:14:23 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-b648611b-99fd-4da6-8618-e51ebbe68f9d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Deleting instance files /opt/stack/data/nova/instances/2802b2cd-793d-4ed1-9863-c059cb3c098f_del
Aug 26 09:14:23 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-b648611b-99fd-4da6-8618-e51ebbe68f9d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Deletion of /opt/stack/data/nova/instances/2802b2cd-793d-4ed1-9863-c059cb3c098f_del complete
Aug 26 09:14:23 user nova-compute[73104]: INFO nova.compute.manager [None req-b648611b-99fd-4da6-8618-e51ebbe68f9d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Took 0.83 seconds to destroy the instance on the hypervisor.
Aug 26 09:14:23 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-b648611b-99fd-4da6-8618-e51ebbe68f9d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 09:14:23 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 09:14:24 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:14:24 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Took 0.43 seconds to deallocate network for instance.
Aug 26 09:14:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b648611b-99fd-4da6-8618-e51ebbe68f9d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:14:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b648611b-99fd-4da6-8618-e51ebbe68f9d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:14:24 user nova-compute[73104]: DEBUG nova.compute.manager [req-c9ec22cf-25ee-4cf6-bbea-41af7278e6a1 req-dcfacb70-3c31-42ef-bc9d-5e1d0ed61bc9 service nova] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Received event network-vif-deleted-9fffc936-fe3c-4fb0-8979-c908a32f5784 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:14:24 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-b648611b-99fd-4da6-8618-e51ebbe68f9d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:14:24 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-b648611b-99fd-4da6-8618-e51ebbe68f9d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:14:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b648611b-99fd-4da6-8618-e51ebbe68f9d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.227s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:14:24 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-b648611b-99fd-4da6-8618-e51ebbe68f9d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Deleted allocations for instance 2802b2cd-793d-4ed1-9863-c059cb3c098f
Aug 26 09:14:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b648611b-99fd-4da6-8618-e51ebbe68f9d tempest-VolumesActionsTest-23958363 tempest-VolumesActionsTest-23958363-project-member] Lock "2802b2cd-793d-4ed1-9863-c059cb3c098f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.675s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:14:25 user nova-compute[73104]: DEBUG nova.compute.manager [req-f4657025-e56c-41d0-8a46-318fefefc896 req-e109da2e-db68-4b14-9f69-b0b78fce1923 service nova] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Received event network-vif-plugged-9fffc936-fe3c-4fb0-8979-c908a32f5784 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:14:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f4657025-e56c-41d0-8a46-318fefefc896 req-e109da2e-db68-4b14-9f69-b0b78fce1923 service nova] Acquiring lock "2802b2cd-793d-4ed1-9863-c059cb3c098f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:14:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f4657025-e56c-41d0-8a46-318fefefc896 req-e109da2e-db68-4b14-9f69-b0b78fce1923 service nova] Lock "2802b2cd-793d-4ed1-9863-c059cb3c098f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:14:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f4657025-e56c-41d0-8a46-318fefefc896 req-e109da2e-db68-4b14-9f69-b0b78fce1923 service nova] Lock "2802b2cd-793d-4ed1-9863-c059cb3c098f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:14:25 user nova-compute[73104]: DEBUG nova.compute.manager [req-f4657025-e56c-41d0-8a46-318fefefc896 req-e109da2e-db68-4b14-9f69-b0b78fce1923 service nova] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] No waiting events found dispatching network-vif-plugged-9fffc936-fe3c-4fb0-8979-c908a32f5784 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:14:25 user nova-compute[73104]: WARNING nova.compute.manager [req-f4657025-e56c-41d0-8a46-318fefefc896 req-e109da2e-db68-4b14-9f69-b0b78fce1923 service nova] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Received unexpected event network-vif-plugged-9fffc936-fe3c-4fb0-8979-c908a32f5784 for instance with vm_state deleted and task_state None.
Aug 26 09:14:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:14:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:14:38 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693041263.8406525, 2802b2cd-793d-4ed1-9863-c059cb3c098f => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:14:38 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] VM Stopped (Lifecycle Event)
Aug 26 09:14:38 user nova-compute[73104]: DEBUG nova.compute.manager [None req-c4f76316-f8d7-4384-9f89-4799fb22e49f None None] [instance: 2802b2cd-793d-4ed1-9863-c059cb3c098f] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:14:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:14:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:14:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:14:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-036ae2b2-89f0-4054-bf16-1da5d273ab9c req-530d2b2a-dad1-4b42-a83e-3f40fab443b3 service nova] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Received event network-changed-d7920842-6125-4174-b78b-ba0cca099169 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:14:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-036ae2b2-89f0-4054-bf16-1da5d273ab9c req-530d2b2a-dad1-4b42-a83e-3f40fab443b3 service nova] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Refreshing instance network info cache due to event network-changed-d7920842-6125-4174-b78b-ba0cca099169. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:14:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-036ae2b2-89f0-4054-bf16-1da5d273ab9c req-530d2b2a-dad1-4b42-a83e-3f40fab443b3 service nova] Acquiring lock "refresh_cache-8612ce65-8d6a-4bfc-86fd-be6094c61c35" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:14:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-036ae2b2-89f0-4054-bf16-1da5d273ab9c req-530d2b2a-dad1-4b42-a83e-3f40fab443b3 service nova] Acquired lock "refresh_cache-8612ce65-8d6a-4bfc-86fd-be6094c61c35" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:14:49 user nova-compute[73104]: DEBUG nova.network.neutron [req-036ae2b2-89f0-4054-bf16-1da5d273ab9c req-530d2b2a-dad1-4b42-a83e-3f40fab443b3 service nova] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Refreshing network info cache for port d7920842-6125-4174-b78b-ba0cca099169 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:14:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:14:49 user nova-compute[73104]: DEBUG nova.network.neutron [req-036ae2b2-89f0-4054-bf16-1da5d273ab9c req-530d2b2a-dad1-4b42-a83e-3f40fab443b3 service nova] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Updated VIF entry in instance network info cache for port d7920842-6125-4174-b78b-ba0cca099169. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:14:49 user nova-compute[73104]: DEBUG nova.network.neutron [req-036ae2b2-89f0-4054-bf16-1da5d273ab9c req-530d2b2a-dad1-4b42-a83e-3f40fab443b3 service nova] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Updating instance_info_cache with network_info: [{"id": "d7920842-6125-4174-b78b-ba0cca099169", "address": "fa:16:3e:81:e4:85", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7920842-61", "ovs_interfaceid": "d7920842-6125-4174-b78b-ba0cca099169", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:14:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-036ae2b2-89f0-4054-bf16-1da5d273ab9c req-530d2b2a-dad1-4b42-a83e-3f40fab443b3 service nova] Releasing lock "refresh_cache-8612ce65-8d6a-4bfc-86fd-be6094c61c35" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:14:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "8612ce65-8d6a-4bfc-86fd-be6094c61c35" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:14:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "8612ce65-8d6a-4bfc-86fd-be6094c61c35" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:14:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "8612ce65-8d6a-4bfc-86fd-be6094c61c35-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:14:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "8612ce65-8d6a-4bfc-86fd-be6094c61c35-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:14:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "8612ce65-8d6a-4bfc-86fd-be6094c61c35-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:14:50 user nova-compute[73104]: INFO nova.compute.manager [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Terminating instance
Aug 26 09:14:50 user nova-compute[73104]: DEBUG nova.compute.manager [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 09:14:50 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:14:50 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:14:50 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:14:50 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:14:50 user nova-compute[73104]: DEBUG nova.compute.manager [req-7f552d2f-e792-4ded-b7e9-8681af5cb420 req-d330a8b0-5339-4816-bee6-01916bd1fd8b service nova] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Received event network-vif-unplugged-d7920842-6125-4174-b78b-ba0cca099169 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:14:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-7f552d2f-e792-4ded-b7e9-8681af5cb420 req-d330a8b0-5339-4816-bee6-01916bd1fd8b service nova] Acquiring lock "8612ce65-8d6a-4bfc-86fd-be6094c61c35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:14:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-7f552d2f-e792-4ded-b7e9-8681af5cb420 req-d330a8b0-5339-4816-bee6-01916bd1fd8b service nova] Lock "8612ce65-8d6a-4bfc-86fd-be6094c61c35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:14:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-7f552d2f-e792-4ded-b7e9-8681af5cb420 req-d330a8b0-5339-4816-bee6-01916bd1fd8b service nova] Lock "8612ce65-8d6a-4bfc-86fd-be6094c61c35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:14:50 user nova-compute[73104]: DEBUG nova.compute.manager [req-7f552d2f-e792-4ded-b7e9-8681af5cb420 req-d330a8b0-5339-4816-bee6-01916bd1fd8b service nova] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] No waiting events found dispatching network-vif-unplugged-d7920842-6125-4174-b78b-ba0cca099169 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:14:50 user nova-compute[73104]: DEBUG nova.compute.manager [req-7f552d2f-e792-4ded-b7e9-8681af5cb420 req-d330a8b0-5339-4816-bee6-01916bd1fd8b service nova] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Received event network-vif-unplugged-d7920842-6125-4174-b78b-ba0cca099169 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 09:14:51 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Instance destroyed successfully.
Aug 26 09:14:51 user nova-compute[73104]: DEBUG nova.objects.instance [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lazy-loading 'resources' on Instance uuid 8612ce65-8d6a-4bfc-86fd-be6094c61c35 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:12:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1312322311',display_name='tempest-TestVolumeBootPattern-server-1312322311',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1312322311',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8fRBTEgWDKx34ZjNEBgV61oHsmnLZZP+YeQ0nSInYs/RyTZwfSiKB8KZ1aFHYupg5U+DrtEMSfZK0uHXz1ZYj79NAVQuNGFL8QjT4HEH9i5HLhublR/vgOebjTekyxMQ==',key_name='tempest-TestVolumeBootPattern-447823700',keypairs=<?>,launch_index=0,launched_at=2023-08-26T09:13:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52518aa77344432385cfc2b73c63aebe',ramdisk_id='',reservation_id='r-nzxsamir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1466837638',owner_user_name='tempest-TestVolumeBootPattern-1466837638-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T09:13:15Z,user_data=None,user_id='bae03c9c8a9a40b2af6bd1fefb3561d0',uuid=8612ce65-8d6a-4bfc-86fd-be6094c61c35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7920842-6125-4174-b78b-ba0cca099169", "address": "fa:16:3e:81:e4:85", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7920842-61", "ovs_interfaceid": "d7920842-6125-4174-b78b-ba0cca099169", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converting VIF {"id": "d7920842-6125-4174-b78b-ba0cca099169", "address": "fa:16:3e:81:e4:85", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7920842-61", "ovs_interfaceid": "d7920842-6125-4174-b78b-ba0cca099169", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:e4:85,bridge_name='br-int',has_traffic_filtering=True,id=d7920842-6125-4174-b78b-ba0cca099169,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7920842-61') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG os_vif [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:e4:85,bridge_name='br-int',has_traffic_filtering=True,id=d7920842-6125-4174-b78b-ba0cca099169,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7920842-61') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7920842-61, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:14:51 user nova-compute[73104]: INFO os_vif [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:e4:85,bridge_name='br-int',has_traffic_filtering=True,id=d7920842-6125-4174-b78b-ba0cca099169,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7920842-61')
Aug 26 09:14:51 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DcxJsPEr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:14:51 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:14:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc35875-0814-46e3-8659-8f29ebb7dcba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[caac70c1-43b4-4b1a-9a5b-4d46047b4d8d]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)
Aug 26 09:14:51 user nova-compute[73104]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d (non-flash)
Aug 26 09:14:51 user nova-compute[73104]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 (non-flash)
Aug 26 09:14:51 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)
Aug 26 09:14:51 user nova-compute[73104]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d (non-flash)
Aug 26 09:14:51 user nova-compute[73104]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 (non-flash)
Aug 26 09:14:51 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b4738d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d'): ({'sdd'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Removing single pathed devices sdd {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[882cf914-9ff9-4824-9e55-f5d05a58fc0a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7807c67-62c0-4600-a47f-5615ffe3a2b0]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Flushing IO for device /dev/sdd {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8911805-235e-4c8f-ad87-c7bdc384f94c]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a65ba00-6200-401f-ada0-25484f8eb51b]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] SCSI volumes sdd have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9080c7-97a5-4c2b-ad7c-4966cb59853e]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG nova.compute.manager [req-2507ac80-49cb-4824-a609-24023b276fa4 req-7445a663-b59b-4fd2-9a14-ddacd7c1538c service nova] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Received event network-changed-d7920842-6125-4174-b78b-ba0cca099169 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG nova.compute.manager [req-2507ac80-49cb-4824-a609-24023b276fa4 req-7445a663-b59b-4fd2-9a14-ddacd7c1538c service nova] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Refreshing instance network info cache due to event network-changed-d7920842-6125-4174-b78b-ba0cca099169. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2507ac80-49cb-4824-a609-24023b276fa4 req-7445a663-b59b-4fd2-9a14-ddacd7c1538c service nova] Acquiring lock "refresh_cache-8612ce65-8d6a-4bfc-86fd-be6094c61c35" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2507ac80-49cb-4824-a609-24023b276fa4 req-7445a663-b59b-4fd2-9a14-ddacd7c1538c service nova] Acquired lock "refresh_cache-8612ce65-8d6a-4bfc-86fd-be6094c61c35" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG nova.network.neutron [req-2507ac80-49cb-4824-a609-24023b276fa4 req-7445a663-b59b-4fd2-9a14-ddacd7c1538c service nova] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Refreshing network info cache for port d7920842-6125-4174-b78b-ba0cca099169 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d18b067-0b9a-43cf-8980-b65cd0e83691]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d, portal: 172.16.0.220,3260]
Aug 26 09:14:51 user nova-compute[73104]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d, portal: 172.16.0.220,3260] successful.
Aug 26 09:14:51 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cde2f987-c9a9-45c3-80c2-6a4fbeede22d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b8941b-084c-4b87-8864-09658488cfc6]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] <== disconnect_volume: return (327ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 09:14:51 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Deleting instance files /opt/stack/data/nova/instances/8612ce65-8d6a-4bfc-86fd-be6094c61c35_del
Aug 26 09:14:51 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Deletion of /opt/stack/data/nova/instances/8612ce65-8d6a-4bfc-86fd-be6094c61c35_del complete
Aug 26 09:14:51 user nova-compute[73104]: INFO nova.compute.manager [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 26 09:14:51 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG nova.network.neutron [req-2507ac80-49cb-4824-a609-24023b276fa4 req-7445a663-b59b-4fd2-9a14-ddacd7c1538c service nova] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Updated VIF entry in instance network info cache for port d7920842-6125-4174-b78b-ba0cca099169. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG nova.network.neutron [req-2507ac80-49cb-4824-a609-24023b276fa4 req-7445a663-b59b-4fd2-9a14-ddacd7c1538c service nova] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Updating instance_info_cache with network_info: [{"id": "d7920842-6125-4174-b78b-ba0cca099169", "address": "fa:16:3e:81:e4:85", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7920842-61", "ovs_interfaceid": "d7920842-6125-4174-b78b-ba0cca099169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:14:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2507ac80-49cb-4824-a609-24023b276fa4 req-7445a663-b59b-4fd2-9a14-ddacd7c1538c service nova] Releasing lock "refresh_cache-8612ce65-8d6a-4bfc-86fd-be6094c61c35" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:14:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:14:52 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:14:52 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Took 0.70 seconds to deallocate network for instance.
Aug 26 09:14:52 user nova-compute[73104]: DEBUG nova.compute.manager [req-b1bd0ed8-ff45-4cfc-bb7f-d81124020a61 req-e32737ca-9c46-4420-b8e3-d2f6241a2be3 service nova] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Received event network-vif-plugged-d7920842-6125-4174-b78b-ba0cca099169 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:14:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b1bd0ed8-ff45-4cfc-bb7f-d81124020a61 req-e32737ca-9c46-4420-b8e3-d2f6241a2be3 service nova] Acquiring lock "8612ce65-8d6a-4bfc-86fd-be6094c61c35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:14:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b1bd0ed8-ff45-4cfc-bb7f-d81124020a61 req-e32737ca-9c46-4420-b8e3-d2f6241a2be3 service nova] Lock "8612ce65-8d6a-4bfc-86fd-be6094c61c35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:14:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-b1bd0ed8-ff45-4cfc-bb7f-d81124020a61 req-e32737ca-9c46-4420-b8e3-d2f6241a2be3 service nova] Lock "8612ce65-8d6a-4bfc-86fd-be6094c61c35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:14:52 user nova-compute[73104]: DEBUG nova.compute.manager [req-b1bd0ed8-ff45-4cfc-bb7f-d81124020a61 req-e32737ca-9c46-4420-b8e3-d2f6241a2be3 service nova] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] No waiting events found dispatching network-vif-plugged-d7920842-6125-4174-b78b-ba0cca099169 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:14:52 user nova-compute[73104]: WARNING nova.compute.manager [req-b1bd0ed8-ff45-4cfc-bb7f-d81124020a61 req-e32737ca-9c46-4420-b8e3-d2f6241a2be3 service nova] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Received unexpected event network-vif-plugged-d7920842-6125-4174-b78b-ba0cca099169 for instance with vm_state active and task_state deleting.
Aug 26 09:14:53 user nova-compute[73104]: INFO nova.compute.manager [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Took 0.90 seconds to detach 1 volumes for instance.
Aug 26 09:14:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:14:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:14:53 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:14:53 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:14:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.215s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:14:53 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Deleted allocations for instance 8612ce65-8d6a-4bfc-86fd-be6094c61c35
Aug 26 09:14:53 user nova-compute[73104]: DEBUG nova.compute.manager [req-1326d569-e6a7-4e3c-89bb-19bb7a9f4b7c req-27c2d8e6-2dc4-4119-bb81-686c378c717e service nova] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Received event network-vif-deleted-d7920842-6125-4174-b78b-ba0cca099169 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:14:53 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-783191c1-a59f-46d7-83ef-b6940367cf0a tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "8612ce65-8d6a-4bfc-86fd-be6094c61c35" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.196s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:14:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:14:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:14:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:14:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:15:01 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:15:06 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693041291.206314, 8612ce65-8d6a-4bfc-86fd-be6094c61c35 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:15:06 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] VM Stopped (Lifecycle Event)
Aug 26 09:15:06 user nova-compute[73104]: DEBUG nova.compute.manager [None req-3035f662-6ccf-4eed-b0a6-0aa37f45fc88 None None] [instance: 8612ce65-8d6a-4bfc-86fd-be6094c61c35] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:15:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:15:09 user nova-compute[73104]: INFO nova.compute.manager [None req-e69a4b0b-ceb3-43aa-aaad-58a6a38fad74 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Unrescuing
Aug 26 09:15:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e69a4b0b-ceb3-43aa-aaad-58a6a38fad74 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "refresh_cache-91a80cff-7890-4379-812d-93a1312e89ce" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:15:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e69a4b0b-ceb3-43aa-aaad-58a6a38fad74 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquired lock "refresh_cache-91a80cff-7890-4379-812d-93a1312e89ce" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:15:09 user nova-compute[73104]: DEBUG nova.network.neutron [None req-e69a4b0b-ceb3-43aa-aaad-58a6a38fad74 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 09:15:09 user nova-compute[73104]: DEBUG nova.network.neutron [None req-e69a4b0b-ceb3-43aa-aaad-58a6a38fad74 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Updating instance_info_cache with network_info: [{"id": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "address": "fa:16:3e:09:9c:0d", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4b382b-e0", "ovs_interfaceid": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:15:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e69a4b0b-ceb3-43aa-aaad-58a6a38fad74 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Releasing lock "refresh_cache-91a80cff-7890-4379-812d-93a1312e89ce" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:15:09 user nova-compute[73104]: DEBUG nova.objects.instance [None req-e69a4b0b-ceb3-43aa-aaad-58a6a38fad74 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lazy-loading 'flavor' on Instance uuid 91a80cff-7890-4379-812d-93a1312e89ce {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:15:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:15:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:15:10 user nova-compute[73104]: DEBUG nova.compute.manager [req-fffec311-80a9-4d9c-9d36-526c6aa39d65 req-11cb4c8e-0893-4435-9614-a8cc69669162 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received event network-vif-unplugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:15:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-fffec311-80a9-4d9c-9d36-526c6aa39d65 req-11cb4c8e-0893-4435-9614-a8cc69669162 service nova] Acquiring lock "91a80cff-7890-4379-812d-93a1312e89ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:15:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-fffec311-80a9-4d9c-9d36-526c6aa39d65 req-11cb4c8e-0893-4435-9614-a8cc69669162 service nova] Lock "91a80cff-7890-4379-812d-93a1312e89ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:15:10 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-fffec311-80a9-4d9c-9d36-526c6aa39d65 req-11cb4c8e-0893-4435-9614-a8cc69669162 service nova] Lock "91a80cff-7890-4379-812d-93a1312e89ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:15:10 user nova-compute[73104]: DEBUG nova.compute.manager [req-fffec311-80a9-4d9c-9d36-526c6aa39d65 req-11cb4c8e-0893-4435-9614-a8cc69669162 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] No waiting events found dispatching network-vif-unplugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:15:10 user nova-compute[73104]: WARNING nova.compute.manager [req-fffec311-80a9-4d9c-9d36-526c6aa39d65 req-11cb4c8e-0893-4435-9614-a8cc69669162 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received unexpected event network-vif-unplugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 for instance with vm_state rescued and task_state unrescuing.
Aug 26 09:15:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:15:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:15:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:15:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:15:10 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Instance destroyed successfully.
Aug 26 09:15:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:15:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:15:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:15:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:15:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:15:12 user nova-compute[73104]: DEBUG nova.compute.manager [req-31554197-af8a-477f-87a7-433505eaa58a req-d57f0d4c-2b96-4056-aea6-aef1f0db22f4 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received event network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:15:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-31554197-af8a-477f-87a7-433505eaa58a req-d57f0d4c-2b96-4056-aea6-aef1f0db22f4 service nova] Acquiring lock "91a80cff-7890-4379-812d-93a1312e89ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:15:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-31554197-af8a-477f-87a7-433505eaa58a req-d57f0d4c-2b96-4056-aea6-aef1f0db22f4 service nova] Lock "91a80cff-7890-4379-812d-93a1312e89ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:15:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-31554197-af8a-477f-87a7-433505eaa58a req-d57f0d4c-2b96-4056-aea6-aef1f0db22f4 service nova] Lock "91a80cff-7890-4379-812d-93a1312e89ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:15:12 user nova-compute[73104]: DEBUG nova.compute.manager [req-31554197-af8a-477f-87a7-433505eaa58a req-d57f0d4c-2b96-4056-aea6-aef1f0db22f4 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] No waiting events found dispatching network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:15:12 user nova-compute[73104]: WARNING nova.compute.manager [req-31554197-af8a-477f-87a7-433505eaa58a req-d57f0d4c-2b96-4056-aea6-aef1f0db22f4 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received unexpected event network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 for instance with vm_state rescued and task_state unrescuing.
Aug 26 09:15:12 user nova-compute[73104]: DEBUG nova.compute.manager [req-31554197-af8a-477f-87a7-433505eaa58a req-d57f0d4c-2b96-4056-aea6-aef1f0db22f4 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received event network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:15:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-31554197-af8a-477f-87a7-433505eaa58a req-d57f0d4c-2b96-4056-aea6-aef1f0db22f4 service nova] Acquiring lock "91a80cff-7890-4379-812d-93a1312e89ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:15:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-31554197-af8a-477f-87a7-433505eaa58a req-d57f0d4c-2b96-4056-aea6-aef1f0db22f4 service nova] Lock "91a80cff-7890-4379-812d-93a1312e89ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:15:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-31554197-af8a-477f-87a7-433505eaa58a req-d57f0d4c-2b96-4056-aea6-aef1f0db22f4 service nova] Lock "91a80cff-7890-4379-812d-93a1312e89ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:15:12 user nova-compute[73104]: DEBUG nova.compute.manager [req-31554197-af8a-477f-87a7-433505eaa58a req-d57f0d4c-2b96-4056-aea6-aef1f0db22f4 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] No waiting events found dispatching network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:15:12 user nova-compute[73104]: WARNING nova.compute.manager [req-31554197-af8a-477f-87a7-433505eaa58a req-d57f0d4c-2b96-4056-aea6-aef1f0db22f4 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received unexpected event network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 for instance with vm_state rescued and task_state unrescuing.
Aug 26 09:15:12 user nova-compute[73104]: DEBUG nova.compute.manager [req-31554197-af8a-477f-87a7-433505eaa58a req-d57f0d4c-2b96-4056-aea6-aef1f0db22f4 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received event network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:15:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-31554197-af8a-477f-87a7-433505eaa58a req-d57f0d4c-2b96-4056-aea6-aef1f0db22f4 service nova] Acquiring lock "91a80cff-7890-4379-812d-93a1312e89ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:15:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-31554197-af8a-477f-87a7-433505eaa58a req-d57f0d4c-2b96-4056-aea6-aef1f0db22f4 service nova] Lock "91a80cff-7890-4379-812d-93a1312e89ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:15:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-31554197-af8a-477f-87a7-433505eaa58a req-d57f0d4c-2b96-4056-aea6-aef1f0db22f4 service nova] Lock "91a80cff-7890-4379-812d-93a1312e89ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:15:12 user nova-compute[73104]: DEBUG nova.compute.manager [req-31554197-af8a-477f-87a7-433505eaa58a req-d57f0d4c-2b96-4056-aea6-aef1f0db22f4 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] No waiting events found dispatching network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:15:12 user nova-compute[73104]: WARNING nova.compute.manager [req-31554197-af8a-477f-87a7-433505eaa58a req-d57f0d4c-2b96-4056-aea6-aef1f0db22f4 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received unexpected event network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 for instance with vm_state rescued and task_state unrescuing.
Aug 26 09:15:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Removed pending event for 91a80cff-7890-4379-812d-93a1312e89ce due to event {{(pid=73104) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 09:15:13 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693041313.7165706, 91a80cff-7890-4379-812d-93a1312e89ce => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:15:13 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] VM Resumed (Lifecycle Event)
Aug 26 09:15:13 user nova-compute[73104]: DEBUG nova.compute.manager [None req-e69a4b0b-ceb3-43aa-aaad-58a6a38fad74 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:15:13 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:15:13 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:15:13 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 09:15:13 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693041313.7185977, 91a80cff-7890-4379-812d-93a1312e89ce => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:15:13 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] VM Started (Lifecycle Event)
Aug 26 09:15:13 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:15:13 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:15:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:15:16 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:15:17 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:15:17 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:15:18 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:15:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:15:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:15:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:15:18 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:15:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:15:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:15:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:15:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:15:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 09:15:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:15:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:15:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:15:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:15:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:15:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:15:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:15:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:15:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:15:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:15:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:15:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:15:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 09:15:20 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:15:20 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:15:20 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8432MB free_disk=24.06583023071289GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:15:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:15:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:15:20 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:15:20 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 432a66be-853d-42d7-8622-0417ef36045c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:15:20 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance d473909b-b527-455c-9048-22e6616b6fb3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:15:20 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 91a80cff-7890-4379-812d-93a1312e89ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:15:20 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:15:20 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:15:20 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:15:20 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:15:20 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:15:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.386s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:15:21 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:15:21 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:15:21 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:15:21 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:15:23 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:15:23 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:15:23 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:15:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-432a66be-853d-42d7-8622-0417ef36045c" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:15:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-432a66be-853d-42d7-8622-0417ef36045c" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:15:23 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 09:15:24 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Updating instance_info_cache with network_info: [{"id": "52b25498-8470-454f-9cf5-4989ec64751a", "address": "fa:16:3e:76:d4:93", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b25498-84", "ovs_interfaceid": "52b25498-8470-454f-9cf5-4989ec64751a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:15:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-432a66be-853d-42d7-8622-0417ef36045c" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:15:24 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 09:15:24 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:15:25 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:15:26 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:15:28 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:15:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:15:31 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:15:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:15:36 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:15:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:15:41 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:15:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:15:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:15:51 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:15:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:15:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-83f700e3-2d4e-4157-8fa6-8a2b0e1edaa7 req-7a2c6480-6284-41ef-a297-6a759e2a426e service nova] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Received event network-changed-2ed07331-5c24-4b78-9d63-b0aa7186af4a {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:15:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-83f700e3-2d4e-4157-8fa6-8a2b0e1edaa7 req-7a2c6480-6284-41ef-a297-6a759e2a426e service nova] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Refreshing instance network info cache due to event network-changed-2ed07331-5c24-4b78-9d63-b0aa7186af4a. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:15:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-83f700e3-2d4e-4157-8fa6-8a2b0e1edaa7 req-7a2c6480-6284-41ef-a297-6a759e2a426e service nova] Acquiring lock "refresh_cache-d473909b-b527-455c-9048-22e6616b6fb3" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:15:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-83f700e3-2d4e-4157-8fa6-8a2b0e1edaa7 req-7a2c6480-6284-41ef-a297-6a759e2a426e service nova] Acquired lock "refresh_cache-d473909b-b527-455c-9048-22e6616b6fb3" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:15:54 user nova-compute[73104]: DEBUG nova.network.neutron [req-83f700e3-2d4e-4157-8fa6-8a2b0e1edaa7 req-7a2c6480-6284-41ef-a297-6a759e2a426e service nova] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Refreshing network info cache for port 2ed07331-5c24-4b78-9d63-b0aa7186af4a {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:15:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "d473909b-b527-455c-9048-22e6616b6fb3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:15:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "d473909b-b527-455c-9048-22e6616b6fb3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:15:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "d473909b-b527-455c-9048-22e6616b6fb3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:15:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "d473909b-b527-455c-9048-22e6616b6fb3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:15:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "d473909b-b527-455c-9048-22e6616b6fb3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:15:54 user nova-compute[73104]: INFO nova.compute.manager [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Terminating instance
Aug 26 09:15:54 user nova-compute[73104]: DEBUG nova.compute.manager [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 09:15:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:15:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:15:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:15:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG nova.network.neutron [req-83f700e3-2d4e-4157-8fa6-8a2b0e1edaa7 req-7a2c6480-6284-41ef-a297-6a759e2a426e service nova] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Updated VIF entry in instance network info cache for port 2ed07331-5c24-4b78-9d63-b0aa7186af4a. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG nova.network.neutron [req-83f700e3-2d4e-4157-8fa6-8a2b0e1edaa7 req-7a2c6480-6284-41ef-a297-6a759e2a426e service nova] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Updating instance_info_cache with network_info: [{"id": "2ed07331-5c24-4b78-9d63-b0aa7186af4a", "address": "fa:16:3e:b2:42:0e", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed07331-5c", "ovs_interfaceid": "2ed07331-5c24-4b78-9d63-b0aa7186af4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG nova.compute.manager [req-7a7eb907-08bd-4ab7-9484-51e4bfc65ef5 req-953dd9b1-7699-400b-ab66-f2c3450188ef service nova] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Received event network-vif-unplugged-2ed07331-5c24-4b78-9d63-b0aa7186af4a {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-7a7eb907-08bd-4ab7-9484-51e4bfc65ef5 req-953dd9b1-7699-400b-ab66-f2c3450188ef service nova] Acquiring lock "d473909b-b527-455c-9048-22e6616b6fb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-7a7eb907-08bd-4ab7-9484-51e4bfc65ef5 req-953dd9b1-7699-400b-ab66-f2c3450188ef service nova] Lock "d473909b-b527-455c-9048-22e6616b6fb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-7a7eb907-08bd-4ab7-9484-51e4bfc65ef5 req-953dd9b1-7699-400b-ab66-f2c3450188ef service nova] Lock "d473909b-b527-455c-9048-22e6616b6fb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG nova.compute.manager [req-7a7eb907-08bd-4ab7-9484-51e4bfc65ef5 req-953dd9b1-7699-400b-ab66-f2c3450188ef service nova] [instance: d473909b-b527-455c-9048-22e6616b6fb3] No waiting events found dispatching network-vif-unplugged-2ed07331-5c24-4b78-9d63-b0aa7186af4a {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG nova.compute.manager [req-7a7eb907-08bd-4ab7-9484-51e4bfc65ef5 req-953dd9b1-7699-400b-ab66-f2c3450188ef service nova] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Received event network-vif-unplugged-2ed07331-5c24-4b78-9d63-b0aa7186af4a for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-83f700e3-2d4e-4157-8fa6-8a2b0e1edaa7 req-7a2c6480-6284-41ef-a297-6a759e2a426e service nova] Releasing lock "refresh_cache-d473909b-b527-455c-9048-22e6616b6fb3" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:15:55 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Instance destroyed successfully.
Aug 26 09:15:55 user nova-compute[73104]: DEBUG nova.objects.instance [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lazy-loading 'resources' on Instance uuid d473909b-b527-455c-9048-22e6616b6fb3 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:10:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-327636569',display_name='tempest-TestVolumeBootPattern-server-327636569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-327636569',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8fRBTEgWDKx34ZjNEBgV61oHsmnLZZP+YeQ0nSInYs/RyTZwfSiKB8KZ1aFHYupg5U+DrtEMSfZK0uHXz1ZYj79NAVQuNGFL8QjT4HEH9i5HLhublR/vgOebjTekyxMQ==',key_name='tempest-TestVolumeBootPattern-447823700',keypairs=<?>,launch_index=0,launched_at=2023-08-26T09:11:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52518aa77344432385cfc2b73c63aebe',ramdisk_id='',reservation_id='r-l01z614v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1466837638',owner_user_name='tempest-TestVolumeBootPattern-1466837638-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T09:11:07Z,user_data=None,user_id='bae03c9c8a9a40b2af6bd1fefb3561d0',uuid=d473909b-b527-455c-9048-22e6616b6fb3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ed07331-5c24-4b78-9d63-b0aa7186af4a", "address": "fa:16:3e:b2:42:0e", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed07331-5c", "ovs_interfaceid": "2ed07331-5c24-4b78-9d63-b0aa7186af4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converting VIF {"id": "2ed07331-5c24-4b78-9d63-b0aa7186af4a", "address": "fa:16:3e:b2:42:0e", "network": {"id": "25c1a750-b426-4248-83d3-f52b3f09b7f0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1955559195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52518aa77344432385cfc2b73c63aebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed07331-5c", "ovs_interfaceid": "2ed07331-5c24-4b78-9d63-b0aa7186af4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:42:0e,bridge_name='br-int',has_traffic_filtering=True,id=2ed07331-5c24-4b78-9d63-b0aa7186af4a,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ed07331-5c') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG os_vif [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:42:0e,bridge_name='br-int',has_traffic_filtering=True,id=2ed07331-5c24-4b78-9d63-b0aa7186af4a,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ed07331-5c') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ed07331-5c, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:15:55 user nova-compute[73104]: INFO os_vif [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:42:0e,bridge_name='br-int',has_traffic_filtering=True,id=2ed07331-5c24-4b78-9d63-b0aa7186af4a,network=Network(25c1a750-b426-4248-83d3-f52b3f09b7f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ed07331-5c')
Aug 26 09:15:55 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BAMdDLex', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:15:55 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:15:55 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[772ebbf1-fca4-4203-a2a2-1c1655fd1bb7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[454536a9-db41-493a-a927-db34dc75f652]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)
Aug 26 09:15:55 user nova-compute[73104]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 (non-flash)
Aug 26 09:15:55 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 (non-flash)
Aug 26 09:15:55 user nova-compute[73104]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 (non-flash)
Aug 26 09:15:55 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b47381f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492'): ({'sdb'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Removing single pathed devices sdb {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10ee949-66fc-41fe-a299-f714d195df64]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b019fe2-3266-4722-b3bf-8635e503a583]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Flushing IO for device /dev/sdb {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd787f79-e0a0-4b59-93ee-093734797f9e]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0195a4bf-3b8e-435a-a82b-be1cc408f5a2]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOb2c7a564-52a6ef28322791ba', '/dev/disk/by-id/scsi-23532613665663238', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b2c7a564') {{(pid=84263) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2ea5b3-250b-428f-b0d5-402a23d626a0]: (4, None) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[255adceb-6721-41d6-a93a-8680cf5068e8]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[652b0b19-ea59-4ef2-8951-fe081cc7c922]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492, portal: 172.16.0.220,3260]
Aug 26 09:15:55 user nova-compute[73104]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492, portal: 172.16.0.220,3260] successful.
Aug 26 09:15:55 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ed6a6d9-5eae-4452-991b-59497b0bb492 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[aade5395-36bd-471c-a04d-048cb73d58d0]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] <== disconnect_volume: return (310ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 09:15:55 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Deleting instance files /opt/stack/data/nova/instances/d473909b-b527-455c-9048-22e6616b6fb3_del
Aug 26 09:15:55 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Deletion of /opt/stack/data/nova/instances/d473909b-b527-455c-9048-22e6616b6fb3_del complete
Aug 26 09:15:55 user nova-compute[73104]: INFO nova.compute.manager [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 26 09:15:55 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 09:15:55 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: d473909b-b527-455c-9048-22e6616b6fb3] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 09:15:56 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:15:56 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Took 0.56 seconds to deallocate network for instance.
Aug 26 09:15:56 user nova-compute[73104]: DEBUG nova.compute.manager [req-b022e2e2-87ce-4ba1-a5f2-476622443acc req-20437833-aa25-4568-8d47-038604ba71a9 service nova] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Received event network-vif-deleted-2ed07331-5c24-4b78-9d63-b0aa7186af4a {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:15:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:15:57 user nova-compute[73104]: DEBUG nova.compute.manager [req-0eb1339a-8c5d-4fc9-8bda-bfad8197476f req-35757e46-39ba-4b5a-815f-d8576b9eacf9 service nova] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Received event network-vif-plugged-2ed07331-5c24-4b78-9d63-b0aa7186af4a {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:15:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0eb1339a-8c5d-4fc9-8bda-bfad8197476f req-35757e46-39ba-4b5a-815f-d8576b9eacf9 service nova] Acquiring lock "d473909b-b527-455c-9048-22e6616b6fb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:15:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0eb1339a-8c5d-4fc9-8bda-bfad8197476f req-35757e46-39ba-4b5a-815f-d8576b9eacf9 service nova] Lock "d473909b-b527-455c-9048-22e6616b6fb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:15:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-0eb1339a-8c5d-4fc9-8bda-bfad8197476f req-35757e46-39ba-4b5a-815f-d8576b9eacf9 service nova] Lock "d473909b-b527-455c-9048-22e6616b6fb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:15:57 user nova-compute[73104]: DEBUG nova.compute.manager [req-0eb1339a-8c5d-4fc9-8bda-bfad8197476f req-35757e46-39ba-4b5a-815f-d8576b9eacf9 service nova] [instance: d473909b-b527-455c-9048-22e6616b6fb3] No waiting events found dispatching network-vif-plugged-2ed07331-5c24-4b78-9d63-b0aa7186af4a {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:15:57 user nova-compute[73104]: WARNING nova.compute.manager [req-0eb1339a-8c5d-4fc9-8bda-bfad8197476f req-35757e46-39ba-4b5a-815f-d8576b9eacf9 service nova] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Received unexpected event network-vif-plugged-2ed07331-5c24-4b78-9d63-b0aa7186af4a for instance with vm_state active and task_state deleting.
Aug 26 09:15:57 user nova-compute[73104]: INFO nova.compute.manager [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Took 0.81 seconds to detach 1 volumes for instance.
Aug 26 09:15:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:15:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:15:57 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:15:57 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:15:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:15:57 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Deleted allocations for instance d473909b-b527-455c-9048-22e6616b6fb3
Aug 26 09:15:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-6fab43c5-40ce-49c4-8adc-28841e0ca938 tempest-TestVolumeBootPattern-1466837638 tempest-TestVolumeBootPattern-1466837638-project-member] Lock "d473909b-b527-455c-9048-22e6616b6fb3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.944s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:16:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:16:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:16:10 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693041355.3793273, d473909b-b527-455c-9048-22e6616b6fb3 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:16:10 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: d473909b-b527-455c-9048-22e6616b6fb3] VM Stopped (Lifecycle Event)
Aug 26 09:16:10 user nova-compute[73104]: DEBUG nova.compute.manager [None req-16956d2b-e254-41bd-8442-203d325796be None None] [instance: d473909b-b527-455c-9048-22e6616b6fb3] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:16:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:16:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:16:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:16:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:16:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:16:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:16:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:16:17 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:16:17 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:16:18 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:16:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:16:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:16:18 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:16:18 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:16:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:16:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:16:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:16:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:16:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 09:16:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:16:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:16:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:16:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:16:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:16:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:16:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:16:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:16:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:16:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:16:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:16:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:16:20 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:16:20 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:16:20 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8491MB free_disk=24.06354522705078GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:16:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:16:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:16:20 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:16:20 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 432a66be-853d-42d7-8622-0417ef36045c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:16:20 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 91a80cff-7890-4379-812d-93a1312e89ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:16:20 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:16:20 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:16:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:16:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:16:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:16:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:16:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:16:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:16:20 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:16:20 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:16:20 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:16:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.303s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:16:23 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:16:23 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:16:23 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:16:23 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:16:24 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:16:24 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:16:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-91a80cff-7890-4379-812d-93a1312e89ce" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:16:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-91a80cff-7890-4379-812d-93a1312e89ce" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:16:24 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 09:16:24 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Updating instance_info_cache with network_info: [{"id": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "address": "fa:16:3e:09:9c:0d", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4b382b-e0", "ovs_interfaceid": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:16:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-91a80cff-7890-4379-812d-93a1312e89ce" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:16:24 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 09:16:25 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:16:25 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:16:26 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:16:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:16:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:16:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:16:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:16:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:16:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:16:35 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:16:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:16:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:16:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:16:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:16:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:16:50 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:16:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:16:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:16:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:16:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:16:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:16:56 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:16:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Acquiring lock "5b7a178a-d831-41db-83b5-f7d056cdb299" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:16:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:16:59 user nova-compute[73104]: DEBUG nova.compute.manager [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 09:16:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:16:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:16:59 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 09:16:59 user nova-compute[73104]: INFO nova.compute.claims [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Claim successful on node user
Aug 26 09:16:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:16:59 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:16:59 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:16:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.264s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:16:59 user nova-compute[73104]: DEBUG nova.compute.manager [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 09:16:59 user nova-compute[73104]: DEBUG nova.compute.manager [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 09:16:59 user nova-compute[73104]: DEBUG nova.network.neutron [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 09:16:59 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 09:16:59 user nova-compute[73104]: DEBUG nova.compute.manager [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 09:16:59 user nova-compute[73104]: DEBUG nova.compute.manager [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 09:16:59 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 09:16:59 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Creating image(s)
Aug 26 09:16:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:16:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "/opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:16:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "/opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:16:59 user nova-compute[73104]: DEBUG nova.policy [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44ec93a370e74a3ea133426220c0ef60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66f2ed2ec19430a9cc5c1456111d641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 09:16:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:16:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.177s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:16:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:16:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:16:59 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:16:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.183s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:17:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:17:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk 1073741824" returned: 0 in 0.066s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:17:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:17:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:17:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.179s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:17:00 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 09:17:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:17:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:00 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:17:00 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Cannot resize image /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 09:17:00 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 09:17:00 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Ensure instance console log exists: /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 09:17:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:17:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:17:00 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:17:00 user nova-compute[73104]: DEBUG nova.network.neutron [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Successfully created port: 085c1ecf-a75a-4e8a-b61d-7f25578d15c1 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 09:17:01 user nova-compute[73104]: DEBUG nova.compute.manager [req-f31c25a9-67bd-4e89-9461-ff0b0ebae23b req-d642e95b-657b-4f1c-8027-29c206261e9d service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received event network-changed-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:17:01 user nova-compute[73104]: DEBUG nova.compute.manager [req-f31c25a9-67bd-4e89-9461-ff0b0ebae23b req-d642e95b-657b-4f1c-8027-29c206261e9d service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Refreshing instance network info cache due to event network-changed-bd4b382b-e0fc-4d71-a554-0985a3ecdc92. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:17:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f31c25a9-67bd-4e89-9461-ff0b0ebae23b req-d642e95b-657b-4f1c-8027-29c206261e9d service nova] Acquiring lock "refresh_cache-91a80cff-7890-4379-812d-93a1312e89ce" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:17:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f31c25a9-67bd-4e89-9461-ff0b0ebae23b req-d642e95b-657b-4f1c-8027-29c206261e9d service nova] Acquired lock "refresh_cache-91a80cff-7890-4379-812d-93a1312e89ce" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:17:01 user nova-compute[73104]: DEBUG nova.network.neutron [req-f31c25a9-67bd-4e89-9461-ff0b0ebae23b req-d642e95b-657b-4f1c-8027-29c206261e9d service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Refreshing network info cache for port bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:17:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7dabef97-4ae3-4b6a-88a5-8751045149bb tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "91a80cff-7890-4379-812d-93a1312e89ce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:17:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7dabef97-4ae3-4b6a-88a5-8751045149bb tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "91a80cff-7890-4379-812d-93a1312e89ce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:17:01 user nova-compute[73104]: INFO nova.compute.manager [None req-7dabef97-4ae3-4b6a-88a5-8751045149bb tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Detaching volume 314792be-7d74-4b09-b296-1a880cc72d99
Aug 26 09:17:01 user nova-compute[73104]: DEBUG nova.network.neutron [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Successfully updated port: 085c1ecf-a75a-4e8a-b61d-7f25578d15c1 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 09:17:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Acquiring lock "refresh_cache-5b7a178a-d831-41db-83b5-f7d056cdb299" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:17:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Acquired lock "refresh_cache-5b7a178a-d831-41db-83b5-f7d056cdb299" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:17:01 user nova-compute[73104]: DEBUG nova.network.neutron [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 09:17:01 user nova-compute[73104]: INFO nova.virt.block_device [None req-7dabef97-4ae3-4b6a-88a5-8751045149bb tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Attempting to driver detach volume 314792be-7d74-4b09-b296-1a880cc72d99 from mountpoint /dev/vdb
Aug 26 09:17:01 user nova-compute[73104]: DEBUG nova.compute.manager [req-f2bd9b95-8b78-47e1-9c5d-604082204630 req-12aaecb4-6335-429a-a453-d8c4a531b88c service nova] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Received event network-changed-085c1ecf-a75a-4e8a-b61d-7f25578d15c1 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:17:01 user nova-compute[73104]: DEBUG nova.compute.manager [req-f2bd9b95-8b78-47e1-9c5d-604082204630 req-12aaecb4-6335-429a-a453-d8c4a531b88c service nova] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Refreshing instance network info cache due to event network-changed-085c1ecf-a75a-4e8a-b61d-7f25578d15c1. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:17:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f2bd9b95-8b78-47e1-9c5d-604082204630 req-12aaecb4-6335-429a-a453-d8c4a531b88c service nova] Acquiring lock "refresh_cache-5b7a178a-d831-41db-83b5-f7d056cdb299" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:17:01 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-7dabef97-4ae3-4b6a-88a5-8751045149bb tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Attempting to detach device vdb from instance 91a80cff-7890-4379-812d-93a1312e89ce from the persistent domain config. {{(pid=73104) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 09:17:01 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-7dabef97-4ae3-4b6a-88a5-8751045149bb tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 09:17:01 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:17:01 user nova-compute[73104]:   <source dev="/dev/sde"/>
Aug 26 09:17:01 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:17:01 user nova-compute[73104]:   <serial>314792be-7d74-4b09-b296-1a880cc72d99</serial>
Aug 26 09:17:01 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 09:17:01 user nova-compute[73104]: </disk>
Aug 26 09:17:01 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 09:17:01 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-7dabef97-4ae3-4b6a-88a5-8751045149bb tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Successfully detached device vdb from instance 91a80cff-7890-4379-812d-93a1312e89ce from the persistent domain config.
Aug 26 09:17:01 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-7dabef97-4ae3-4b6a-88a5-8751045149bb tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 91a80cff-7890-4379-812d-93a1312e89ce from the live domain config. {{(pid=73104) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 09:17:01 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-7dabef97-4ae3-4b6a-88a5-8751045149bb tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 09:17:01 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:17:01 user nova-compute[73104]:   <source dev="/dev/sde"/>
Aug 26 09:17:01 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:17:01 user nova-compute[73104]:   <serial>314792be-7d74-4b09-b296-1a880cc72d99</serial>
Aug 26 09:17:01 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 09:17:01 user nova-compute[73104]: </disk>
Aug 26 09:17:01 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 09:17:01 user nova-compute[73104]: DEBUG nova.network.neutron [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 09:17:01 user nova-compute[73104]: DEBUG nova.network.neutron [req-f31c25a9-67bd-4e89-9461-ff0b0ebae23b req-d642e95b-657b-4f1c-8027-29c206261e9d service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Updated VIF entry in instance network info cache for port bd4b382b-e0fc-4d71-a554-0985a3ecdc92. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:17:01 user nova-compute[73104]: DEBUG nova.network.neutron [req-f31c25a9-67bd-4e89-9461-ff0b0ebae23b req-d642e95b-657b-4f1c-8027-29c206261e9d service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Updating instance_info_cache with network_info: [{"id": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "address": "fa:16:3e:09:9c:0d", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4b382b-e0", "ovs_interfaceid": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:17:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f31c25a9-67bd-4e89-9461-ff0b0ebae23b req-d642e95b-657b-4f1c-8027-29c206261e9d service nova] Releasing lock "refresh_cache-91a80cff-7890-4379-812d-93a1312e89ce" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.network.neutron [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Updating instance_info_cache with network_info: [{"id": "085c1ecf-a75a-4e8a-b61d-7f25578d15c1", "address": "fa:16:3e:f8:ac:3e", "network": {"id": "a2f3e73a-66a3-4ad7-b362-1747ad158dc8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1518509383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c66f2ed2ec19430a9cc5c1456111d641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085c1ecf-a7", "ovs_interfaceid": "085c1ecf-a75a-4e8a-b61d-7f25578d15c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Releasing lock "refresh_cache-5b7a178a-d831-41db-83b5-f7d056cdb299" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.compute.manager [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Instance network_info: |[{"id": "085c1ecf-a75a-4e8a-b61d-7f25578d15c1", "address": "fa:16:3e:f8:ac:3e", "network": {"id": "a2f3e73a-66a3-4ad7-b362-1747ad158dc8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1518509383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c66f2ed2ec19430a9cc5c1456111d641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085c1ecf-a7", "ovs_interfaceid": "085c1ecf-a75a-4e8a-b61d-7f25578d15c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f2bd9b95-8b78-47e1-9c5d-604082204630 req-12aaecb4-6335-429a-a453-d8c4a531b88c service nova] Acquired lock "refresh_cache-5b7a178a-d831-41db-83b5-f7d056cdb299" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.network.neutron [req-f2bd9b95-8b78-47e1-9c5d-604082204630 req-12aaecb4-6335-429a-a453-d8c4a531b88c service nova] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Refreshing network info cache for port 085c1ecf-a75a-4e8a-b61d-7f25578d15c1 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Start _get_guest_xml network_info=[{"id": "085c1ecf-a75a-4e8a-b61d-7f25578d15c1", "address": "fa:16:3e:f8:ac:3e", "network": {"id": "a2f3e73a-66a3-4ad7-b362-1747ad158dc8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1518509383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c66f2ed2ec19430a9cc5c1456111d641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085c1ecf-a7", "ovs_interfaceid": "085c1ecf-a75a-4e8a-b61d-7f25578d15c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 09:17:02 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:17:02 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:16:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2013194521',display_name='tempest-SnapshotDataIntegrityTests-server-2013194521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2013194521',id=52,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKm8zcKDklFGHn8lnlILCvmxDUoJFHlcozECtSjW4D3Y0YHf9na5NNmhqpTp4qIsHf3IVu2KTEs16q45lJzbkgqWALDKOdNv9cjaq7ygDp3BmfkBxDWXS1IIeukmrrZ6KA==',key_name='tempest-keypair-1789320669',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c66f2ed2ec19430a9cc5c1456111d641',ramdisk_id='',reservation_id='r-edct06n9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2002712156',owner_user_name='tempest-SnapshotDataIntegrityTests-2002712156-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:17:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44ec93a370e74a3ea133426220c0ef60',uuid=5b7a178a-d831-41db-83b5-f7d056cdb299,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "085c1ecf-a75a-4e8a-b61d-7f25578d15c1", "address": "fa:16:3e:f8:ac:3e", "network": {"id": "a2f3e73a-66a3-4ad7-b362-1747ad158dc8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1518509383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c66f2ed2ec19430a9cc5c1456111d641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085c1ecf-a7", "ovs_interfaceid": "085c1ecf-a75a-4e8a-b61d-7f25578d15c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Converting VIF {"id": "085c1ecf-a75a-4e8a-b61d-7f25578d15c1", "address": "fa:16:3e:f8:ac:3e", "network": {"id": "a2f3e73a-66a3-4ad7-b362-1747ad158dc8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1518509383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c66f2ed2ec19430a9cc5c1456111d641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085c1ecf-a7", "ovs_interfaceid": "085c1ecf-a75a-4e8a-b61d-7f25578d15c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:ac:3e,bridge_name='br-int',has_traffic_filtering=True,id=085c1ecf-a75a-4e8a-b61d-7f25578d15c1,network=Network(a2f3e73a-66a3-4ad7-b362-1747ad158dc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap085c1ecf-a7') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.objects.instance [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b7a178a-d831-41db-83b5-f7d056cdb299 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Received event <DeviceRemovedEvent: 1693041422.4058757, 91a80cff-7890-4379-812d-93a1312e89ce => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73104) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-7dabef97-4ae3-4b6a-88a5-8751045149bb tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 91a80cff-7890-4379-812d-93a1312e89ce {{(pid=73104) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 09:17:02 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-7dabef97-4ae3-4b6a-88a5-8751045149bb tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Successfully detached device vdb from instance 91a80cff-7890-4379-812d-93a1312e89ce from the live domain config.
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dabef97-4ae3-4b6a-88a5-8751045149bb tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dabef97-4ae3-4b6a-88a5-8751045149bb tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DzYosgSl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:17:02 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-7dabef97-4ae3-4b6a-88a5-8751045149bb tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:17:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-7dabef97-4ae3-4b6a-88a5-8751045149bb tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-7dabef97-4ae3-4b6a-88a5-8751045149bb tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dabef97-4ae3-4b6a-88a5-8751045149bb tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] End _get_guest_xml xml=<domain type="kvm">
Aug 26 09:17:02 user nova-compute[73104]:   <uuid>5b7a178a-d831-41db-83b5-f7d056cdb299</uuid>
Aug 26 09:17:02 user nova-compute[73104]:   <name>instance-00000034</name>
Aug 26 09:17:02 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 09:17:02 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 09:17:02 user nova-compute[73104]:   <metadata>
Aug 26 09:17:02 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 09:17:02 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 09:17:02 user nova-compute[73104]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-2013194521</nova:name>
Aug 26 09:17:02 user nova-compute[73104]:       <nova:creationTime>2023-08-26 09:17:02</nova:creationTime>
Aug 26 09:17:02 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 09:17:02 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 09:17:02 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 09:17:02 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 09:17:02 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 09:17:02 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 09:17:02 user nova-compute[73104]:       </nova:flavor>
Aug 26 09:17:02 user nova-compute[73104]:       <nova:owner>
Aug 26 09:17:02 user nova-compute[73104]:         <nova:user uuid="44ec93a370e74a3ea133426220c0ef60">tempest-SnapshotDataIntegrityTests-2002712156-project-member</nova:user>
Aug 26 09:17:02 user nova-compute[73104]:         <nova:project uuid="c66f2ed2ec19430a9cc5c1456111d641">tempest-SnapshotDataIntegrityTests-2002712156</nova:project>
Aug 26 09:17:02 user nova-compute[73104]:       </nova:owner>
Aug 26 09:17:02 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 09:17:02 user nova-compute[73104]:       <nova:ports>
Aug 26 09:17:02 user nova-compute[73104]:         <nova:port uuid="085c1ecf-a75a-4e8a-b61d-7f25578d15c1">
Aug 26 09:17:02 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 09:17:02 user nova-compute[73104]:         </nova:port>
Aug 26 09:17:02 user nova-compute[73104]:       </nova:ports>
Aug 26 09:17:02 user nova-compute[73104]:     </nova:instance>
Aug 26 09:17:02 user nova-compute[73104]:   </metadata>
Aug 26 09:17:02 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 09:17:02 user nova-compute[73104]:     <system>
Aug 26 09:17:02 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 09:17:02 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 09:17:02 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 09:17:02 user nova-compute[73104]:       <entry name="serial">5b7a178a-d831-41db-83b5-f7d056cdb299</entry>
Aug 26 09:17:02 user nova-compute[73104]:       <entry name="uuid">5b7a178a-d831-41db-83b5-f7d056cdb299</entry>
Aug 26 09:17:02 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 09:17:02 user nova-compute[73104]:     </system>
Aug 26 09:17:02 user nova-compute[73104]:   </sysinfo>
Aug 26 09:17:02 user nova-compute[73104]:   <os>
Aug 26 09:17:02 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 09:17:02 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 09:17:02 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 09:17:02 user nova-compute[73104]:   </os>
Aug 26 09:17:02 user nova-compute[73104]:   <features>
Aug 26 09:17:02 user nova-compute[73104]:     <acpi/>
Aug 26 09:17:02 user nova-compute[73104]:     <apic/>
Aug 26 09:17:02 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 09:17:02 user nova-compute[73104]:   </features>
Aug 26 09:17:02 user nova-compute[73104]:   <clock offset="utc">
Aug 26 09:17:02 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 09:17:02 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 09:17:02 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 09:17:02 user nova-compute[73104]:   </clock>
Aug 26 09:17:02 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 09:17:02 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 09:17:02 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 09:17:02 user nova-compute[73104]:   </cpu>
Aug 26 09:17:02 user nova-compute[73104]:   <devices>
Aug 26 09:17:02 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 09:17:02 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 09:17:02 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk"/>
Aug 26 09:17:02 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 09:17:02 user nova-compute[73104]:     </disk>
Aug 26 09:17:02 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 09:17:02 user nova-compute[73104]:       <mac address="fa:16:3e:f8:ac:3e"/>
Aug 26 09:17:02 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:17:02 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 09:17:02 user nova-compute[73104]:       <target dev="tap085c1ecf-a7"/>
Aug 26 09:17:02 user nova-compute[73104]:     </interface>
Aug 26 09:17:02 user nova-compute[73104]:     <serial type="pty">
Aug 26 09:17:02 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/console.log" append="off"/>
Aug 26 09:17:02 user nova-compute[73104]:     </serial>
Aug 26 09:17:02 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 09:17:02 user nova-compute[73104]:     <video>
Aug 26 09:17:02 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:17:02 user nova-compute[73104]:     </video>
Aug 26 09:17:02 user nova-compute[73104]:     <rng model="virtio">
Aug 26 09:17:02 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 09:17:02 user nova-compute[73104]:     </rng>
Aug 26 09:17:02 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 09:17:02 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 09:17:02 user nova-compute[73104]:       <stats period="10"/>
Aug 26 09:17:02 user nova-compute[73104]:     </memballoon>
Aug 26 09:17:02 user nova-compute[73104]:   </devices>
Aug 26 09:17:02 user nova-compute[73104]: </domain>
Aug 26 09:17:02 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:16:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2013194521',display_name='tempest-SnapshotDataIntegrityTests-server-2013194521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2013194521',id=52,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKm8zcKDklFGHn8lnlILCvmxDUoJFHlcozECtSjW4D3Y0YHf9na5NNmhqpTp4qIsHf3IVu2KTEs16q45lJzbkgqWALDKOdNv9cjaq7ygDp3BmfkBxDWXS1IIeukmrrZ6KA==',key_name='tempest-keypair-1789320669',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c66f2ed2ec19430a9cc5c1456111d641',ramdisk_id='',reservation_id='r-edct06n9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2002712156',owner_user_name='tempest-SnapshotDataIntegrityTests-2002712156-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:17:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44ec93a370e74a3ea133426220c0ef60',uuid=5b7a178a-d831-41db-83b5-f7d056cdb299,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "085c1ecf-a75a-4e8a-b61d-7f25578d15c1", "address": "fa:16:3e:f8:ac:3e", "network": {"id": "a2f3e73a-66a3-4ad7-b362-1747ad158dc8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1518509383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c66f2ed2ec19430a9cc5c1456111d641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085c1ecf-a7", "ovs_interfaceid": "085c1ecf-a75a-4e8a-b61d-7f25578d15c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Converting VIF {"id": "085c1ecf-a75a-4e8a-b61d-7f25578d15c1", "address": "fa:16:3e:f8:ac:3e", "network": {"id": "a2f3e73a-66a3-4ad7-b362-1747ad158dc8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1518509383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c66f2ed2ec19430a9cc5c1456111d641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085c1ecf-a7", "ovs_interfaceid": "085c1ecf-a75a-4e8a-b61d-7f25578d15c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:ac:3e,bridge_name='br-int',has_traffic_filtering=True,id=085c1ecf-a75a-4e8a-b61d-7f25578d15c1,network=Network(a2f3e73a-66a3-4ad7-b362-1747ad158dc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap085c1ecf-a7') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG os_vif [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:ac:3e,bridge_name='br-int',has_traffic_filtering=True,id=085c1ecf-a75a-4e8a-b61d-7f25578d15c1,network=Network(a2f3e73a-66a3-4ad7-b362-1747ad158dc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap085c1ecf-a7') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap085c1ecf-a7, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap085c1ecf-a7, col_values=(('external_ids', {'iface-id': '085c1ecf-a75a-4e8a-b61d-7f25578d15c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:ac:3e', 'vm-uuid': '5b7a178a-d831-41db-83b5-f7d056cdb299'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a359e189-c0f1-443d-bcfe-72109bc23805]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:02 user nova-compute[73104]: INFO os_vif [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:ac:3e,bridge_name='br-int',has_traffic_filtering=True,id=085c1ecf-a75a-4e8a-b61d-7f25578d15c1,network=Network(a2f3e73a-66a3-4ad7-b362-1747ad158dc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap085c1ecf-a7')
Aug 26 09:17:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e1db01-d36f-478a-9844-fc5060cc5efb]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dabef97-4ae3-4b6a-88a5-8751045149bb tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 (non-flash)
Aug 26 09:17:02 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dabef97-4ae3-4b6a-88a5-8751045149bb tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 (non-flash)
Aug 26 09:17:02 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dabef97-4ae3-4b6a-88a5-8751045149bb tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0c4186320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99'): ({'sde'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-7dabef97-4ae3-4b6a-88a5-8751045149bb tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Removing single pathed devices sde {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[069d3efb-221b-45cc-96db-a594fbea117c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c920581-c6ab-4be7-b02f-d107d886f813]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-7dabef97-4ae3-4b6a-88a5-8751045149bb tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Flushing IO for device /dev/sde {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] No VIF found with MAC fa:16:3e:f8:ac:3e, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe2d3a2-1466-435b-98e4-8ccd8f673fa0]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-7dabef97-4ae3-4b6a-88a5-8751045149bb tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[41200e40-bd20-4358-b000-3521bcfdb730]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-7dabef97-4ae3-4b6a-88a5-8751045149bb tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-7dabef97-4ae3-4b6a-88a5-8751045149bb tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] SCSI volumes sde have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dabef97-4ae3-4b6a-88a5-8751045149bb tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[996686d0-8e31-47a0-b245-b38222a5fc69]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dabef97-4ae3-4b6a-88a5-8751045149bb tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7477c263-0ffa-4229-877c-13ae62f58f2b]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dabef97-4ae3-4b6a-88a5-8751045149bb tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99, portal: 172.16.0.220,3260]
Aug 26 09:17:02 user nova-compute[73104]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99, portal: 172.16.0.220,3260] successful.
Aug 26 09:17:02 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:314792be-7d74-4b09-b296-1a880cc72d99 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3957d2-1c30-43ec-9323-9b2c736b9cd1]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dabef97-4ae3-4b6a-88a5-8751045149bb tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-7dabef97-4ae3-4b6a-88a5-8751045149bb tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dabef97-4ae3-4b6a-88a5-8751045149bb tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] <== disconnect_volume: return (278ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dabef97-4ae3-4b6a-88a5-8751045149bb tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.network.neutron [req-f2bd9b95-8b78-47e1-9c5d-604082204630 req-12aaecb4-6335-429a-a453-d8c4a531b88c service nova] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Updated VIF entry in instance network info cache for port 085c1ecf-a75a-4e8a-b61d-7f25578d15c1. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG nova.network.neutron [req-f2bd9b95-8b78-47e1-9c5d-604082204630 req-12aaecb4-6335-429a-a453-d8c4a531b88c service nova] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Updating instance_info_cache with network_info: [{"id": "085c1ecf-a75a-4e8a-b61d-7f25578d15c1", "address": "fa:16:3e:f8:ac:3e", "network": {"id": "a2f3e73a-66a3-4ad7-b362-1747ad158dc8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1518509383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c66f2ed2ec19430a9cc5c1456111d641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085c1ecf-a7", "ovs_interfaceid": "085c1ecf-a75a-4e8a-b61d-7f25578d15c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:17:02 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-f2bd9b95-8b78-47e1-9c5d-604082204630 req-12aaecb4-6335-429a-a453-d8c4a531b88c service nova] Releasing lock "refresh_cache-5b7a178a-d831-41db-83b5-f7d056cdb299" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:17:03 user nova-compute[73104]: DEBUG nova.compute.manager [req-66e8b6dd-b14c-44b3-b7ec-35b376cb9330 req-2c93cab3-e1d4-4425-82fd-3ddab3d771c5 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received event network-changed-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:17:03 user nova-compute[73104]: DEBUG nova.compute.manager [req-66e8b6dd-b14c-44b3-b7ec-35b376cb9330 req-2c93cab3-e1d4-4425-82fd-3ddab3d771c5 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Refreshing instance network info cache due to event network-changed-bd4b382b-e0fc-4d71-a554-0985a3ecdc92. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:17:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-66e8b6dd-b14c-44b3-b7ec-35b376cb9330 req-2c93cab3-e1d4-4425-82fd-3ddab3d771c5 service nova] Acquiring lock "refresh_cache-91a80cff-7890-4379-812d-93a1312e89ce" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:17:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-66e8b6dd-b14c-44b3-b7ec-35b376cb9330 req-2c93cab3-e1d4-4425-82fd-3ddab3d771c5 service nova] Acquired lock "refresh_cache-91a80cff-7890-4379-812d-93a1312e89ce" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:17:03 user nova-compute[73104]: DEBUG nova.network.neutron [req-66e8b6dd-b14c-44b3-b7ec-35b376cb9330 req-2c93cab3-e1d4-4425-82fd-3ddab3d771c5 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Refreshing network info cache for port bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:17:03 user nova-compute[73104]: DEBUG nova.objects.instance [None req-7dabef97-4ae3-4b6a-88a5-8751045149bb tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lazy-loading 'flavor' on Instance uuid 91a80cff-7890-4379-812d-93a1312e89ce {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:17:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7dabef97-4ae3-4b6a-88a5-8751045149bb tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "91a80cff-7890-4379-812d-93a1312e89ce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.109s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:17:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:03 user nova-compute[73104]: DEBUG nova.network.neutron [req-66e8b6dd-b14c-44b3-b7ec-35b376cb9330 req-2c93cab3-e1d4-4425-82fd-3ddab3d771c5 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Updated VIF entry in instance network info cache for port bd4b382b-e0fc-4d71-a554-0985a3ecdc92. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:17:03 user nova-compute[73104]: DEBUG nova.network.neutron [req-66e8b6dd-b14c-44b3-b7ec-35b376cb9330 req-2c93cab3-e1d4-4425-82fd-3ddab3d771c5 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Updating instance_info_cache with network_info: [{"id": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "address": "fa:16:3e:09:9c:0d", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4b382b-e0", "ovs_interfaceid": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:17:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-66e8b6dd-b14c-44b3-b7ec-35b376cb9330 req-2c93cab3-e1d4-4425-82fd-3ddab3d771c5 service nova] Releasing lock "refresh_cache-91a80cff-7890-4379-812d-93a1312e89ce" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:17:04 user nova-compute[73104]: DEBUG nova.compute.manager [req-03f89544-5e2d-433e-ab28-8edad18f8c7f req-80d57a9b-a9f9-45a6-8ee6-438bc9d02b8e service nova] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Received event network-vif-plugged-085c1ecf-a75a-4e8a-b61d-7f25578d15c1 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:17:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-03f89544-5e2d-433e-ab28-8edad18f8c7f req-80d57a9b-a9f9-45a6-8ee6-438bc9d02b8e service nova] Acquiring lock "5b7a178a-d831-41db-83b5-f7d056cdb299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:17:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-03f89544-5e2d-433e-ab28-8edad18f8c7f req-80d57a9b-a9f9-45a6-8ee6-438bc9d02b8e service nova] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:17:04 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-03f89544-5e2d-433e-ab28-8edad18f8c7f req-80d57a9b-a9f9-45a6-8ee6-438bc9d02b8e service nova] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:17:04 user nova-compute[73104]: DEBUG nova.compute.manager [req-03f89544-5e2d-433e-ab28-8edad18f8c7f req-80d57a9b-a9f9-45a6-8ee6-438bc9d02b8e service nova] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] No waiting events found dispatching network-vif-plugged-085c1ecf-a75a-4e8a-b61d-7f25578d15c1 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:17:04 user nova-compute[73104]: WARNING nova.compute.manager [req-03f89544-5e2d-433e-ab28-8edad18f8c7f req-80d57a9b-a9f9-45a6-8ee6-438bc9d02b8e service nova] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Received unexpected event network-vif-plugged-085c1ecf-a75a-4e8a-b61d-7f25578d15c1 for instance with vm_state building and task_state spawning.
Aug 26 09:17:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:06 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693041426.1612184, 5b7a178a-d831-41db-83b5-f7d056cdb299 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:17:06 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] VM Resumed (Lifecycle Event)
Aug 26 09:17:06 user nova-compute[73104]: DEBUG nova.compute.manager [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 09:17:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 09:17:06 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Instance spawned successfully.
Aug 26 09:17:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 09:17:06 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:17:06 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:17:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:17:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:17:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:17:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:17:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:17:06 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:17:06 user nova-compute[73104]: DEBUG nova.compute.manager [req-27242b2b-2d09-4384-a1c4-a4647190aaed req-0fc3bd10-b924-4137-af6b-69bc36c48f72 service nova] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Received event network-vif-plugged-085c1ecf-a75a-4e8a-b61d-7f25578d15c1 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:17:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-27242b2b-2d09-4384-a1c4-a4647190aaed req-0fc3bd10-b924-4137-af6b-69bc36c48f72 service nova] Acquiring lock "5b7a178a-d831-41db-83b5-f7d056cdb299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:17:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-27242b2b-2d09-4384-a1c4-a4647190aaed req-0fc3bd10-b924-4137-af6b-69bc36c48f72 service nova] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:17:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-27242b2b-2d09-4384-a1c4-a4647190aaed req-0fc3bd10-b924-4137-af6b-69bc36c48f72 service nova] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:17:06 user nova-compute[73104]: DEBUG nova.compute.manager [req-27242b2b-2d09-4384-a1c4-a4647190aaed req-0fc3bd10-b924-4137-af6b-69bc36c48f72 service nova] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] No waiting events found dispatching network-vif-plugged-085c1ecf-a75a-4e8a-b61d-7f25578d15c1 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:17:06 user nova-compute[73104]: WARNING nova.compute.manager [req-27242b2b-2d09-4384-a1c4-a4647190aaed req-0fc3bd10-b924-4137-af6b-69bc36c48f72 service nova] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Received unexpected event network-vif-plugged-085c1ecf-a75a-4e8a-b61d-7f25578d15c1 for instance with vm_state building and task_state spawning.
Aug 26 09:17:06 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 09:17:06 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693041426.1632, 5b7a178a-d831-41db-83b5-f7d056cdb299 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:17:06 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] VM Started (Lifecycle Event)
Aug 26 09:17:06 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:17:06 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:17:06 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 09:17:06 user nova-compute[73104]: INFO nova.compute.manager [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Took 6.62 seconds to spawn the instance on the hypervisor.
Aug 26 09:17:06 user nova-compute[73104]: DEBUG nova.compute.manager [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:17:06 user nova-compute[73104]: INFO nova.compute.manager [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Took 7.20 seconds to build instance.
Aug 26 09:17:06 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-c65c24e6-33a9-4e4a-b408-66a2869bafe2 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.303s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:17:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:17 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:17:17 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:17:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:17:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:17:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:17:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:17:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:19 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:17:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:17:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:17:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:17:19 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:17:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:17:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:17:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:17:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:17:19 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:17:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:17:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:17:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:17:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:17:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:17:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:17:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:17:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:17:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:17:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:17:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:17:20 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:17:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:17:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:17:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:17:21 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:17:21 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:17:21 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8352MB free_disk=24.027725219726562GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:17:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:17:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:17:21 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:17:21 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 432a66be-853d-42d7-8622-0417ef36045c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:17:21 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 91a80cff-7890-4379-812d-93a1312e89ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:17:21 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 5b7a178a-d831-41db-83b5-f7d056cdb299 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:17:21 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:17:21 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:17:21 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:17:21 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:17:21 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:17:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:17:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:23 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:17:23 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:17:23 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:17:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:25 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:17:25 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:17:25 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:17:25 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Didn't find any instances for network info cache update. {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 09:17:25 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:17:27 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:17:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:32 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:17:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:35 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:17:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:17:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:17:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:17:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:17:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-56a93f2f-beae-4e9d-aa28-454a87daa280 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "91a80cff-7890-4379-812d-93a1312e89ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:17:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-56a93f2f-beae-4e9d-aa28-454a87daa280 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "91a80cff-7890-4379-812d-93a1312e89ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:17:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-56a93f2f-beae-4e9d-aa28-454a87daa280 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "91a80cff-7890-4379-812d-93a1312e89ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:17:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-56a93f2f-beae-4e9d-aa28-454a87daa280 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "91a80cff-7890-4379-812d-93a1312e89ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:17:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-56a93f2f-beae-4e9d-aa28-454a87daa280 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "91a80cff-7890-4379-812d-93a1312e89ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:17:52 user nova-compute[73104]: INFO nova.compute.manager [None req-56a93f2f-beae-4e9d-aa28-454a87daa280 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Terminating instance
Aug 26 09:17:52 user nova-compute[73104]: DEBUG nova.compute.manager [None req-56a93f2f-beae-4e9d-aa28-454a87daa280 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 09:17:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:52 user nova-compute[73104]: DEBUG nova.compute.manager [req-d31fcc92-b524-4526-bc9b-26c72b3a0b24 req-b3eb64d9-98bf-478f-810e-ac3cc2519767 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received event network-vif-unplugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:17:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d31fcc92-b524-4526-bc9b-26c72b3a0b24 req-b3eb64d9-98bf-478f-810e-ac3cc2519767 service nova] Acquiring lock "91a80cff-7890-4379-812d-93a1312e89ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:17:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d31fcc92-b524-4526-bc9b-26c72b3a0b24 req-b3eb64d9-98bf-478f-810e-ac3cc2519767 service nova] Lock "91a80cff-7890-4379-812d-93a1312e89ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:17:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-d31fcc92-b524-4526-bc9b-26c72b3a0b24 req-b3eb64d9-98bf-478f-810e-ac3cc2519767 service nova] Lock "91a80cff-7890-4379-812d-93a1312e89ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:17:52 user nova-compute[73104]: DEBUG nova.compute.manager [req-d31fcc92-b524-4526-bc9b-26c72b3a0b24 req-b3eb64d9-98bf-478f-810e-ac3cc2519767 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] No waiting events found dispatching network-vif-unplugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:17:52 user nova-compute[73104]: DEBUG nova.compute.manager [req-d31fcc92-b524-4526-bc9b-26c72b3a0b24 req-b3eb64d9-98bf-478f-810e-ac3cc2519767 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received event network-vif-unplugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 09:17:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:52 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Instance destroyed successfully.
Aug 26 09:17:52 user nova-compute[73104]: DEBUG nova.objects.instance [None req-56a93f2f-beae-4e9d-aa28-454a87daa280 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lazy-loading 'resources' on Instance uuid 91a80cff-7890-4379-812d-93a1312e89ce {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:17:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-56a93f2f-beae-4e9d-aa28-454a87daa280 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:11:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-610449647',display_name='tempest-ServerRescueNegativeTestJSON-server-610449647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-610449647',id=49,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZ21PFmAeWEv6gMElqhwF4yV9CGe2trYvz4xOHn+iIp4VodL+fOa8EV0yQ0NIqBqCjZgTOL7NE/HAkaYxxZbDjGcWBiUMQ44esb2PVkSUUIhbIlJKiiChZq8vE/UjbNuw==',key_name='tempest-keypair-189958290',keypairs=<?>,launch_index=0,launched_at=2023-08-26T09:13:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b7642d165474defadde34dabc11f842',ramdisk_id='',reservation_id='r-j9qm35ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-901062798',owner_user_name='tempest-ServerRescueNegativeTestJSON-901062798-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T09:15:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da4b6574d165418eaf2b8c8b84d6151f',uuid=91a80cff-7890-4379-812d-93a1312e89ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "address": "fa:16:3e:09:9c:0d", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4b382b-e0", "ovs_interfaceid": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 09:17:52 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-56a93f2f-beae-4e9d-aa28-454a87daa280 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Converting VIF {"id": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "address": "fa:16:3e:09:9c:0d", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4b382b-e0", "ovs_interfaceid": "bd4b382b-e0fc-4d71-a554-0985a3ecdc92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:17:52 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-56a93f2f-beae-4e9d-aa28-454a87daa280 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:9c:0d,bridge_name='br-int',has_traffic_filtering=True,id=bd4b382b-e0fc-4d71-a554-0985a3ecdc92,network=Network(fb2d19ab-1c79-4529-b058-e1b8c4fc8276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd4b382b-e0') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:17:52 user nova-compute[73104]: DEBUG os_vif [None req-56a93f2f-beae-4e9d-aa28-454a87daa280 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:9c:0d,bridge_name='br-int',has_traffic_filtering=True,id=bd4b382b-e0fc-4d71-a554-0985a3ecdc92,network=Network(fb2d19ab-1c79-4529-b058-e1b8c4fc8276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd4b382b-e0') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 09:17:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd4b382b-e0, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:17:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:17:52 user nova-compute[73104]: INFO os_vif [None req-56a93f2f-beae-4e9d-aa28-454a87daa280 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:9c:0d,bridge_name='br-int',has_traffic_filtering=True,id=bd4b382b-e0fc-4d71-a554-0985a3ecdc92,network=Network(fb2d19ab-1c79-4529-b058-e1b8c4fc8276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd4b382b-e0')
Aug 26 09:17:52 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-56a93f2f-beae-4e9d-aa28-454a87daa280 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Deleting instance files /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce_del
Aug 26 09:17:52 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-56a93f2f-beae-4e9d-aa28-454a87daa280 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Deletion of /opt/stack/data/nova/instances/91a80cff-7890-4379-812d-93a1312e89ce_del complete
Aug 26 09:17:52 user nova-compute[73104]: INFO nova.compute.manager [None req-56a93f2f-beae-4e9d-aa28-454a87daa280 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 26 09:17:52 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-56a93f2f-beae-4e9d-aa28-454a87daa280 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 09:17:52 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 09:17:52 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 09:17:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-5f34b4d0-82dd-4ac7-ac92-a3c2147a7856 req-d920e8ec-f975-4ac4-a23c-342face1d518 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received event network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:17:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5f34b4d0-82dd-4ac7-ac92-a3c2147a7856 req-d920e8ec-f975-4ac4-a23c-342face1d518 service nova] Acquiring lock "91a80cff-7890-4379-812d-93a1312e89ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:17:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5f34b4d0-82dd-4ac7-ac92-a3c2147a7856 req-d920e8ec-f975-4ac4-a23c-342face1d518 service nova] Lock "91a80cff-7890-4379-812d-93a1312e89ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:17:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5f34b4d0-82dd-4ac7-ac92-a3c2147a7856 req-d920e8ec-f975-4ac4-a23c-342face1d518 service nova] Lock "91a80cff-7890-4379-812d-93a1312e89ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:17:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-5f34b4d0-82dd-4ac7-ac92-a3c2147a7856 req-d920e8ec-f975-4ac4-a23c-342face1d518 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] No waiting events found dispatching network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:17:54 user nova-compute[73104]: WARNING nova.compute.manager [req-5f34b4d0-82dd-4ac7-ac92-a3c2147a7856 req-d920e8ec-f975-4ac4-a23c-342face1d518 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received unexpected event network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 for instance with vm_state active and task_state deleting.
Aug 26 09:17:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-5f34b4d0-82dd-4ac7-ac92-a3c2147a7856 req-d920e8ec-f975-4ac4-a23c-342face1d518 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received event network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:17:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5f34b4d0-82dd-4ac7-ac92-a3c2147a7856 req-d920e8ec-f975-4ac4-a23c-342face1d518 service nova] Acquiring lock "91a80cff-7890-4379-812d-93a1312e89ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:17:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5f34b4d0-82dd-4ac7-ac92-a3c2147a7856 req-d920e8ec-f975-4ac4-a23c-342face1d518 service nova] Lock "91a80cff-7890-4379-812d-93a1312e89ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:17:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5f34b4d0-82dd-4ac7-ac92-a3c2147a7856 req-d920e8ec-f975-4ac4-a23c-342face1d518 service nova] Lock "91a80cff-7890-4379-812d-93a1312e89ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:17:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-5f34b4d0-82dd-4ac7-ac92-a3c2147a7856 req-d920e8ec-f975-4ac4-a23c-342face1d518 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] No waiting events found dispatching network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:17:54 user nova-compute[73104]: WARNING nova.compute.manager [req-5f34b4d0-82dd-4ac7-ac92-a3c2147a7856 req-d920e8ec-f975-4ac4-a23c-342face1d518 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received unexpected event network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 for instance with vm_state active and task_state deleting.
Aug 26 09:17:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-5f34b4d0-82dd-4ac7-ac92-a3c2147a7856 req-d920e8ec-f975-4ac4-a23c-342face1d518 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received event network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:17:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5f34b4d0-82dd-4ac7-ac92-a3c2147a7856 req-d920e8ec-f975-4ac4-a23c-342face1d518 service nova] Acquiring lock "91a80cff-7890-4379-812d-93a1312e89ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:17:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5f34b4d0-82dd-4ac7-ac92-a3c2147a7856 req-d920e8ec-f975-4ac4-a23c-342face1d518 service nova] Lock "91a80cff-7890-4379-812d-93a1312e89ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:17:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5f34b4d0-82dd-4ac7-ac92-a3c2147a7856 req-d920e8ec-f975-4ac4-a23c-342face1d518 service nova] Lock "91a80cff-7890-4379-812d-93a1312e89ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:17:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-5f34b4d0-82dd-4ac7-ac92-a3c2147a7856 req-d920e8ec-f975-4ac4-a23c-342face1d518 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] No waiting events found dispatching network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:17:54 user nova-compute[73104]: WARNING nova.compute.manager [req-5f34b4d0-82dd-4ac7-ac92-a3c2147a7856 req-d920e8ec-f975-4ac4-a23c-342face1d518 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received unexpected event network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 for instance with vm_state active and task_state deleting.
Aug 26 09:17:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-5f34b4d0-82dd-4ac7-ac92-a3c2147a7856 req-d920e8ec-f975-4ac4-a23c-342face1d518 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received event network-vif-unplugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:17:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5f34b4d0-82dd-4ac7-ac92-a3c2147a7856 req-d920e8ec-f975-4ac4-a23c-342face1d518 service nova] Acquiring lock "91a80cff-7890-4379-812d-93a1312e89ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:17:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5f34b4d0-82dd-4ac7-ac92-a3c2147a7856 req-d920e8ec-f975-4ac4-a23c-342face1d518 service nova] Lock "91a80cff-7890-4379-812d-93a1312e89ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:17:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5f34b4d0-82dd-4ac7-ac92-a3c2147a7856 req-d920e8ec-f975-4ac4-a23c-342face1d518 service nova] Lock "91a80cff-7890-4379-812d-93a1312e89ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:17:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-5f34b4d0-82dd-4ac7-ac92-a3c2147a7856 req-d920e8ec-f975-4ac4-a23c-342face1d518 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] No waiting events found dispatching network-vif-unplugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:17:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-5f34b4d0-82dd-4ac7-ac92-a3c2147a7856 req-d920e8ec-f975-4ac4-a23c-342face1d518 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received event network-vif-unplugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 09:17:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-5f34b4d0-82dd-4ac7-ac92-a3c2147a7856 req-d920e8ec-f975-4ac4-a23c-342face1d518 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received event network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:17:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5f34b4d0-82dd-4ac7-ac92-a3c2147a7856 req-d920e8ec-f975-4ac4-a23c-342face1d518 service nova] Acquiring lock "91a80cff-7890-4379-812d-93a1312e89ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:17:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5f34b4d0-82dd-4ac7-ac92-a3c2147a7856 req-d920e8ec-f975-4ac4-a23c-342face1d518 service nova] Lock "91a80cff-7890-4379-812d-93a1312e89ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:17:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-5f34b4d0-82dd-4ac7-ac92-a3c2147a7856 req-d920e8ec-f975-4ac4-a23c-342face1d518 service nova] Lock "91a80cff-7890-4379-812d-93a1312e89ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:17:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-5f34b4d0-82dd-4ac7-ac92-a3c2147a7856 req-d920e8ec-f975-4ac4-a23c-342face1d518 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] No waiting events found dispatching network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:17:54 user nova-compute[73104]: WARNING nova.compute.manager [req-5f34b4d0-82dd-4ac7-ac92-a3c2147a7856 req-d920e8ec-f975-4ac4-a23c-342face1d518 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received unexpected event network-vif-plugged-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 for instance with vm_state active and task_state deleting.
Aug 26 09:17:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:17:54 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:17:54 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Took 1.52 seconds to deallocate network for instance.
Aug 26 09:17:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-7047cd38-d357-4523-adb4-f9f861ac76af req-ab231b54-b3e4-4581-a389-9a4a84fd7779 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Received event network-vif-deleted-bd4b382b-e0fc-4d71-a554-0985a3ecdc92 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:17:54 user nova-compute[73104]: INFO nova.compute.manager [req-7047cd38-d357-4523-adb4-f9f861ac76af req-ab231b54-b3e4-4581-a389-9a4a84fd7779 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Neutron deleted interface bd4b382b-e0fc-4d71-a554-0985a3ecdc92; detaching it from the instance and deleting it from the info cache
Aug 26 09:17:54 user nova-compute[73104]: DEBUG nova.network.neutron [req-7047cd38-d357-4523-adb4-f9f861ac76af req-ab231b54-b3e4-4581-a389-9a4a84fd7779 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:17:54 user nova-compute[73104]: DEBUG nova.compute.manager [req-7047cd38-d357-4523-adb4-f9f861ac76af req-ab231b54-b3e4-4581-a389-9a4a84fd7779 service nova] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Detach interface failed, port_id=bd4b382b-e0fc-4d71-a554-0985a3ecdc92, reason: Instance 91a80cff-7890-4379-812d-93a1312e89ce could not be found. {{(pid=73104) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 09:17:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-56a93f2f-beae-4e9d-aa28-454a87daa280 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:17:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-56a93f2f-beae-4e9d-aa28-454a87daa280 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:17:54 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-56a93f2f-beae-4e9d-aa28-454a87daa280 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:17:54 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-56a93f2f-beae-4e9d-aa28-454a87daa280 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:17:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-56a93f2f-beae-4e9d-aa28-454a87daa280 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.187s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:17:54 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-56a93f2f-beae-4e9d-aa28-454a87daa280 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Deleted allocations for instance 91a80cff-7890-4379-812d-93a1312e89ce
Aug 26 09:17:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-56a93f2f-beae-4e9d-aa28-454a87daa280 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "91a80cff-7890-4379-812d-93a1312e89ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.773s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:17:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:18:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:18:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:18:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:18:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:18:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:18:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:18:07 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693041472.850508, 91a80cff-7890-4379-812d-93a1312e89ce => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:18:07 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] VM Stopped (Lifecycle Event)
Aug 26 09:18:07 user nova-compute[73104]: DEBUG nova.compute.manager [None req-2c4646dc-1784-4cab-a46f-5f84d4fd0840 None None] [instance: 91a80cff-7890-4379-812d-93a1312e89ce] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:18:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:18:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:18:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:18:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:18:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:18:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:18:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:18:17 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:18:17 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:18:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:18:21 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:18:21 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:18:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:18:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:18:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:18:21 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:18:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:18:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:18:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:18:22 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:18:22 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:18:22 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:18:22 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:18:22 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:18:22 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:18:22 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:18:22 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:18:22 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:18:22 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:18:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:18:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:18:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:18:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:18:23 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:18:23 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:18:23 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8548MB free_disk=24.051258087158203GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:18:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:18:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:18:24 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:18:24 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 432a66be-853d-42d7-8622-0417ef36045c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:18:24 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 5b7a178a-d831-41db-83b5-f7d056cdb299 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:18:24 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:18:24 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:18:24 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Refreshing inventories for resource provider 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 09:18:24 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Updating ProviderTree inventory for provider 8a2a2397-4d47-4524-8146-84db4225a812 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 09:18:24 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Updating inventory in ProviderTree for provider 8a2a2397-4d47-4524-8146-84db4225a812 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 09:18:24 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Refreshing aggregate associations for resource provider 8a2a2397-4d47-4524-8146-84db4225a812, aggregates: None {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 09:18:24 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Refreshing trait associations for resource provider 8a2a2397-4d47-4524-8146-84db4225a812, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 09:18:24 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:18:24 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:18:24 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:18:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.665s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:18:25 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:18:25 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:18:25 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Rebuilding the list of instances to heal {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 09:18:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-2c10f0ac-f63d-462d-a999-aa98eb6d91f2" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:18:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-2c10f0ac-f63d-462d-a999-aa98eb6d91f2" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:18:25 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 09:18:25 user nova-compute[73104]: DEBUG nova.objects.instance [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lazy-loading 'info_cache' on Instance uuid 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:18:25 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Updating instance_info_cache with network_info: [{"id": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "address": "fa:16:3e:f0:cc:d7", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e91d018-83", "ovs_interfaceid": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:18:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-2c10f0ac-f63d-462d-a999-aa98eb6d91f2" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:18:25 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 09:18:25 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:18:25 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:18:26 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:18:26 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:18:27 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:18:27 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73104) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 09:18:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:18:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:18:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:18:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:18:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:18:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:18:29 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:18:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:18:34 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:18:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:18:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:18:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:18:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:18:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:18:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:18:42 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:18:42 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Cleaning up deleted instances {{(pid=73104) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 09:18:42 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] There are 0 instances to clean {{(pid=73104) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 09:18:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:18:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:18:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:18:50 user nova-compute[73104]: DEBUG nova.compute.manager [req-2f3ba418-89ec-4a35-9b6e-a41d0e37f6af req-3fed9743-02ef-4c1c-94a3-19f17ab05256 service nova] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Received event network-changed-085c1ecf-a75a-4e8a-b61d-7f25578d15c1 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:18:50 user nova-compute[73104]: DEBUG nova.compute.manager [req-2f3ba418-89ec-4a35-9b6e-a41d0e37f6af req-3fed9743-02ef-4c1c-94a3-19f17ab05256 service nova] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Refreshing instance network info cache due to event network-changed-085c1ecf-a75a-4e8a-b61d-7f25578d15c1. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:18:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2f3ba418-89ec-4a35-9b6e-a41d0e37f6af req-3fed9743-02ef-4c1c-94a3-19f17ab05256 service nova] Acquiring lock "refresh_cache-5b7a178a-d831-41db-83b5-f7d056cdb299" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:18:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2f3ba418-89ec-4a35-9b6e-a41d0e37f6af req-3fed9743-02ef-4c1c-94a3-19f17ab05256 service nova] Acquired lock "refresh_cache-5b7a178a-d831-41db-83b5-f7d056cdb299" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:18:50 user nova-compute[73104]: DEBUG nova.network.neutron [req-2f3ba418-89ec-4a35-9b6e-a41d0e37f6af req-3fed9743-02ef-4c1c-94a3-19f17ab05256 service nova] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Refreshing network info cache for port 085c1ecf-a75a-4e8a-b61d-7f25578d15c1 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:18:50 user nova-compute[73104]: DEBUG nova.network.neutron [req-2f3ba418-89ec-4a35-9b6e-a41d0e37f6af req-3fed9743-02ef-4c1c-94a3-19f17ab05256 service nova] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Updated VIF entry in instance network info cache for port 085c1ecf-a75a-4e8a-b61d-7f25578d15c1. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:18:50 user nova-compute[73104]: DEBUG nova.network.neutron [req-2f3ba418-89ec-4a35-9b6e-a41d0e37f6af req-3fed9743-02ef-4c1c-94a3-19f17ab05256 service nova] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Updating instance_info_cache with network_info: [{"id": "085c1ecf-a75a-4e8a-b61d-7f25578d15c1", "address": "fa:16:3e:f8:ac:3e", "network": {"id": "a2f3e73a-66a3-4ad7-b362-1747ad158dc8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1518509383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c66f2ed2ec19430a9cc5c1456111d641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085c1ecf-a7", "ovs_interfaceid": "085c1ecf-a75a-4e8a-b61d-7f25578d15c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:18:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-2f3ba418-89ec-4a35-9b6e-a41d0e37f6af req-3fed9743-02ef-4c1c-94a3-19f17ab05256 service nova] Releasing lock "refresh_cache-5b7a178a-d831-41db-83b5-f7d056cdb299" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:18:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:18:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:18:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:18:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:18:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:18:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:18:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:18:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a3c6bc9c-a8ef-4e6d-9f85-262c589693cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "432a66be-853d-42d7-8622-0417ef36045c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:18:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a3c6bc9c-a8ef-4e6d-9f85-262c589693cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "432a66be-853d-42d7-8622-0417ef36045c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:18:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a3c6bc9c-a8ef-4e6d-9f85-262c589693cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "432a66be-853d-42d7-8622-0417ef36045c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:18:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a3c6bc9c-a8ef-4e6d-9f85-262c589693cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "432a66be-853d-42d7-8622-0417ef36045c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:18:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a3c6bc9c-a8ef-4e6d-9f85-262c589693cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "432a66be-853d-42d7-8622-0417ef36045c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:18:57 user nova-compute[73104]: INFO nova.compute.manager [None req-a3c6bc9c-a8ef-4e6d-9f85-262c589693cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Terminating instance
Aug 26 09:18:57 user nova-compute[73104]: DEBUG nova.compute.manager [None req-a3c6bc9c-a8ef-4e6d-9f85-262c589693cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 09:18:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:18:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:18:57 user nova-compute[73104]: DEBUG nova.compute.manager [req-e6617032-1680-48e6-9077-eb3e43ce9974 req-6a2e8761-3d12-4add-a0d1-d6c7b854ea55 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Received event network-vif-unplugged-52b25498-8470-454f-9cf5-4989ec64751a {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:18:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e6617032-1680-48e6-9077-eb3e43ce9974 req-6a2e8761-3d12-4add-a0d1-d6c7b854ea55 service nova] Acquiring lock "432a66be-853d-42d7-8622-0417ef36045c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:18:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e6617032-1680-48e6-9077-eb3e43ce9974 req-6a2e8761-3d12-4add-a0d1-d6c7b854ea55 service nova] Lock "432a66be-853d-42d7-8622-0417ef36045c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:18:57 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e6617032-1680-48e6-9077-eb3e43ce9974 req-6a2e8761-3d12-4add-a0d1-d6c7b854ea55 service nova] Lock "432a66be-853d-42d7-8622-0417ef36045c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:18:57 user nova-compute[73104]: DEBUG nova.compute.manager [req-e6617032-1680-48e6-9077-eb3e43ce9974 req-6a2e8761-3d12-4add-a0d1-d6c7b854ea55 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] No waiting events found dispatching network-vif-unplugged-52b25498-8470-454f-9cf5-4989ec64751a {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:18:57 user nova-compute[73104]: DEBUG nova.compute.manager [req-e6617032-1680-48e6-9077-eb3e43ce9974 req-6a2e8761-3d12-4add-a0d1-d6c7b854ea55 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Received event network-vif-unplugged-52b25498-8470-454f-9cf5-4989ec64751a for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 09:18:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:18:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:18:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:18:58 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Instance destroyed successfully.
Aug 26 09:18:58 user nova-compute[73104]: DEBUG nova.objects.instance [None req-a3c6bc9c-a8ef-4e6d-9f85-262c589693cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lazy-loading 'resources' on Instance uuid 432a66be-853d-42d7-8622-0417ef36045c {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:18:58 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-a3c6bc9c-a8ef-4e6d-9f85-262c589693cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:02:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-735563407',display_name='tempest-ServerRescueNegativeTestJSON-server-735563407',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-735563407',id=42,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T09:04:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b7642d165474defadde34dabc11f842',ramdisk_id='',reservation_id='r-xran4wdf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-901062798',owner_user_name='tempest-ServerRescueNegativeTestJSON-901062798-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T09:04:34Z,user_data=None,user_id='da4b6574d165418eaf2b8c8b84d6151f',uuid=432a66be-853d-42d7-8622-0417ef36045c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "52b25498-8470-454f-9cf5-4989ec64751a", "address": "fa:16:3e:76:d4:93", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b25498-84", "ovs_interfaceid": "52b25498-8470-454f-9cf5-4989ec64751a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 09:18:58 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-a3c6bc9c-a8ef-4e6d-9f85-262c589693cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Converting VIF {"id": "52b25498-8470-454f-9cf5-4989ec64751a", "address": "fa:16:3e:76:d4:93", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b25498-84", "ovs_interfaceid": "52b25498-8470-454f-9cf5-4989ec64751a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:18:58 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-a3c6bc9c-a8ef-4e6d-9f85-262c589693cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:d4:93,bridge_name='br-int',has_traffic_filtering=True,id=52b25498-8470-454f-9cf5-4989ec64751a,network=Network(fb2d19ab-1c79-4529-b058-e1b8c4fc8276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52b25498-84') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:18:58 user nova-compute[73104]: DEBUG os_vif [None req-a3c6bc9c-a8ef-4e6d-9f85-262c589693cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:d4:93,bridge_name='br-int',has_traffic_filtering=True,id=52b25498-8470-454f-9cf5-4989ec64751a,network=Network(fb2d19ab-1c79-4529-b058-e1b8c4fc8276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52b25498-84') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 09:18:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:18:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52b25498-84, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:18:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:18:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:18:58 user nova-compute[73104]: INFO os_vif [None req-a3c6bc9c-a8ef-4e6d-9f85-262c589693cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:d4:93,bridge_name='br-int',has_traffic_filtering=True,id=52b25498-8470-454f-9cf5-4989ec64751a,network=Network(fb2d19ab-1c79-4529-b058-e1b8c4fc8276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52b25498-84')
Aug 26 09:18:58 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-a3c6bc9c-a8ef-4e6d-9f85-262c589693cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Deleting instance files /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c_del
Aug 26 09:18:58 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-a3c6bc9c-a8ef-4e6d-9f85-262c589693cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Deletion of /opt/stack/data/nova/instances/432a66be-853d-42d7-8622-0417ef36045c_del complete
Aug 26 09:18:58 user nova-compute[73104]: INFO nova.compute.manager [None req-a3c6bc9c-a8ef-4e6d-9f85-262c589693cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 26 09:18:58 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-a3c6bc9c-a8ef-4e6d-9f85-262c589693cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 09:18:58 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 09:18:58 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 432a66be-853d-42d7-8622-0417ef36045c] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 09:18:58 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:18:58 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Took 0.49 seconds to deallocate network for instance.
Aug 26 09:18:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a3c6bc9c-a8ef-4e6d-9f85-262c589693cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:18:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a3c6bc9c-a8ef-4e6d-9f85-262c589693cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:18:59 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-a3c6bc9c-a8ef-4e6d-9f85-262c589693cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:18:59 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-a3c6bc9c-a8ef-4e6d-9f85-262c589693cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:18:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a3c6bc9c-a8ef-4e6d-9f85-262c589693cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.170s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:18:59 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-a3c6bc9c-a8ef-4e6d-9f85-262c589693cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Deleted allocations for instance 432a66be-853d-42d7-8622-0417ef36045c
Aug 26 09:18:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a3c6bc9c-a8ef-4e6d-9f85-262c589693cc tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "432a66be-853d-42d7-8622-0417ef36045c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.836s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:18:59 user nova-compute[73104]: DEBUG nova.compute.manager [req-3edb385a-8b71-42bd-8d46-5626a642cf56 req-8d1b6216-38ee-4faa-8ac4-f47136f204a8 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Received event network-vif-plugged-52b25498-8470-454f-9cf5-4989ec64751a {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:18:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3edb385a-8b71-42bd-8d46-5626a642cf56 req-8d1b6216-38ee-4faa-8ac4-f47136f204a8 service nova] Acquiring lock "432a66be-853d-42d7-8622-0417ef36045c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:18:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3edb385a-8b71-42bd-8d46-5626a642cf56 req-8d1b6216-38ee-4faa-8ac4-f47136f204a8 service nova] Lock "432a66be-853d-42d7-8622-0417ef36045c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:18:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-3edb385a-8b71-42bd-8d46-5626a642cf56 req-8d1b6216-38ee-4faa-8ac4-f47136f204a8 service nova] Lock "432a66be-853d-42d7-8622-0417ef36045c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:18:59 user nova-compute[73104]: DEBUG nova.compute.manager [req-3edb385a-8b71-42bd-8d46-5626a642cf56 req-8d1b6216-38ee-4faa-8ac4-f47136f204a8 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] No waiting events found dispatching network-vif-plugged-52b25498-8470-454f-9cf5-4989ec64751a {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:18:59 user nova-compute[73104]: WARNING nova.compute.manager [req-3edb385a-8b71-42bd-8d46-5626a642cf56 req-8d1b6216-38ee-4faa-8ac4-f47136f204a8 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Received unexpected event network-vif-plugged-52b25498-8470-454f-9cf5-4989ec64751a for instance with vm_state deleted and task_state None.
Aug 26 09:18:59 user nova-compute[73104]: DEBUG nova.compute.manager [req-3edb385a-8b71-42bd-8d46-5626a642cf56 req-8d1b6216-38ee-4faa-8ac4-f47136f204a8 service nova] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Received event network-vif-deleted-52b25498-8470-454f-9cf5-4989ec64751a {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:19:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:19:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Acquiring lock "5b7a178a-d831-41db-83b5-f7d056cdb299" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:19:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:19:01 user nova-compute[73104]: DEBUG nova.objects.instance [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lazy-loading 'flavor' on Instance uuid 5b7a178a-d831-41db-83b5-f7d056cdb299 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:19:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:19:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Acquiring lock "5b7a178a-d831-41db-83b5-f7d056cdb299" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:19:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:19:01 user nova-compute[73104]: INFO nova.compute.manager [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Attaching volume 23823d8e-3101-4373-b68b-c4355a6bc77c to /dev/vdb
Aug 26 09:19:01 user nova-compute[73104]: DEBUG os_brick.utils [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:19:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:19:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:19:01 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0565359-cdae-4bd9-a895-f5f42a5e9043]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:19:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:19:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:19:01 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[af96bc30-eec1-42cf-a845-51dddca88109]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:19:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:19:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:19:01 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[df11f86f-6915-43d0-b6aa-f629eea22bb6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:19:01 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6ebbd0-5258-410c-82eb-68977d590070]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:19:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:19:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:19:01 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 09:19:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:19:01 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:19:01 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 09:19:01 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba64ea1-a002-4b71-a004-0d43d4113568]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:19:01 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 09:19:01 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 09:19:01 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 09:19:01 user nova-compute[73104]: DEBUG os_brick.utils [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:19:01 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Updating existing volume attachment record: 0c43dca5-c072-4af4-ae65-0b131860797b {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 09:19:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:19:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:19:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:19:11 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 09:19:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KALhODSf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:19:11 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:19:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:19:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:19:11 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:19:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:19:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:19:11 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 09:19:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:19:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:19:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfa6a8b-f0ac-4f25-a4b0-7f6cf46e59d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:19:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 09:19:11 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:19:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:19:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:19:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa8b347-d87f-4c25-95d2-8b757af99a43]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:19:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c] added
Aug 26 09:19:11 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:19:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:19:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:19:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[422143ca-2903-46fa-b7da-7a4129d7ae02]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:19:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:19:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:19:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:19:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32d902f-0e12-4c2b-a302-9f1f6c0d9eac]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:19:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:19:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KALhODSf {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:19:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KALhODSf" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:19:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae5b9f0-39d0-4fc3-a25d-e3d573a038ba]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:19:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KALhODSf'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:19:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:19:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:19:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[71013d23-202f-4627-9847-fcc1df06d652]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:19:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:19:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:19:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:19:11 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[473d3aa7-1434-4eb9-9aa3-28ecf04b1227]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:19:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 09:19:11 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:19:11 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 09:19:11 user nova-compute[73104]:  {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:19:11 user nova-compute[73104]: WARNING os_brick.initiator.connectors.iscsi [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 09:19:11 user nova-compute[73104]: 
Aug 26 09:19:11 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:19:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:19:12 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd39a7ef-d704-4fab-b58f-1a60ad267fec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:19:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c, portal: 172.16.0.220,3260]
Aug 26 09:19:12 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c, portal: 172.16.0.220,3260] successful.
Aug 26 09:19:12 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:19:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:19:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:19:12 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdef547c-8280-47f6-bd45-c848076eaa2b]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:19:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:19:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:19:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:19:12 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0f80ee-3516-4e94-bd40-a3be7b6dbea1]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:19:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c (non-flash)
Aug 26 09:19:12 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:19:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c (non-flash)
Aug 26 09:19:12 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:19:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:19:12 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 09:19:12 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 09:19:12 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 09:19:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:19:12 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:19:12 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[06003ad4-e626-4628-8b10-c7fec84d2506]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:19:12 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 09:19:13 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 09:19:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KALhODSf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 09:19:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:19:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23733333333373937', 'path': '/dev/sdb'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:19:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733333333373937', 'path': '/dev/sdb'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 09:19:13 user nova-compute[73104]: DEBUG nova.objects.instance [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lazy-loading 'flavor' on Instance uuid 5b7a178a-d831-41db-83b5-f7d056cdb299 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:19:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 09:19:13 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:19:13 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 09:19:13 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:19:13 user nova-compute[73104]:   <serial>23823d8e-3101-4373-b68b-c4355a6bc77c</serial>
Aug 26 09:19:13 user nova-compute[73104]: </disk>
Aug 26 09:19:13 user nova-compute[73104]:  {{(pid=73104) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 09:19:13 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693041538.3509314, 432a66be-853d-42d7-8622-0417ef36045c => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:19:13 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 432a66be-853d-42d7-8622-0417ef36045c] VM Stopped (Lifecycle Event)
Aug 26 09:19:13 user nova-compute[73104]: DEBUG nova.compute.manager [None req-1e2e873c-afe0-4dba-8aa9-1b3a6b59f93c None None] [instance: 432a66be-853d-42d7-8622-0417ef36045c] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:19:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:19:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:19:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:19:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] No VIF found with MAC fa:16:3e:f8:ac:3e, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 09:19:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-58a4d264-bd34-4c86-80e2-94c87d832992 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.181s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:19:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:19:17 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:19:17 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:19:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:19:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:19:21 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:19:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:19:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:19:21 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:19:21 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:19:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:19:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:19:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:19:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:19:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:19:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:19:21 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:19:22 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:19:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73104) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 09:19:22 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:19:22 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:19:22 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8642MB free_disk=24.077957153320312GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:19:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:19:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:19:22 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:19:22 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 5b7a178a-d831-41db-83b5-f7d056cdb299 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:19:22 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:19:22 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:19:22 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:19:22 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:19:22 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:19:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.211s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:19:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:19:23 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:19:24 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:19:25 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:19:26 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:19:26 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:19:26 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:19:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-5b7a178a-d831-41db-83b5-f7d056cdb299" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:19:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-5b7a178a-d831-41db-83b5-f7d056cdb299" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:19:26 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 09:19:26 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Updating instance_info_cache with network_info: [{"id": "085c1ecf-a75a-4e8a-b61d-7f25578d15c1", "address": "fa:16:3e:f8:ac:3e", "network": {"id": "a2f3e73a-66a3-4ad7-b362-1747ad158dc8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1518509383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c66f2ed2ec19430a9cc5c1456111d641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085c1ecf-a7", "ovs_interfaceid": "085c1ecf-a75a-4e8a-b61d-7f25578d15c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:19:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-5b7a178a-d831-41db-83b5-f7d056cdb299" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:19:26 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 09:19:26 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:19:27 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:19:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:19:29 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:19:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:19:33 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:19:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:19:35 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:19:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:19:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:19:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a323fe3e-c020-4656-b995-a044dbe1177e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Acquiring lock "5b7a178a-d831-41db-83b5-f7d056cdb299" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:19:43 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a323fe3e-c020-4656-b995-a044dbe1177e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:19:43 user nova-compute[73104]: INFO nova.compute.manager [None req-a323fe3e-c020-4656-b995-a044dbe1177e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Detaching volume 23823d8e-3101-4373-b68b-c4355a6bc77c
Aug 26 09:19:44 user nova-compute[73104]: INFO nova.virt.block_device [None req-a323fe3e-c020-4656-b995-a044dbe1177e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Attempting to driver detach volume 23823d8e-3101-4373-b68b-c4355a6bc77c from mountpoint /dev/vdb
Aug 26 09:19:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a323fe3e-c020-4656-b995-a044dbe1177e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Attempting to detach device vdb from instance 5b7a178a-d831-41db-83b5-f7d056cdb299 from the persistent domain config. {{(pid=73104) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-a323fe3e-c020-4656-b995-a044dbe1177e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 09:19:44 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:19:44 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 09:19:44 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:19:44 user nova-compute[73104]:   <serial>23823d8e-3101-4373-b68b-c4355a6bc77c</serial>
Aug 26 09:19:44 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 09:19:44 user nova-compute[73104]: </disk>
Aug 26 09:19:44 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 09:19:44 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-a323fe3e-c020-4656-b995-a044dbe1177e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Successfully detached device vdb from instance 5b7a178a-d831-41db-83b5-f7d056cdb299 from the persistent domain config.
Aug 26 09:19:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a323fe3e-c020-4656-b995-a044dbe1177e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5b7a178a-d831-41db-83b5-f7d056cdb299 from the live domain config. {{(pid=73104) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-a323fe3e-c020-4656-b995-a044dbe1177e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 09:19:44 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:19:44 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 09:19:44 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:19:44 user nova-compute[73104]:   <serial>23823d8e-3101-4373-b68b-c4355a6bc77c</serial>
Aug 26 09:19:44 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 09:19:44 user nova-compute[73104]: </disk>
Aug 26 09:19:44 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Received event <DeviceRemovedEvent: 1693041584.5200477, 5b7a178a-d831-41db-83b5-f7d056cdb299 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73104) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a323fe3e-c020-4656-b995-a044dbe1177e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5b7a178a-d831-41db-83b5-f7d056cdb299 {{(pid=73104) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 09:19:44 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-a323fe3e-c020-4656-b995-a044dbe1177e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Successfully detached device vdb from instance 5b7a178a-d831-41db-83b5-f7d056cdb299 from the live domain config.
Aug 26 09:19:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a323fe3e-c020-4656-b995-a044dbe1177e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a323fe3e-c020-4656-b995-a044dbe1177e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KALhODSf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:19:44 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-a323fe3e-c020-4656-b995-a044dbe1177e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:19:44 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-a323fe3e-c020-4656-b995-a044dbe1177e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-a323fe3e-c020-4656-b995-a044dbe1177e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a323fe3e-c020-4656-b995-a044dbe1177e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[309a2094-ac86-43b3-a77f-5073b0d7b0ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4880f64c-8d41-4825-a90c-3e97283fd411]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a323fe3e-c020-4656-b995-a044dbe1177e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c (non-flash)
Aug 26 09:19:44 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a323fe3e-c020-4656-b995-a044dbe1177e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c (non-flash)
Aug 26 09:19:44 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a323fe3e-c020-4656-b995-a044dbe1177e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b4794af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c'): ({'sdb'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-a323fe3e-c020-4656-b995-a044dbe1177e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Removing single pathed devices sdb {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6d191c-51b5-4e09-aa84-be9a25b99431]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ada5962-4995-4fb5-aeca-ac94684a178b]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-a323fe3e-c020-4656-b995-a044dbe1177e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Flushing IO for device /dev/sdb {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f97f64-def2-46df-bef3-9f02543b0be3]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-a323fe3e-c020-4656-b995-a044dbe1177e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f55e38-50c9-4a76-ab30-5f94b9de8e83]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-a323fe3e-c020-4656-b995-a044dbe1177e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-a323fe3e-c020-4656-b995-a044dbe1177e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a323fe3e-c020-4656-b995-a044dbe1177e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[62191cda-8097-40ec-83e7-75d30356cd13]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a323fe3e-c020-4656-b995-a044dbe1177e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[192bbea3-dae5-43d3-9f91-70c4501179cc]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a323fe3e-c020-4656-b995-a044dbe1177e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c, portal: 172.16.0.220,3260]
Aug 26 09:19:44 user nova-compute[73104]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c, portal: 172.16.0.220,3260] successful.
Aug 26 09:19:44 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23823d8e-3101-4373-b68b-c4355a6bc77c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e84c2a-597f-4642-86a1-11514530a764]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a323fe3e-c020-4656-b995-a044dbe1177e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-a323fe3e-c020-4656-b995-a044dbe1177e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.245s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a323fe3e-c020-4656-b995-a044dbe1177e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] <== disconnect_volume: return (247ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:19:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a323fe3e-c020-4656-b995-a044dbe1177e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 09:19:45 user nova-compute[73104]: DEBUG nova.objects.instance [None req-a323fe3e-c020-4656-b995-a044dbe1177e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lazy-loading 'flavor' on Instance uuid 5b7a178a-d831-41db-83b5-f7d056cdb299 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:19:45 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a323fe3e-c020-4656-b995-a044dbe1177e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.581s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:19:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-4d7b3316-6a9a-4727-9826-d9cb4e1c86c0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:19:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-4d7b3316-6a9a-4727-9826-d9cb4e1c86c0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:19:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-4d7b3316-6a9a-4727-9826-d9cb4e1c86c0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:19:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-4d7b3316-6a9a-4727-9826-d9cb4e1c86c0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:19:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-4d7b3316-6a9a-4727-9826-d9cb4e1c86c0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:19:48 user nova-compute[73104]: INFO nova.compute.manager [None req-4d7b3316-6a9a-4727-9826-d9cb4e1c86c0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Terminating instance
Aug 26 09:19:48 user nova-compute[73104]: DEBUG nova.compute.manager [None req-4d7b3316-6a9a-4727-9826-d9cb4e1c86c0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 09:19:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:19:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:19:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:19:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:19:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:19:48 user nova-compute[73104]: DEBUG nova.compute.manager [req-1b1b971b-e5ab-4f69-9cb8-b14353727960 req-c395a89a-3416-4e27-bc01-5be707339bdd service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Received event network-vif-unplugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:19:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1b1b971b-e5ab-4f69-9cb8-b14353727960 req-c395a89a-3416-4e27-bc01-5be707339bdd service nova] Acquiring lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:19:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1b1b971b-e5ab-4f69-9cb8-b14353727960 req-c395a89a-3416-4e27-bc01-5be707339bdd service nova] Lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:19:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-1b1b971b-e5ab-4f69-9cb8-b14353727960 req-c395a89a-3416-4e27-bc01-5be707339bdd service nova] Lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:19:48 user nova-compute[73104]: DEBUG nova.compute.manager [req-1b1b971b-e5ab-4f69-9cb8-b14353727960 req-c395a89a-3416-4e27-bc01-5be707339bdd service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] No waiting events found dispatching network-vif-unplugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:19:48 user nova-compute[73104]: DEBUG nova.compute.manager [req-1b1b971b-e5ab-4f69-9cb8-b14353727960 req-c395a89a-3416-4e27-bc01-5be707339bdd service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Received event network-vif-unplugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 09:19:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:19:48 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Instance destroyed successfully.
Aug 26 09:19:48 user nova-compute[73104]: DEBUG nova.objects.instance [None req-4d7b3316-6a9a-4727-9826-d9cb4e1c86c0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lazy-loading 'resources' on Instance uuid 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:19:48 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-4d7b3316-6a9a-4727-9826-d9cb4e1c86c0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-636224961',display_name='tempest-ServerRescueNegativeTestJSON-server-636224961',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-636224961',id=41,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T09:07:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b7642d165474defadde34dabc11f842',ramdisk_id='',reservation_id='r-dt3wsa96',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-901062798',owner_user_name='tempest-ServerRescueNegativeTestJSON-901062798-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T09:09:19Z,user_data=None,user_id='da4b6574d165418eaf2b8c8b84d6151f',uuid=2c10f0ac-f63d-462d-a999-aa98eb6d91f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "address": "fa:16:3e:f0:cc:d7", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e91d018-83", "ovs_interfaceid": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 09:19:48 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-4d7b3316-6a9a-4727-9826-d9cb4e1c86c0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Converting VIF {"id": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "address": "fa:16:3e:f0:cc:d7", "network": {"id": "fb2d19ab-1c79-4529-b058-e1b8c4fc8276", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1523416620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b7642d165474defadde34dabc11f842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e91d018-83", "ovs_interfaceid": "5e91d018-838e-4b87-bd5f-1b5f31c22d5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:19:48 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-4d7b3316-6a9a-4727-9826-d9cb4e1c86c0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:cc:d7,bridge_name='br-int',has_traffic_filtering=True,id=5e91d018-838e-4b87-bd5f-1b5f31c22d5f,network=Network(fb2d19ab-1c79-4529-b058-e1b8c4fc8276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e91d018-83') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:19:48 user nova-compute[73104]: DEBUG os_vif [None req-4d7b3316-6a9a-4727-9826-d9cb4e1c86c0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:cc:d7,bridge_name='br-int',has_traffic_filtering=True,id=5e91d018-838e-4b87-bd5f-1b5f31c22d5f,network=Network(fb2d19ab-1c79-4529-b058-e1b8c4fc8276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e91d018-83') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 09:19:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:19:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e91d018-83, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:19:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:19:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:19:48 user nova-compute[73104]: INFO os_vif [None req-4d7b3316-6a9a-4727-9826-d9cb4e1c86c0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:cc:d7,bridge_name='br-int',has_traffic_filtering=True,id=5e91d018-838e-4b87-bd5f-1b5f31c22d5f,network=Network(fb2d19ab-1c79-4529-b058-e1b8c4fc8276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e91d018-83')
Aug 26 09:19:48 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-4d7b3316-6a9a-4727-9826-d9cb4e1c86c0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Deleting instance files /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2_del
Aug 26 09:19:48 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-4d7b3316-6a9a-4727-9826-d9cb4e1c86c0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Deletion of /opt/stack/data/nova/instances/2c10f0ac-f63d-462d-a999-aa98eb6d91f2_del complete
Aug 26 09:19:48 user nova-compute[73104]: INFO nova.compute.manager [None req-4d7b3316-6a9a-4727-9826-d9cb4e1c86c0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 26 09:19:48 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-4d7b3316-6a9a-4727-9826-d9cb4e1c86c0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 09:19:48 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 09:19:48 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 09:19:49 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:19:49 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Took 0.57 seconds to deallocate network for instance.
Aug 26 09:19:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-4d7b3316-6a9a-4727-9826-d9cb4e1c86c0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:19:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-4d7b3316-6a9a-4727-9826-d9cb4e1c86c0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:19:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-b8eb9459-ab8d-4e23-ab5d-8c97a5641eae req-ef32b8cf-ed22-4105-a6e3-c3e2a0c337a8 service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Received event network-vif-deleted-5e91d018-838e-4b87-bd5f-1b5f31c22d5f {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:19:49 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-4d7b3316-6a9a-4727-9826-d9cb4e1c86c0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:19:49 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-4d7b3316-6a9a-4727-9826-d9cb4e1c86c0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:19:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-4d7b3316-6a9a-4727-9826-d9cb4e1c86c0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:19:49 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-4d7b3316-6a9a-4727-9826-d9cb4e1c86c0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Deleted allocations for instance 2c10f0ac-f63d-462d-a999-aa98eb6d91f2
Aug 26 09:19:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-4d7b3316-6a9a-4727-9826-d9cb4e1c86c0 tempest-ServerRescueNegativeTestJSON-901062798 tempest-ServerRescueNegativeTestJSON-901062798-project-member] Lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.754s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:19:50 user nova-compute[73104]: DEBUG nova.compute.manager [req-264784e1-d938-453c-bc7a-32e68cdce581 req-647755c5-13c4-4b3a-89d3-4b10998466db service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Received event network-vif-plugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:19:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-264784e1-d938-453c-bc7a-32e68cdce581 req-647755c5-13c4-4b3a-89d3-4b10998466db service nova] Acquiring lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:19:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-264784e1-d938-453c-bc7a-32e68cdce581 req-647755c5-13c4-4b3a-89d3-4b10998466db service nova] Lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:19:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-264784e1-d938-453c-bc7a-32e68cdce581 req-647755c5-13c4-4b3a-89d3-4b10998466db service nova] Lock "2c10f0ac-f63d-462d-a999-aa98eb6d91f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:19:50 user nova-compute[73104]: DEBUG nova.compute.manager [req-264784e1-d938-453c-bc7a-32e68cdce581 req-647755c5-13c4-4b3a-89d3-4b10998466db service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] No waiting events found dispatching network-vif-plugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:19:50 user nova-compute[73104]: WARNING nova.compute.manager [req-264784e1-d938-453c-bc7a-32e68cdce581 req-647755c5-13c4-4b3a-89d3-4b10998466db service nova] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Received unexpected event network-vif-plugged-5e91d018-838e-4b87-bd5f-1b5f31c22d5f for instance with vm_state deleted and task_state None.
Aug 26 09:19:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:19:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:19:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:19:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:19:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:19:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:19:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:20:03 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693041588.834426, 2c10f0ac-f63d-462d-a999-aa98eb6d91f2 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:20:03 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] VM Stopped (Lifecycle Event)
Aug 26 09:20:03 user nova-compute[73104]: DEBUG nova.compute.manager [None req-91693e67-9753-4531-8557-03adb3cd6732 None None] [instance: 2c10f0ac-f63d-462d-a999-aa98eb6d91f2] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:20:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:20:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:20:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:20:18 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:20:18 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:20:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:20:23 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:20:23 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:20:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:20:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:20:23 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:20:23 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:20:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:20:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:20:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:20:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:20:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:20:24 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:20:24 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:20:24 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8724MB free_disk=24.10511016845703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:20:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:20:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:20:24 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 5b7a178a-d831-41db-83b5-f7d056cdb299 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:20:24 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:20:24 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:20:24 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:20:24 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:20:24 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:20:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.206s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:20:26 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:20:27 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:20:27 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:20:27 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:20:27 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Rebuilding the list of instances to heal {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 09:20:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-5b7a178a-d831-41db-83b5-f7d056cdb299" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:20:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-5b7a178a-d831-41db-83b5-f7d056cdb299" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:20:27 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 09:20:27 user nova-compute[73104]: DEBUG nova.objects.instance [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lazy-loading 'info_cache' on Instance uuid 5b7a178a-d831-41db-83b5-f7d056cdb299 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:20:27 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Updating instance_info_cache with network_info: [{"id": "085c1ecf-a75a-4e8a-b61d-7f25578d15c1", "address": "fa:16:3e:f8:ac:3e", "network": {"id": "a2f3e73a-66a3-4ad7-b362-1747ad158dc8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1518509383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c66f2ed2ec19430a9cc5c1456111d641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085c1ecf-a7", "ovs_interfaceid": "085c1ecf-a75a-4e8a-b61d-7f25578d15c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:20:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-5b7a178a-d831-41db-83b5-f7d056cdb299" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:20:27 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 09:20:27 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:20:28 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:20:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:20:29 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:20:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:20:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Acquiring lock "5b7a178a-d831-41db-83b5-f7d056cdb299" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:20:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:20:38 user nova-compute[73104]: DEBUG nova.objects.instance [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lazy-loading 'flavor' on Instance uuid 5b7a178a-d831-41db-83b5-f7d056cdb299 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:20:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:20:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Acquiring lock "5b7a178a-d831-41db-83b5-f7d056cdb299" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:20:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:20:38 user nova-compute[73104]: INFO nova.compute.manager [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Attaching volume 5ff2160f-ee5d-47d2-8548-239871ca8c7e to /dev/vdb
Aug 26 09:20:38 user nova-compute[73104]: DEBUG os_brick.utils [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:20:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:20:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:20:38 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5762022d-92db-412b-addd-4b0b4e0036d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:20:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:20:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:20:38 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[22670766-dd1a-4071-810c-3ab9c1b3a790]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:20:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:20:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:20:38 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[038a1b54-3c3e-4cc2-a962-346cb053c7c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:20:38 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a899c25c-8841-4bed-be04-0a99efaa78e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:20:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:20:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:20:38 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 09:20:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:20:38 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:20:38 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 09:20:38 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[122a79fe-7706-4623-8d22-b46e3f6baa67]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:20:38 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 09:20:38 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 09:20:38 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 09:20:38 user nova-compute[73104]: DEBUG os_brick.utils [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:20:38 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Updating existing volume attachment record: 334f1d22-6a01-4c96-a251-17e052047f2b {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 09:20:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:20:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:20:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:20:41 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:20:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mJCITzUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:20:48 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:20:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:20:48 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:20:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:20:48 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 09:20:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a385f0-98d6-4691-8a0e-5bf5a18b3a97]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 09:20:48 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a83b78-76ac-4538-9092-6ac588d55709]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e] added
Aug 26 09:20:48 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ead25d-e54a-445d-9d75-fff86bb486fe]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcdf452-bbb4-4309-a579-c8ff260e4214]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mJCITzUr {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mJCITzUr" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf191ae9-5543-480e-a3a4-fdfebefdb38d]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mJCITzUr'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e181242-5712-4bff-be8c-2421f212d3ad]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a261e89-141e-4ff4-9b82-690f86088a40]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 09:20:48 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 09:20:48 user nova-compute[73104]:  {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:20:48 user nova-compute[73104]: WARNING os_brick.initiator.connectors.iscsi [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 09:20:48 user nova-compute[73104]: 
Aug 26 09:20:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[de43dad1-4492-42ad-b86b-563b7390d83c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e, portal: 172.16.0.220,3260]
Aug 26 09:20:48 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e, portal: 172.16.0.220,3260] successful.
Aug 26 09:20:48 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[88567e95-717e-4ac9-babd-1ee5386b7c94]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ab5f42-8e4d-4aef-a9cf-3eb28d3f78f6]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e (non-flash)
Aug 26 09:20:48 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e (non-flash)
Aug 26 09:20:48 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30e16f6-975d-4348-a723-99aad7ee6778]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:20:48 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 09:20:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:20:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:20:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:20:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:20:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:20:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:20:49 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 09:20:49 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mJCITzUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 09:20:49 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:20:49 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23038323161303331', 'path': '/dev/sdb'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:20:49 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038323161303331', 'path': '/dev/sdb'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 09:20:49 user nova-compute[73104]: DEBUG nova.objects.instance [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lazy-loading 'flavor' on Instance uuid 5b7a178a-d831-41db-83b5-f7d056cdb299 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:20:49 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 09:20:49 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:20:49 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 09:20:49 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:20:49 user nova-compute[73104]:   <serial>5ff2160f-ee5d-47d2-8548-239871ca8c7e</serial>
Aug 26 09:20:49 user nova-compute[73104]: </disk>
Aug 26 09:20:49 user nova-compute[73104]:  {{(pid=73104) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 09:20:50 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:20:50 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:20:50 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] No VIF found with MAC fa:16:3e:f8:ac:3e, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 09:20:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-2b7b399e-6b30-4769-88cd-6bfb1c364413 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.145s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:20:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7a327f1c-52ca-4b8c-94c5-0e6a3a626286 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Acquiring lock "5b7a178a-d831-41db-83b5-f7d056cdb299" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:20:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7a327f1c-52ca-4b8c-94c5-0e6a3a626286 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:20:52 user nova-compute[73104]: INFO nova.compute.manager [None req-7a327f1c-52ca-4b8c-94c5-0e6a3a626286 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Detaching volume 5ff2160f-ee5d-47d2-8548-239871ca8c7e
Aug 26 09:20:52 user nova-compute[73104]: INFO nova.virt.block_device [None req-7a327f1c-52ca-4b8c-94c5-0e6a3a626286 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Attempting to driver detach volume 5ff2160f-ee5d-47d2-8548-239871ca8c7e from mountpoint /dev/vdb
Aug 26 09:20:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-7a327f1c-52ca-4b8c-94c5-0e6a3a626286 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Attempting to detach device vdb from instance 5b7a178a-d831-41db-83b5-f7d056cdb299 from the persistent domain config. {{(pid=73104) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 09:20:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-7a327f1c-52ca-4b8c-94c5-0e6a3a626286 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 09:20:52 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:20:52 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 09:20:52 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:20:52 user nova-compute[73104]:   <serial>5ff2160f-ee5d-47d2-8548-239871ca8c7e</serial>
Aug 26 09:20:52 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 09:20:52 user nova-compute[73104]: </disk>
Aug 26 09:20:52 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 09:20:52 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-7a327f1c-52ca-4b8c-94c5-0e6a3a626286 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Successfully detached device vdb from instance 5b7a178a-d831-41db-83b5-f7d056cdb299 from the persistent domain config.
Aug 26 09:20:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-7a327f1c-52ca-4b8c-94c5-0e6a3a626286 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5b7a178a-d831-41db-83b5-f7d056cdb299 from the live domain config. {{(pid=73104) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 09:20:52 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-7a327f1c-52ca-4b8c-94c5-0e6a3a626286 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 09:20:52 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:20:52 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 09:20:52 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:20:52 user nova-compute[73104]:   <serial>5ff2160f-ee5d-47d2-8548-239871ca8c7e</serial>
Aug 26 09:20:52 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 09:20:52 user nova-compute[73104]: </disk>
Aug 26 09:20:52 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Received event <DeviceRemovedEvent: 1693041653.1936402, 5b7a178a-d831-41db-83b5-f7d056cdb299 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73104) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-7a327f1c-52ca-4b8c-94c5-0e6a3a626286 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5b7a178a-d831-41db-83b5-f7d056cdb299 {{(pid=73104) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 09:20:53 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-7a327f1c-52ca-4b8c-94c5-0e6a3a626286 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Successfully detached device vdb from instance 5b7a178a-d831-41db-83b5-f7d056cdb299 from the live domain config.
Aug 26 09:20:53 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a327f1c-52ca-4b8c-94c5-0e6a3a626286 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a327f1c-52ca-4b8c-94c5-0e6a3a626286 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mJCITzUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:20:53 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-7a327f1c-52ca-4b8c-94c5-0e6a3a626286 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:20:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-7a327f1c-52ca-4b8c-94c5-0e6a3a626286 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-7a327f1c-52ca-4b8c-94c5-0e6a3a626286 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a327f1c-52ca-4b8c-94c5-0e6a3a626286 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed175fdc-3e88-4e85-abf9-0f30949c50b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[697ddeef-1aa5-45d5-a1ad-11d0448dbf41]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a327f1c-52ca-4b8c-94c5-0e6a3a626286 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e (non-flash)
Aug 26 09:20:53 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a327f1c-52ca-4b8c-94c5-0e6a3a626286 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e (non-flash)
Aug 26 09:20:53 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a327f1c-52ca-4b8c-94c5-0e6a3a626286 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0c4182560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e'): ({'sdb'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-7a327f1c-52ca-4b8c-94c5-0e6a3a626286 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Removing single pathed devices sdb {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8e2907-bbdc-4d5d-bd4e-4972d45b4df2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c585c39a-a38c-4f13-9dbf-7d1a17ce54e8]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-7a327f1c-52ca-4b8c-94c5-0e6a3a626286 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Flushing IO for device /dev/sdb {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[def93e4f-e005-4416-bb6f-1892a62a46b5]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-7a327f1c-52ca-4b8c-94c5-0e6a3a626286 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c274f63f-167e-4908-a5c0-0b6a2443f34c]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-7a327f1c-52ca-4b8c-94c5-0e6a3a626286 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-7a327f1c-52ca-4b8c-94c5-0e6a3a626286 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a327f1c-52ca-4b8c-94c5-0e6a3a626286 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d5cce1-6060-4ab8-8097-60fe05276a42]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a327f1c-52ca-4b8c-94c5-0e6a3a626286 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec8f412-f5aa-47b7-9654-628a89442946]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a327f1c-52ca-4b8c-94c5-0e6a3a626286 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e, portal: 172.16.0.220,3260]
Aug 26 09:20:53 user nova-compute[73104]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e, portal: 172.16.0.220,3260] successful.
Aug 26 09:20:53 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ff2160f-ee5d-47d2-8548-239871ca8c7e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[150e28d6-e2bf-429a-a451-26f1236497eb]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a327f1c-52ca-4b8c-94c5-0e6a3a626286 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-7a327f1c-52ca-4b8c-94c5-0e6a3a626286 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.254s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a327f1c-52ca-4b8c-94c5-0e6a3a626286 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] <== disconnect_volume: return (255ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:20:53 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a327f1c-52ca-4b8c-94c5-0e6a3a626286 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 09:20:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:20:54 user nova-compute[73104]: DEBUG nova.objects.instance [None req-7a327f1c-52ca-4b8c-94c5-0e6a3a626286 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lazy-loading 'flavor' on Instance uuid 5b7a178a-d831-41db-83b5-f7d056cdb299 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:20:54 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-7a327f1c-52ca-4b8c-94c5-0e6a3a626286 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.604s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:20:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:20:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:21:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:21:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:21:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:21:18 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:21:18 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:21:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:21:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:21:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:21:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:21:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:21:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:21:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:21:24 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:21:25 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:21:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:21:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:21:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:21:25 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:21:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:21:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:21:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:21:25 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:21:26 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:21:26 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:21:26 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8732MB free_disk=24.10238265991211GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:21:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:21:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:21:26 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 5b7a178a-d831-41db-83b5-f7d056cdb299 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:21:26 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:21:26 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:21:26 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:21:26 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:21:26 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:21:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:21:28 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:21:28 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:21:28 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:21:28 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Rebuilding the list of instances to heal {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 09:21:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-5b7a178a-d831-41db-83b5-f7d056cdb299" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:21:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-5b7a178a-d831-41db-83b5-f7d056cdb299" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:21:28 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 09:21:28 user nova-compute[73104]: DEBUG nova.objects.instance [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lazy-loading 'info_cache' on Instance uuid 5b7a178a-d831-41db-83b5-f7d056cdb299 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:21:28 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Updating instance_info_cache with network_info: [{"id": "085c1ecf-a75a-4e8a-b61d-7f25578d15c1", "address": "fa:16:3e:f8:ac:3e", "network": {"id": "a2f3e73a-66a3-4ad7-b362-1747ad158dc8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1518509383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c66f2ed2ec19430a9cc5c1456111d641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085c1ecf-a7", "ovs_interfaceid": "085c1ecf-a75a-4e8a-b61d-7f25578d15c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:21:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-5b7a178a-d831-41db-83b5-f7d056cdb299" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:21:28 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 09:21:28 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:21:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:21:29 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:21:29 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:21:30 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:21:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:21:38 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:21:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:21:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:21:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:21:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Acquiring lock "5b7a178a-d831-41db-83b5-f7d056cdb299" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:21:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:21:46 user nova-compute[73104]: DEBUG nova.objects.instance [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lazy-loading 'flavor' on Instance uuid 5b7a178a-d831-41db-83b5-f7d056cdb299 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:21:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.105s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:21:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Acquiring lock "5b7a178a-d831-41db-83b5-f7d056cdb299" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:21:46 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:21:46 user nova-compute[73104]: INFO nova.compute.manager [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Attaching volume b78bd1e8-9f62-4f95-86eb-5e9397b1ce79 to /dev/vdb
Aug 26 09:21:47 user nova-compute[73104]: DEBUG os_brick.utils [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:21:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:21:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:21:47 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbdbb9ad-05e7-41d3-80dd-9648309f5c07]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:21:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:21:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:21:47 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c222bbdf-0529-4113-8a18-33c68fcca55c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:21:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:21:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:21:47 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[94151349-f71e-4419-a3ba-238adaac5b8e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:21:47 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[16803b18-4b2b-4c34-866b-cd8c7b07dbe8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:21:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:21:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:21:47 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 09:21:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:21:47 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:21:47 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 09:21:47 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0be0c92-7f85-484e-a7e1-461372c0d9fb]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:21:47 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 09:21:47 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 09:21:47 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 09:21:47 user nova-compute[73104]: DEBUG os_brick.utils [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:21:47 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Updating existing volume attachment record: 557f39d5-b428-457e-aa42-9270c5bb03ed {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 09:21:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:21:50 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:21:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wiLlCGab', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:21:57 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:21:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:21:57 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:21:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:21:57 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 09:21:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad809726-ec20-4450-828f-b679cab11a05]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 09:21:57 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[316d934b-5902-46fe-8984-c77e9bd307e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79] added
Aug 26 09:21:57 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cee1ee-2f3f-4759-ae5a-fbba75b30700]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2202a1-a167-4b2a-a50e-6853f264e1e0]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wiLlCGab {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wiLlCGab" returned: 0 in 0.030s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7caf5d9-754d-4313-b439-e8b606f670b7]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wiLlCGab'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4044123-c721-4661-9487-6141061134d5]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7182fff0-0e79-4844-81d1-005fbc5e6ffb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 09:21:57 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 09:21:57 user nova-compute[73104]:  {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:21:57 user nova-compute[73104]: WARNING os_brick.initiator.connectors.iscsi [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 09:21:57 user nova-compute[73104]: 
Aug 26 09:21:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f7bc73-176d-4947-b306-cf5394d3c7a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79, portal: 172.16.0.220,3260]
Aug 26 09:21:57 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79, portal: 172.16.0.220,3260] successful.
Aug 26 09:21:57 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9c9869-23d9-4134-9100-1e3a7fa9770c]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4475c094-7743-4deb-a8a1-56b55e9a3e1d]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79 (non-flash)
Aug 26 09:21:57 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79 (non-flash)
Aug 26 09:21:57 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2dcbfb6-8ef4-467e-b0d3-12f403336d3f]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 09:21:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wiLlCGab', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 09:21:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:21:58 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23561653836333665', 'path': '/dev/sdb'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:21:58 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561653836333665', 'path': '/dev/sdb'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 09:21:58 user nova-compute[73104]: DEBUG nova.objects.instance [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lazy-loading 'flavor' on Instance uuid 5b7a178a-d831-41db-83b5-f7d056cdb299 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:21:58 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 09:21:58 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:21:58 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 09:21:58 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:21:58 user nova-compute[73104]:   <serial>b78bd1e8-9f62-4f95-86eb-5e9397b1ce79</serial>
Aug 26 09:21:58 user nova-compute[73104]: </disk>
Aug 26 09:21:58 user nova-compute[73104]:  {{(pid=73104) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 09:21:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:21:59 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:21:59 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:21:59 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] No VIF found with MAC fa:16:3e:f8:ac:3e, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 09:21:59 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-513aa35b-b5c7-4944-a275-8ae995d6c87c tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.453s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:22:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:22:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ddb5bcb1-67dc-466f-9451-9316742a6922 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Acquiring lock "5b7a178a-d831-41db-83b5-f7d056cdb299" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:22:01 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ddb5bcb1-67dc-466f-9451-9316742a6922 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:22:01 user nova-compute[73104]: INFO nova.compute.manager [None req-ddb5bcb1-67dc-466f-9451-9316742a6922 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Detaching volume b78bd1e8-9f62-4f95-86eb-5e9397b1ce79
Aug 26 09:22:01 user nova-compute[73104]: INFO nova.virt.block_device [None req-ddb5bcb1-67dc-466f-9451-9316742a6922 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Attempting to driver detach volume b78bd1e8-9f62-4f95-86eb-5e9397b1ce79 from mountpoint /dev/vdb
Aug 26 09:22:01 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ddb5bcb1-67dc-466f-9451-9316742a6922 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Attempting to detach device vdb from instance 5b7a178a-d831-41db-83b5-f7d056cdb299 from the persistent domain config. {{(pid=73104) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 09:22:01 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-ddb5bcb1-67dc-466f-9451-9316742a6922 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 09:22:01 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:22:01 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 09:22:01 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:22:01 user nova-compute[73104]:   <serial>b78bd1e8-9f62-4f95-86eb-5e9397b1ce79</serial>
Aug 26 09:22:01 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 09:22:01 user nova-compute[73104]: </disk>
Aug 26 09:22:01 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 09:22:01 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-ddb5bcb1-67dc-466f-9451-9316742a6922 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Successfully detached device vdb from instance 5b7a178a-d831-41db-83b5-f7d056cdb299 from the persistent domain config.
Aug 26 09:22:01 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ddb5bcb1-67dc-466f-9451-9316742a6922 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5b7a178a-d831-41db-83b5-f7d056cdb299 from the live domain config. {{(pid=73104) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 09:22:01 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-ddb5bcb1-67dc-466f-9451-9316742a6922 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 09:22:01 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:22:01 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 09:22:01 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:22:01 user nova-compute[73104]:   <serial>b78bd1e8-9f62-4f95-86eb-5e9397b1ce79</serial>
Aug 26 09:22:01 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 09:22:01 user nova-compute[73104]: </disk>
Aug 26 09:22:01 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Received event <DeviceRemovedEvent: 1693041722.077697, 5b7a178a-d831-41db-83b5-f7d056cdb299 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73104) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-ddb5bcb1-67dc-466f-9451-9316742a6922 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5b7a178a-d831-41db-83b5-f7d056cdb299 {{(pid=73104) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 09:22:02 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-ddb5bcb1-67dc-466f-9451-9316742a6922 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Successfully detached device vdb from instance 5b7a178a-d831-41db-83b5-f7d056cdb299 from the live domain config.
Aug 26 09:22:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddb5bcb1-67dc-466f-9451-9316742a6922 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb5bcb1-67dc-466f-9451-9316742a6922 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wiLlCGab', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:22:02 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-ddb5bcb1-67dc-466f-9451-9316742a6922 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:22:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-ddb5bcb1-67dc-466f-9451-9316742a6922 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-ddb5bcb1-67dc-466f-9451-9316742a6922 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb5bcb1-67dc-466f-9451-9316742a6922 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[366e0435-8dfc-499d-9260-8501d7ed59aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[877fb51e-5ed2-416c-9557-32a17cf74917]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb5bcb1-67dc-466f-9451-9316742a6922 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79 (non-flash)
Aug 26 09:22:02 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb5bcb1-67dc-466f-9451-9316742a6922 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79 (non-flash)
Aug 26 09:22:02 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb5bcb1-67dc-466f-9451-9316742a6922 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0b4795c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79'): ({'sdb'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ddb5bcb1-67dc-466f-9451-9316742a6922 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Removing single pathed devices sdb {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd27d3b-3418-4c03-a2f9-9452152f67ea]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[afccdfed-e0fe-48f5-ac43-99a6a805f80a]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ddb5bcb1-67dc-466f-9451-9316742a6922 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Flushing IO for device /dev/sdb {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6ce9fb-9118-4546-91a6-9fb3cbe262ea]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ddb5bcb1-67dc-466f-9451-9316742a6922 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc14b36-912f-456c-ac02-32e157d69110]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ddb5bcb1-67dc-466f-9451-9316742a6922 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-ddb5bcb1-67dc-466f-9451-9316742a6922 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb5bcb1-67dc-466f-9451-9316742a6922 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5efc07-6f81-4404-8d84-4a48a002bb9e]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb5bcb1-67dc-466f-9451-9316742a6922 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e38fa53-576a-44e4-afdc-f9e1ad7eed82]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb5bcb1-67dc-466f-9451-9316742a6922 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79, portal: 172.16.0.220,3260]
Aug 26 09:22:02 user nova-compute[73104]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79, portal: 172.16.0.220,3260] successful.
Aug 26 09:22:02 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78bd1e8-9f62-4f95-86eb-5e9397b1ce79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fec5b8-d0a3-4fe1-8df6-0ac9d5bd015c]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb5bcb1-67dc-466f-9451-9316742a6922 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-ddb5bcb1-67dc-466f-9451-9316742a6922 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb5bcb1-67dc-466f-9451-9316742a6922 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] <== disconnect_volume: return (287ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:22:02 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddb5bcb1-67dc-466f-9451-9316742a6922 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 09:22:03 user nova-compute[73104]: DEBUG nova.objects.instance [None req-ddb5bcb1-67dc-466f-9451-9316742a6922 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lazy-loading 'flavor' on Instance uuid 5b7a178a-d831-41db-83b5-f7d056cdb299 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:22:03 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-ddb5bcb1-67dc-466f-9451-9316742a6922 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.739s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:22:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:22:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:22:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:22:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:22:18 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:22:18 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:22:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:22:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:22:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:22:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:22:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:22:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:22:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:22:24 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:22:27 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:22:27 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:22:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:22:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:22:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:22:27 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:22:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:22:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:22:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:22:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:22:28 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:22:28 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:22:28 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8699MB free_disk=24.092594146728516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:22:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:22:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:22:28 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 5b7a178a-d831-41db-83b5-f7d056cdb299 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:22:28 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:22:28 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:22:28 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:22:28 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:22:28 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:22:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:22:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:22:29 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:22:29 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:22:29 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:22:29 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Rebuilding the list of instances to heal {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 09:22:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-5b7a178a-d831-41db-83b5-f7d056cdb299" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:22:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-5b7a178a-d831-41db-83b5-f7d056cdb299" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:22:29 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 09:22:29 user nova-compute[73104]: DEBUG nova.objects.instance [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lazy-loading 'info_cache' on Instance uuid 5b7a178a-d831-41db-83b5-f7d056cdb299 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:22:30 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Updating instance_info_cache with network_info: [{"id": "085c1ecf-a75a-4e8a-b61d-7f25578d15c1", "address": "fa:16:3e:f8:ac:3e", "network": {"id": "a2f3e73a-66a3-4ad7-b362-1747ad158dc8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1518509383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c66f2ed2ec19430a9cc5c1456111d641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085c1ecf-a7", "ovs_interfaceid": "085c1ecf-a75a-4e8a-b61d-7f25578d15c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:22:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-5b7a178a-d831-41db-83b5-f7d056cdb299" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:22:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 09:22:30 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:22:31 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:22:32 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:22:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:22:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:22:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:22:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:22:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:22:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:22:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:22:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:22:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:22:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:22:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:22:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:22:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:22:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:22:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:22:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Acquiring lock "5b7a178a-d831-41db-83b5-f7d056cdb299" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:22:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:22:56 user nova-compute[73104]: DEBUG nova.objects.instance [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lazy-loading 'flavor' on Instance uuid 5b7a178a-d831-41db-83b5-f7d056cdb299 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:22:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:22:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Acquiring lock "5b7a178a-d831-41db-83b5-f7d056cdb299" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:22:56 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:22:56 user nova-compute[73104]: INFO nova.compute.manager [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Attaching volume 41b2359f-3fa3-4b60-9d67-e44301ee1e44 to /dev/vdb
Aug 26 09:22:57 user nova-compute[73104]: DEBUG os_brick.utils [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:22:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:22:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:22:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e5f575-853d-408b-85ca-0d48554f6807]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:22:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:22:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:22:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea034ebf-8c10-4820-82c2-cad0abbfdd15]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:22:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:22:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:22:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac296bec-a405-435a-9ad7-d797f0a420b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:22:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c07f22-b169-4981-ac82-864efcdbd6ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:22:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:22:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:22:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 09:22:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:22:57 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:22:57 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 09:22:57 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eaa0b92-1ef5-4ea7-940c-0eb1a1f3dc44]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:22:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 09:22:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 09:22:57 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 09:22:57 user nova-compute[73104]: DEBUG os_brick.utils [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:22:57 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Updating existing volume attachment record: 2b2eaaad-ffd8-4eeb-a35f-705d3974c239 {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 09:22:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:23:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:23:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:23:07 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 09:23:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NipLlcbH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:23:07 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:23:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:23:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:23:07 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:23:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:23:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:23:07 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 09:23:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:23:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:23:07 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e972038-ee04-4ded-ac71-bfb2ad55c9d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:23:07 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 09:23:07 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:23:07 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.107s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f488bac-90eb-4e45-ae4e-42177c01fb0f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44] added
Aug 26 09:23:08 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4875eb5b-b5c0-45b3-92c2-26966afcf278]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0e7c65-267c-435d-88b6-871af284d3a0]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NipLlcbH {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NipLlcbH" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[df63089c-02c6-4cfb-b6e9-9fcd397fc456]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NipLlcbH'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1713f24b-a642-40e4-a683-0ad8342e67d0]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fefb5d-c2b0-47e3-9d98-6a40914ff1ba]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 09:23:08 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 09:23:08 user nova-compute[73104]:  {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:23:08 user nova-compute[73104]: WARNING os_brick.initiator.connectors.iscsi [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 09:23:08 user nova-compute[73104]: 
Aug 26 09:23:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea18866-ffa3-4958-a184-56e193bc93ba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44, portal: 172.16.0.220,3260]
Aug 26 09:23:08 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44, portal: 172.16.0.220,3260] successful.
Aug 26 09:23:08 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3404aa7d-f885-481b-92f4-cf1ac1d7ffb6]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[55efdf9b-7315-4bfd-8640-2f3769dbd153]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44 (non-flash)
Aug 26 09:23:08 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44 (non-flash)
Aug 26 09:23:08 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b54819-6771-462c-a6cb-00263f97897e]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:23:08 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: None {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 09:23:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:23:09 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 09:23:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NipLlcbH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 09:23:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:23:09 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23138333036646365', 'path': '/dev/sdb'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:23:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138333036646365', 'path': '/dev/sdb'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 09:23:09 user nova-compute[73104]: DEBUG nova.objects.instance [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lazy-loading 'flavor' on Instance uuid 5b7a178a-d831-41db-83b5-f7d056cdb299 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:23:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 09:23:09 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:23:09 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 09:23:09 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:23:09 user nova-compute[73104]:   <serial>41b2359f-3fa3-4b60-9d67-e44301ee1e44</serial>
Aug 26 09:23:09 user nova-compute[73104]: </disk>
Aug 26 09:23:09 user nova-compute[73104]:  {{(pid=73104) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 09:23:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:23:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:23:09 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] No VIF found with MAC fa:16:3e:f8:ac:3e, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 09:23:09 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e71524be-d912-4866-8dda-ebdc77d9879e tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.984s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:23:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e906711e-59d6-4837-bc6a-8512ed3d5a71 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Acquiring lock "5b7a178a-d831-41db-83b5-f7d056cdb299" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:23:12 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e906711e-59d6-4837-bc6a-8512ed3d5a71 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:23:12 user nova-compute[73104]: INFO nova.compute.manager [None req-e906711e-59d6-4837-bc6a-8512ed3d5a71 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Detaching volume 41b2359f-3fa3-4b60-9d67-e44301ee1e44
Aug 26 09:23:12 user nova-compute[73104]: INFO nova.virt.block_device [None req-e906711e-59d6-4837-bc6a-8512ed3d5a71 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Attempting to driver detach volume 41b2359f-3fa3-4b60-9d67-e44301ee1e44 from mountpoint /dev/vdb
Aug 26 09:23:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e906711e-59d6-4837-bc6a-8512ed3d5a71 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Attempting to detach device vdb from instance 5b7a178a-d831-41db-83b5-f7d056cdb299 from the persistent domain config. {{(pid=73104) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 09:23:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-e906711e-59d6-4837-bc6a-8512ed3d5a71 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 09:23:12 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:23:12 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 09:23:12 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:23:12 user nova-compute[73104]:   <serial>41b2359f-3fa3-4b60-9d67-e44301ee1e44</serial>
Aug 26 09:23:12 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 09:23:12 user nova-compute[73104]: </disk>
Aug 26 09:23:12 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 09:23:12 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-e906711e-59d6-4837-bc6a-8512ed3d5a71 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Successfully detached device vdb from instance 5b7a178a-d831-41db-83b5-f7d056cdb299 from the persistent domain config.
Aug 26 09:23:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e906711e-59d6-4837-bc6a-8512ed3d5a71 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5b7a178a-d831-41db-83b5-f7d056cdb299 from the live domain config. {{(pid=73104) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 09:23:12 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-e906711e-59d6-4837-bc6a-8512ed3d5a71 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 09:23:12 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:23:12 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 09:23:12 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:23:12 user nova-compute[73104]:   <serial>41b2359f-3fa3-4b60-9d67-e44301ee1e44</serial>
Aug 26 09:23:12 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 09:23:12 user nova-compute[73104]: </disk>
Aug 26 09:23:12 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Received event <DeviceRemovedEvent: 1693041793.1111703, 5b7a178a-d831-41db-83b5-f7d056cdb299 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73104) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-e906711e-59d6-4837-bc6a-8512ed3d5a71 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5b7a178a-d831-41db-83b5-f7d056cdb299 {{(pid=73104) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 09:23:13 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-e906711e-59d6-4837-bc6a-8512ed3d5a71 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Successfully detached device vdb from instance 5b7a178a-d831-41db-83b5-f7d056cdb299 from the live domain config.
Aug 26 09:23:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e906711e-59d6-4837-bc6a-8512ed3d5a71 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e906711e-59d6-4837-bc6a-8512ed3d5a71 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NipLlcbH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:23:13 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-e906711e-59d6-4837-bc6a-8512ed3d5a71 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:23:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-e906711e-59d6-4837-bc6a-8512ed3d5a71 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-e906711e-59d6-4837-bc6a-8512ed3d5a71 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e906711e-59d6-4837-bc6a-8512ed3d5a71 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[838e73de-1e1c-4523-837d-5144d8166d42]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2967592-2cef-4113-9613-ffb4a7d54639]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e906711e-59d6-4837-bc6a-8512ed3d5a71 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44 (non-flash)
Aug 26 09:23:13 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e906711e-59d6-4837-bc6a-8512ed3d5a71 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44 (non-flash)
Aug 26 09:23:13 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e906711e-59d6-4837-bc6a-8512ed3d5a71 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0c41816c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44'): ({'sdb'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-e906711e-59d6-4837-bc6a-8512ed3d5a71 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Removing single pathed devices sdb {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55389e7-07bf-4572-ba3f-0da51db2c855]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a8f791-1cc2-4c16-bfa7-010ae8c02477]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-e906711e-59d6-4837-bc6a-8512ed3d5a71 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Flushing IO for device /dev/sdb {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fffa70-c150-4b98-a82b-9928b87f31d8]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-e906711e-59d6-4837-bc6a-8512ed3d5a71 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[db86cc92-c01d-4900-88aa-c1a3555a81ec]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-e906711e-59d6-4837-bc6a-8512ed3d5a71 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-e906711e-59d6-4837-bc6a-8512ed3d5a71 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e906711e-59d6-4837-bc6a-8512ed3d5a71 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06a375a-9bc6-4b99-922e-1b8045ec2722]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e906711e-59d6-4837-bc6a-8512ed3d5a71 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf3d500-adad-46fc-9a28-149c00f280d4]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e906711e-59d6-4837-bc6a-8512ed3d5a71 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44, portal: 172.16.0.220,3260]
Aug 26 09:23:13 user nova-compute[73104]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44, portal: 172.16.0.220,3260] successful.
Aug 26 09:23:13 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41b2359f-3fa3-4b60-9d67-e44301ee1e44 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[230e71f0-90ac-4310-87b4-3d938561b316]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e906711e-59d6-4837-bc6a-8512ed3d5a71 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-e906711e-59d6-4837-bc6a-8512ed3d5a71 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-e906711e-59d6-4837-bc6a-8512ed3d5a71 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] <== disconnect_volume: return (271ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:23:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e906711e-59d6-4837-bc6a-8512ed3d5a71 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 09:23:14 user nova-compute[73104]: DEBUG nova.objects.instance [None req-e906711e-59d6-4837-bc6a-8512ed3d5a71 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lazy-loading 'flavor' on Instance uuid 5b7a178a-d831-41db-83b5-f7d056cdb299 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:23:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:23:14 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-e906711e-59d6-4837-bc6a-8512ed3d5a71 tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.631s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:23:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:23:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:23:19 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:23:19 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:23:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:23:26 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:23:27 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:23:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:23:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:23:27 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:23:27 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:23:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:23:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:23:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:23:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:23:28 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:23:28 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:23:28 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8706MB free_disk=24.090816497802734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:23:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:23:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:23:28 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 5b7a178a-d831-41db-83b5-f7d056cdb299 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:23:28 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:23:28 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:23:28 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Refreshing inventories for resource provider 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 09:23:28 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Updating ProviderTree inventory for provider 8a2a2397-4d47-4524-8146-84db4225a812 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 09:23:28 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Updating inventory in ProviderTree for provider 8a2a2397-4d47-4524-8146-84db4225a812 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 09:23:28 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Refreshing aggregate associations for resource provider 8a2a2397-4d47-4524-8146-84db4225a812, aggregates: None {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 09:23:28 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Refreshing trait associations for resource provider 8a2a2397-4d47-4524-8146-84db4225a812, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 09:23:28 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:23:28 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:23:28 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:23:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.443s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:23:28 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:23:28 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73104) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 09:23:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:23:29 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:23:30 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:23:30 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:23:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:23:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Rebuilding the list of instances to heal {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 09:23:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-5b7a178a-d831-41db-83b5-f7d056cdb299" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:23:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-5b7a178a-d831-41db-83b5-f7d056cdb299" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:23:30 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 09:23:30 user nova-compute[73104]: DEBUG nova.objects.instance [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lazy-loading 'info_cache' on Instance uuid 5b7a178a-d831-41db-83b5-f7d056cdb299 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:23:30 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Updating instance_info_cache with network_info: [{"id": "085c1ecf-a75a-4e8a-b61d-7f25578d15c1", "address": "fa:16:3e:f8:ac:3e", "network": {"id": "a2f3e73a-66a3-4ad7-b362-1747ad158dc8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1518509383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c66f2ed2ec19430a9cc5c1456111d641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085c1ecf-a7", "ovs_interfaceid": "085c1ecf-a75a-4e8a-b61d-7f25578d15c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:23:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-5b7a178a-d831-41db-83b5-f7d056cdb299" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:23:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 09:23:32 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:23:32 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:23:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:23:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:23:34 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:23:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:23:39 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:23:39 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:23:42 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:23:42 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Cleaning up deleted instances {{(pid=73104) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 09:23:42 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] There are 0 instances to clean {{(pid=73104) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 09:23:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:23:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:23:50 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:23:50 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Triggering sync for uuid 5b7a178a-d831-41db-83b5-f7d056cdb299 {{(pid=73104) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 09:23:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "5b7a178a-d831-41db-83b5-f7d056cdb299" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:23:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:23:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:23:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:23:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:24:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:24:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:24:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:24:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:24:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:24:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:24:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:24:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:24:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:24:19 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:24:19 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:24:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:24:28 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:24:28 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:24:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:24:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:24:28 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:24:28 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:24:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:24:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:24:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:24:28 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:24:29 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:24:29 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:24:29 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8778MB free_disk=24.089847564697266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:24:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:24:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:24:29 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance 5b7a178a-d831-41db-83b5-f7d056cdb299 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:24:29 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:24:29 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:24:29 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:24:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:24:29 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:24:29 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:24:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:24:30 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:24:30 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:24:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:24:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Rebuilding the list of instances to heal {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 09:24:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-5b7a178a-d831-41db-83b5-f7d056cdb299" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:24:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-5b7a178a-d831-41db-83b5-f7d056cdb299" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:24:30 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 09:24:30 user nova-compute[73104]: DEBUG nova.objects.instance [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lazy-loading 'info_cache' on Instance uuid 5b7a178a-d831-41db-83b5-f7d056cdb299 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:24:30 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Updating instance_info_cache with network_info: [{"id": "085c1ecf-a75a-4e8a-b61d-7f25578d15c1", "address": "fa:16:3e:f8:ac:3e", "network": {"id": "a2f3e73a-66a3-4ad7-b362-1747ad158dc8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1518509383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c66f2ed2ec19430a9cc5c1456111d641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085c1ecf-a7", "ovs_interfaceid": "085c1ecf-a75a-4e8a-b61d-7f25578d15c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:24:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-5b7a178a-d831-41db-83b5-f7d056cdb299" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:24:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 09:24:30 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:24:32 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:24:33 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:24:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:24:35 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:24:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:24:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:24:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-06c8940e-5f38-4293-a069-e85b9dfccd7b tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Acquiring lock "5b7a178a-d831-41db-83b5-f7d056cdb299" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:24:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-06c8940e-5f38-4293-a069-e85b9dfccd7b tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:24:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-06c8940e-5f38-4293-a069-e85b9dfccd7b tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Acquiring lock "5b7a178a-d831-41db-83b5-f7d056cdb299-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:24:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-06c8940e-5f38-4293-a069-e85b9dfccd7b tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:24:48 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-06c8940e-5f38-4293-a069-e85b9dfccd7b tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:24:48 user nova-compute[73104]: INFO nova.compute.manager [None req-06c8940e-5f38-4293-a069-e85b9dfccd7b tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Terminating instance
Aug 26 09:24:48 user nova-compute[73104]: DEBUG nova.compute.manager [None req-06c8940e-5f38-4293-a069-e85b9dfccd7b tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 09:24:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:24:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:24:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:24:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:24:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:24:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:24:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-7675a52f-f3da-4362-8ca7-b9894ae2b1e8 req-a8dae86d-ab79-4ee6-880d-9e234c7df98c service nova] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Received event network-vif-unplugged-085c1ecf-a75a-4e8a-b61d-7f25578d15c1 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:24:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-7675a52f-f3da-4362-8ca7-b9894ae2b1e8 req-a8dae86d-ab79-4ee6-880d-9e234c7df98c service nova] Acquiring lock "5b7a178a-d831-41db-83b5-f7d056cdb299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:24:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-7675a52f-f3da-4362-8ca7-b9894ae2b1e8 req-a8dae86d-ab79-4ee6-880d-9e234c7df98c service nova] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:24:49 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-7675a52f-f3da-4362-8ca7-b9894ae2b1e8 req-a8dae86d-ab79-4ee6-880d-9e234c7df98c service nova] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:24:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-7675a52f-f3da-4362-8ca7-b9894ae2b1e8 req-a8dae86d-ab79-4ee6-880d-9e234c7df98c service nova] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] No waiting events found dispatching network-vif-unplugged-085c1ecf-a75a-4e8a-b61d-7f25578d15c1 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:24:49 user nova-compute[73104]: DEBUG nova.compute.manager [req-7675a52f-f3da-4362-8ca7-b9894ae2b1e8 req-a8dae86d-ab79-4ee6-880d-9e234c7df98c service nova] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Received event network-vif-unplugged-085c1ecf-a75a-4e8a-b61d-7f25578d15c1 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 09:24:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:24:49 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Instance destroyed successfully.
Aug 26 09:24:49 user nova-compute[73104]: DEBUG nova.objects.instance [None req-06c8940e-5f38-4293-a069-e85b9dfccd7b tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lazy-loading 'resources' on Instance uuid 5b7a178a-d831-41db-83b5-f7d056cdb299 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:24:49 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-06c8940e-5f38-4293-a069-e85b9dfccd7b tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:16:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2013194521',display_name='tempest-SnapshotDataIntegrityTests-server-2013194521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2013194521',id=52,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKm8zcKDklFGHn8lnlILCvmxDUoJFHlcozECtSjW4D3Y0YHf9na5NNmhqpTp4qIsHf3IVu2KTEs16q45lJzbkgqWALDKOdNv9cjaq7ygDp3BmfkBxDWXS1IIeukmrrZ6KA==',key_name='tempest-keypair-1789320669',keypairs=<?>,launch_index=0,launched_at=2023-08-26T09:17:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c66f2ed2ec19430a9cc5c1456111d641',ramdisk_id='',reservation_id='r-edct06n9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-2002712156',owner_user_name='tempest-SnapshotDataIntegrityTests-2002712156-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T09:17:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44ec93a370e74a3ea133426220c0ef60',uuid=5b7a178a-d831-41db-83b5-f7d056cdb299,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "085c1ecf-a75a-4e8a-b61d-7f25578d15c1", "address": "fa:16:3e:f8:ac:3e", "network": {"id": "a2f3e73a-66a3-4ad7-b362-1747ad158dc8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1518509383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c66f2ed2ec19430a9cc5c1456111d641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085c1ecf-a7", "ovs_interfaceid": "085c1ecf-a75a-4e8a-b61d-7f25578d15c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 09:24:49 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-06c8940e-5f38-4293-a069-e85b9dfccd7b tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Converting VIF {"id": "085c1ecf-a75a-4e8a-b61d-7f25578d15c1", "address": "fa:16:3e:f8:ac:3e", "network": {"id": "a2f3e73a-66a3-4ad7-b362-1747ad158dc8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1518509383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c66f2ed2ec19430a9cc5c1456111d641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap085c1ecf-a7", "ovs_interfaceid": "085c1ecf-a75a-4e8a-b61d-7f25578d15c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:24:49 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-06c8940e-5f38-4293-a069-e85b9dfccd7b tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:ac:3e,bridge_name='br-int',has_traffic_filtering=True,id=085c1ecf-a75a-4e8a-b61d-7f25578d15c1,network=Network(a2f3e73a-66a3-4ad7-b362-1747ad158dc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap085c1ecf-a7') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:24:49 user nova-compute[73104]: DEBUG os_vif [None req-06c8940e-5f38-4293-a069-e85b9dfccd7b tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:ac:3e,bridge_name='br-int',has_traffic_filtering=True,id=085c1ecf-a75a-4e8a-b61d-7f25578d15c1,network=Network(a2f3e73a-66a3-4ad7-b362-1747ad158dc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap085c1ecf-a7') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 09:24:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:24:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap085c1ecf-a7, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:24:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:24:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:24:49 user nova-compute[73104]: INFO os_vif [None req-06c8940e-5f38-4293-a069-e85b9dfccd7b tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:ac:3e,bridge_name='br-int',has_traffic_filtering=True,id=085c1ecf-a75a-4e8a-b61d-7f25578d15c1,network=Network(a2f3e73a-66a3-4ad7-b362-1747ad158dc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap085c1ecf-a7')
Aug 26 09:24:49 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-06c8940e-5f38-4293-a069-e85b9dfccd7b tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Deleting instance files /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299_del
Aug 26 09:24:49 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-06c8940e-5f38-4293-a069-e85b9dfccd7b tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Deletion of /opt/stack/data/nova/instances/5b7a178a-d831-41db-83b5-f7d056cdb299_del complete
Aug 26 09:24:49 user nova-compute[73104]: INFO nova.compute.manager [None req-06c8940e-5f38-4293-a069-e85b9dfccd7b tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 26 09:24:49 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-06c8940e-5f38-4293-a069-e85b9dfccd7b tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 09:24:49 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 09:24:49 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 09:24:50 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:24:50 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Took 1.04 seconds to deallocate network for instance.
Aug 26 09:24:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-06c8940e-5f38-4293-a069-e85b9dfccd7b tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:24:50 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-06c8940e-5f38-4293-a069-e85b9dfccd7b tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:24:50 user nova-compute[73104]: DEBUG nova.compute.manager [req-5ef2c337-a0e2-433d-9d54-6a94b97764d5 req-812d33e0-b074-4de5-9c42-47d0cb1b9c57 service nova] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Received event network-vif-deleted-085c1ecf-a75a-4e8a-b61d-7f25578d15c1 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:24:50 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-06c8940e-5f38-4293-a069-e85b9dfccd7b tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:24:50 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-06c8940e-5f38-4293-a069-e85b9dfccd7b tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:24:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-06c8940e-5f38-4293-a069-e85b9dfccd7b tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.118s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:24:51 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-06c8940e-5f38-4293-a069-e85b9dfccd7b tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Deleted allocations for instance 5b7a178a-d831-41db-83b5-f7d056cdb299
Aug 26 09:24:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-06c8940e-5f38-4293-a069-e85b9dfccd7b tempest-SnapshotDataIntegrityTests-2002712156 tempest-SnapshotDataIntegrityTests-2002712156-project-member] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.367s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:24:51 user nova-compute[73104]: DEBUG nova.compute.manager [req-de67c80c-a7bc-483b-b153-d3239b09222a req-5979900c-2192-42ae-958e-e78a987f21ca service nova] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Received event network-vif-plugged-085c1ecf-a75a-4e8a-b61d-7f25578d15c1 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:24:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-de67c80c-a7bc-483b-b153-d3239b09222a req-5979900c-2192-42ae-958e-e78a987f21ca service nova] Acquiring lock "5b7a178a-d831-41db-83b5-f7d056cdb299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:24:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-de67c80c-a7bc-483b-b153-d3239b09222a req-5979900c-2192-42ae-958e-e78a987f21ca service nova] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:24:51 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-de67c80c-a7bc-483b-b153-d3239b09222a req-5979900c-2192-42ae-958e-e78a987f21ca service nova] Lock "5b7a178a-d831-41db-83b5-f7d056cdb299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:24:51 user nova-compute[73104]: DEBUG nova.compute.manager [req-de67c80c-a7bc-483b-b153-d3239b09222a req-5979900c-2192-42ae-958e-e78a987f21ca service nova] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] No waiting events found dispatching network-vif-plugged-085c1ecf-a75a-4e8a-b61d-7f25578d15c1 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:24:51 user nova-compute[73104]: WARNING nova.compute.manager [req-de67c80c-a7bc-483b-b153-d3239b09222a req-5979900c-2192-42ae-958e-e78a987f21ca service nova] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Received unexpected event network-vif-plugged-085c1ecf-a75a-4e8a-b61d-7f25578d15c1 for instance with vm_state deleted and task_state None.
Aug 26 09:24:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:24:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:24:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:24:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:24:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:24:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:24:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:25:04 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693041889.7002504, 5b7a178a-d831-41db-83b5-f7d056cdb299 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:25:04 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] VM Stopped (Lifecycle Event)
Aug 26 09:25:04 user nova-compute[73104]: DEBUG nova.compute.manager [None req-3e5cd022-76c1-4c27-8242-f6b4577ffa54 None None] [instance: 5b7a178a-d831-41db-83b5-f7d056cdb299] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:25:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:25:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:25:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:25:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:25:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:25:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:25:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:25:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:25:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:25:20 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:25:20 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:25:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:25:29 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:25:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:25:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:25:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:25:29 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:25:29 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:25:29 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:25:29 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8928MB free_disk=24.117156982421875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:25:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:25:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:25:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:25:29 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:25:29 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:25:29 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:25:29 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:25:29 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:25:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:25:30 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:25:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:25:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Rebuilding the list of instances to heal {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 09:25:30 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Didn't find any instances for network info cache update. {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 09:25:30 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:25:30 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:25:31 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:25:33 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:25:34 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:25:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:25:37 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:25:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:25:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:25:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:25:44 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:25:44 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:25:46 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:25:49 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:25:54 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:25:59 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:26:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:26:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:26:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:26:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:26:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:26:04 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:26:09 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:26:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:26:15 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:26:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:26:19 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:26:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:26:22 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:26:22 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:26:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:26:24 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:26:25 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:26:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:26:29 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:26:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:26:30 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:26:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:26:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:26:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:26:30 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:26:30 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:26:30 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:26:30 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8600MB free_disk=24.10354232788086GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:26:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:26:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:26:30 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:26:30 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:26:31 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:26:31 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:26:31 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:26:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:26:32 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:26:32 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:26:32 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:26:32 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:26:32 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:26:32 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Rebuilding the list of instances to heal {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 09:26:32 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Didn't find any instances for network info cache update. {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 09:26:34 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:26:34 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:26:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Acquiring lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:26:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:26:34 user nova-compute[73104]: DEBUG nova.compute.manager [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Starting instance... {{(pid=73104) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 09:26:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:26:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:26:34 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73104) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 09:26:34 user nova-compute[73104]: INFO nova.compute.claims [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Claim successful on node user
Aug 26 09:26:34 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:26:34 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:26:34 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:26:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.288s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:26:34 user nova-compute[73104]: DEBUG nova.compute.manager [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Start building networks asynchronously for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 09:26:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Allocating IP information in the background. {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 09:26:35 user nova-compute[73104]: DEBUG nova.network.neutron [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] allocate_for_instance() {{(pid=73104) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 09:26:35 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 09:26:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Start building block device mappings for instance. {{(pid=73104) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 09:26:35 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:26:35 user nova-compute[73104]: DEBUG nova.policy [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '52a9f5bf03d1463488bdc3c4222297ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76e5ef4b1364dfd95283d46ddbf198d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73104) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 09:26:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Start spawning the instance on the hypervisor. {{(pid=73104) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 09:26:35 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Creating instance directory {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 09:26:35 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Creating image(s)
Aug 26 09:26:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:26:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "/opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:26:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "/opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:26:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:26:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.241s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:26:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Acquiring lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:26:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:26:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:26:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.203s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:26:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk 1073741824 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:26:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5,backing_fmt=raw /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk 1073741824" returned: 0 in 0.055s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:26:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:26:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:26:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f11f04016be0dcfc5ca7ba0280eed3b5ec12d5 --force-share --output=json" returned: 0 in 0.207s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:26:36 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk. size=1073741824 {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 09:26:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:26:36 user nova-compute[73104]: DEBUG nova.network.neutron [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Successfully created port: 43ead9d3-4205-480c-bace-f8e91986bbf1 {{(pid=73104) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 09:26:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:26:36 user nova-compute[73104]: DEBUG nova.virt.disk.api [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Cannot resize image /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk to a smaller size. {{(pid=73104) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 09:26:36 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Created local disks {{(pid=73104) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 09:26:36 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Ensure instance console log exists: /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/console.log {{(pid=73104) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 09:26:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:26:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:26:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.network.neutron [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Successfully updated port: 43ead9d3-4205-480c-bace-f8e91986bbf1 {{(pid=73104) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Acquiring lock "refresh_cache-cf7abefb-4f52-47f9-8710-7731fe1d1b95" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Acquired lock "refresh_cache-cf7abefb-4f52-47f9-8710-7731fe1d1b95" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.network.neutron [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Building network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.compute.manager [req-976618dc-1a0d-46f5-bf00-6e1bf223af20 req-f29c6dcc-688a-46f8-9cbc-2b484c9a61d2 service nova] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Received event network-changed-43ead9d3-4205-480c-bace-f8e91986bbf1 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.compute.manager [req-976618dc-1a0d-46f5-bf00-6e1bf223af20 req-f29c6dcc-688a-46f8-9cbc-2b484c9a61d2 service nova] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Refreshing instance network info cache due to event network-changed-43ead9d3-4205-480c-bace-f8e91986bbf1. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-976618dc-1a0d-46f5-bf00-6e1bf223af20 req-f29c6dcc-688a-46f8-9cbc-2b484c9a61d2 service nova] Acquiring lock "refresh_cache-cf7abefb-4f52-47f9-8710-7731fe1d1b95" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.network.neutron [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Instance cache missing network info. {{(pid=73104) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.network.neutron [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Updating instance_info_cache with network_info: [{"id": "43ead9d3-4205-480c-bace-f8e91986bbf1", "address": "fa:16:3e:50:53:2c", "network": {"id": "83a42b92-0209-424b-90c3-cd30bc69ac18", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-322258755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b76e5ef4b1364dfd95283d46ddbf198d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ead9d3-42", "ovs_interfaceid": "43ead9d3-4205-480c-bace-f8e91986bbf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Releasing lock "refresh_cache-cf7abefb-4f52-47f9-8710-7731fe1d1b95" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.compute.manager [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Instance network_info: |[{"id": "43ead9d3-4205-480c-bace-f8e91986bbf1", "address": "fa:16:3e:50:53:2c", "network": {"id": "83a42b92-0209-424b-90c3-cd30bc69ac18", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-322258755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b76e5ef4b1364dfd95283d46ddbf198d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ead9d3-42", "ovs_interfaceid": "43ead9d3-4205-480c-bace-f8e91986bbf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73104) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-976618dc-1a0d-46f5-bf00-6e1bf223af20 req-f29c6dcc-688a-46f8-9cbc-2b484c9a61d2 service nova] Acquired lock "refresh_cache-cf7abefb-4f52-47f9-8710-7731fe1d1b95" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.network.neutron [req-976618dc-1a0d-46f5-bf00-6e1bf223af20 req-f29c6dcc-688a-46f8-9cbc-2b484c9a61d2 service nova] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Refreshing network info cache for port 43ead9d3-4205-480c-bace-f8e91986bbf1 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Start _get_guest_xml network_info=[{"id": "43ead9d3-4205-480c-bace-f8e91986bbf1", "address": "fa:16:3e:50:53:2c", "network": {"id": "83a42b92-0209-424b-90c3-cd30bc69ac18", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-322258755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b76e5ef4b1364dfd95283d46ddbf198d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ead9d3-42", "ovs_interfaceid": "43ead9d3-4205-480c-bace-f8e91986bbf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'e28116ef-1f27-40e2-be41-f8cc5c10ee86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 09:26:37 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:26:37 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] CPU controller missing on host. {{(pid=73104) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.host [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] CPU controller found on host. {{(pid=73104) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73104) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T08:32:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T08:33:06Z,direct_url=<?>,disk_format='qcow2',id=e28116ef-1f27-40e2-be41-f8cc5c10ee86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='549d3fed307c4f4c84128afef97a358e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T08:33:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Flavor limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Image limits 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Flavor pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Image pref 0:0:0 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Got 1 possible topologies {{(pid=73104) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.virt.hardware [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73104) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:26:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1509733539',display_name='tempest-SnapshotDataIntegrityTests-server-1509733539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1509733539',id=53,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0OEsvdAlnlIyrF3na+qaFLlUa3PzoOF0PZ+CWi7hZ9NjA/Ay/NfXpKk1sOQ9Ik0ZbpROvxb6p8J0smgtBicDgnLkUEMUp6IHGoX3icnTx116+R+K8zgYZNdbeNGWBqDA==',key_name='tempest-keypair-468890120',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b76e5ef4b1364dfd95283d46ddbf198d',ramdisk_id='',reservation_id='r-75g8xqep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-756955482',owner_user_name='tempest-SnapshotDataIntegrityTests-756955482-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:26:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52a9f5bf03d1463488bdc3c4222297ce',uuid=cf7abefb-4f52-47f9-8710-7731fe1d1b95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43ead9d3-4205-480c-bace-f8e91986bbf1", "address": "fa:16:3e:50:53:2c", "network": {"id": "83a42b92-0209-424b-90c3-cd30bc69ac18", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-322258755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b76e5ef4b1364dfd95283d46ddbf198d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ead9d3-42", "ovs_interfaceid": "43ead9d3-4205-480c-bace-f8e91986bbf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73104) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Converting VIF {"id": "43ead9d3-4205-480c-bace-f8e91986bbf1", "address": "fa:16:3e:50:53:2c", "network": {"id": "83a42b92-0209-424b-90c3-cd30bc69ac18", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-322258755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b76e5ef4b1364dfd95283d46ddbf198d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ead9d3-42", "ovs_interfaceid": "43ead9d3-4205-480c-bace-f8e91986bbf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:53:2c,bridge_name='br-int',has_traffic_filtering=True,id=43ead9d3-4205-480c-bace-f8e91986bbf1,network=Network(83a42b92-0209-424b-90c3-cd30bc69ac18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43ead9d3-42') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.objects.instance [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lazy-loading 'pci_devices' on Instance uuid cf7abefb-4f52-47f9-8710-7731fe1d1b95 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] End _get_guest_xml xml=<domain type="kvm">
Aug 26 09:26:37 user nova-compute[73104]:   <uuid>cf7abefb-4f52-47f9-8710-7731fe1d1b95</uuid>
Aug 26 09:26:37 user nova-compute[73104]:   <name>instance-00000035</name>
Aug 26 09:26:37 user nova-compute[73104]:   <memory>524288</memory>
Aug 26 09:26:37 user nova-compute[73104]:   <vcpu>1</vcpu>
Aug 26 09:26:37 user nova-compute[73104]:   <metadata>
Aug 26 09:26:37 user nova-compute[73104]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 09:26:37 user nova-compute[73104]:       <nova:package version="0.0.0"/>
Aug 26 09:26:37 user nova-compute[73104]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1509733539</nova:name>
Aug 26 09:26:37 user nova-compute[73104]:       <nova:creationTime>2023-08-26 09:26:37</nova:creationTime>
Aug 26 09:26:37 user nova-compute[73104]:       <nova:flavor name="m1.tiny">
Aug 26 09:26:37 user nova-compute[73104]:         <nova:memory>512</nova:memory>
Aug 26 09:26:37 user nova-compute[73104]:         <nova:disk>1</nova:disk>
Aug 26 09:26:37 user nova-compute[73104]:         <nova:swap>0</nova:swap>
Aug 26 09:26:37 user nova-compute[73104]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 09:26:37 user nova-compute[73104]:         <nova:vcpus>1</nova:vcpus>
Aug 26 09:26:37 user nova-compute[73104]:       </nova:flavor>
Aug 26 09:26:37 user nova-compute[73104]:       <nova:owner>
Aug 26 09:26:37 user nova-compute[73104]:         <nova:user uuid="52a9f5bf03d1463488bdc3c4222297ce">tempest-SnapshotDataIntegrityTests-756955482-project-member</nova:user>
Aug 26 09:26:37 user nova-compute[73104]:         <nova:project uuid="b76e5ef4b1364dfd95283d46ddbf198d">tempest-SnapshotDataIntegrityTests-756955482</nova:project>
Aug 26 09:26:37 user nova-compute[73104]:       </nova:owner>
Aug 26 09:26:37 user nova-compute[73104]:       <nova:root type="image" uuid="e28116ef-1f27-40e2-be41-f8cc5c10ee86"/>
Aug 26 09:26:37 user nova-compute[73104]:       <nova:ports>
Aug 26 09:26:37 user nova-compute[73104]:         <nova:port uuid="43ead9d3-4205-480c-bace-f8e91986bbf1">
Aug 26 09:26:37 user nova-compute[73104]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 09:26:37 user nova-compute[73104]:         </nova:port>
Aug 26 09:26:37 user nova-compute[73104]:       </nova:ports>
Aug 26 09:26:37 user nova-compute[73104]:     </nova:instance>
Aug 26 09:26:37 user nova-compute[73104]:   </metadata>
Aug 26 09:26:37 user nova-compute[73104]:   <sysinfo type="smbios">
Aug 26 09:26:37 user nova-compute[73104]:     <system>
Aug 26 09:26:37 user nova-compute[73104]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 09:26:37 user nova-compute[73104]:       <entry name="product">OpenStack Nova</entry>
Aug 26 09:26:37 user nova-compute[73104]:       <entry name="version">0.0.0</entry>
Aug 26 09:26:37 user nova-compute[73104]:       <entry name="serial">cf7abefb-4f52-47f9-8710-7731fe1d1b95</entry>
Aug 26 09:26:37 user nova-compute[73104]:       <entry name="uuid">cf7abefb-4f52-47f9-8710-7731fe1d1b95</entry>
Aug 26 09:26:37 user nova-compute[73104]:       <entry name="family">Virtual Machine</entry>
Aug 26 09:26:37 user nova-compute[73104]:     </system>
Aug 26 09:26:37 user nova-compute[73104]:   </sysinfo>
Aug 26 09:26:37 user nova-compute[73104]:   <os>
Aug 26 09:26:37 user nova-compute[73104]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 09:26:37 user nova-compute[73104]:     <boot dev="hd"/>
Aug 26 09:26:37 user nova-compute[73104]:     <smbios mode="sysinfo"/>
Aug 26 09:26:37 user nova-compute[73104]:   </os>
Aug 26 09:26:37 user nova-compute[73104]:   <features>
Aug 26 09:26:37 user nova-compute[73104]:     <acpi/>
Aug 26 09:26:37 user nova-compute[73104]:     <apic/>
Aug 26 09:26:37 user nova-compute[73104]:     <vmcoreinfo/>
Aug 26 09:26:37 user nova-compute[73104]:   </features>
Aug 26 09:26:37 user nova-compute[73104]:   <clock offset="utc">
Aug 26 09:26:37 user nova-compute[73104]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 09:26:37 user nova-compute[73104]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 09:26:37 user nova-compute[73104]:     <timer name="hpet" present="no"/>
Aug 26 09:26:37 user nova-compute[73104]:   </clock>
Aug 26 09:26:37 user nova-compute[73104]:   <cpu mode="custom" match="exact">
Aug 26 09:26:37 user nova-compute[73104]:     <model>Nehalem</model>
Aug 26 09:26:37 user nova-compute[73104]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 09:26:37 user nova-compute[73104]:   </cpu>
Aug 26 09:26:37 user nova-compute[73104]:   <devices>
Aug 26 09:26:37 user nova-compute[73104]:     <disk type="file" device="disk">
Aug 26 09:26:37 user nova-compute[73104]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 09:26:37 user nova-compute[73104]:       <source file="/opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk"/>
Aug 26 09:26:37 user nova-compute[73104]:       <target dev="vda" bus="virtio"/>
Aug 26 09:26:37 user nova-compute[73104]:     </disk>
Aug 26 09:26:37 user nova-compute[73104]:     <interface type="ethernet">
Aug 26 09:26:37 user nova-compute[73104]:       <mac address="fa:16:3e:50:53:2c"/>
Aug 26 09:26:37 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:26:37 user nova-compute[73104]:       <mtu size="1442"/>
Aug 26 09:26:37 user nova-compute[73104]:       <target dev="tap43ead9d3-42"/>
Aug 26 09:26:37 user nova-compute[73104]:     </interface>
Aug 26 09:26:37 user nova-compute[73104]:     <serial type="pty">
Aug 26 09:26:37 user nova-compute[73104]:       <log file="/opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/console.log" append="off"/>
Aug 26 09:26:37 user nova-compute[73104]:     </serial>
Aug 26 09:26:37 user nova-compute[73104]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 09:26:37 user nova-compute[73104]:     <video>
Aug 26 09:26:37 user nova-compute[73104]:       <model type="virtio"/>
Aug 26 09:26:37 user nova-compute[73104]:     </video>
Aug 26 09:26:37 user nova-compute[73104]:     <rng model="virtio">
Aug 26 09:26:37 user nova-compute[73104]:       <backend model="random">/dev/urandom</backend>
Aug 26 09:26:37 user nova-compute[73104]:     </rng>
Aug 26 09:26:37 user nova-compute[73104]:     <controller type="usb" index="0" model="none"/>
Aug 26 09:26:37 user nova-compute[73104]:     <memballoon model="virtio">
Aug 26 09:26:37 user nova-compute[73104]:       <stats period="10"/>
Aug 26 09:26:37 user nova-compute[73104]:     </memballoon>
Aug 26 09:26:37 user nova-compute[73104]:   </devices>
Aug 26 09:26:37 user nova-compute[73104]: </domain>
Aug 26 09:26:37 user nova-compute[73104]:  {{(pid=73104) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:26:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1509733539',display_name='tempest-SnapshotDataIntegrityTests-server-1509733539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1509733539',id=53,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0OEsvdAlnlIyrF3na+qaFLlUa3PzoOF0PZ+CWi7hZ9NjA/Ay/NfXpKk1sOQ9Ik0ZbpROvxb6p8J0smgtBicDgnLkUEMUp6IHGoX3icnTx116+R+K8zgYZNdbeNGWBqDA==',key_name='tempest-keypair-468890120',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b76e5ef4b1364dfd95283d46ddbf198d',ramdisk_id='',reservation_id='r-75g8xqep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-756955482',owner_user_name='tempest-SnapshotDataIntegrityTests-756955482-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T09:26:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52a9f5bf03d1463488bdc3c4222297ce',uuid=cf7abefb-4f52-47f9-8710-7731fe1d1b95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43ead9d3-4205-480c-bace-f8e91986bbf1", "address": "fa:16:3e:50:53:2c", "network": {"id": "83a42b92-0209-424b-90c3-cd30bc69ac18", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-322258755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b76e5ef4b1364dfd95283d46ddbf198d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ead9d3-42", "ovs_interfaceid": "43ead9d3-4205-480c-bace-f8e91986bbf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Converting VIF {"id": "43ead9d3-4205-480c-bace-f8e91986bbf1", "address": "fa:16:3e:50:53:2c", "network": {"id": "83a42b92-0209-424b-90c3-cd30bc69ac18", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-322258755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b76e5ef4b1364dfd95283d46ddbf198d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ead9d3-42", "ovs_interfaceid": "43ead9d3-4205-480c-bace-f8e91986bbf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:53:2c,bridge_name='br-int',has_traffic_filtering=True,id=43ead9d3-4205-480c-bace-f8e91986bbf1,network=Network(83a42b92-0209-424b-90c3-cd30bc69ac18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43ead9d3-42') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG os_vif [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:53:2c,bridge_name='br-int',has_traffic_filtering=True,id=43ead9d3-4205-480c-bace-f8e91986bbf1,network=Network(83a42b92-0209-424b-90c3-cd30bc69ac18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43ead9d3-42') {{(pid=73104) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43ead9d3-42, may_exist=True, interface_attrs={}) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap43ead9d3-42, col_values=(('external_ids', {'iface-id': '43ead9d3-4205-480c-bace-f8e91986bbf1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:53:2c', 'vm-uuid': 'cf7abefb-4f52-47f9-8710-7731fe1d1b95'}),), if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:26:37 user nova-compute[73104]: INFO os_vif [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:53:2c,bridge_name='br-int',has_traffic_filtering=True,id=43ead9d3-4205-480c-bace-f8e91986bbf1,network=Network(83a42b92-0209-424b-90c3-cd30bc69ac18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43ead9d3-42')
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:26:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] No VIF found with MAC fa:16:3e:50:53:2c, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 09:26:38 user nova-compute[73104]: DEBUG nova.network.neutron [req-976618dc-1a0d-46f5-bf00-6e1bf223af20 req-f29c6dcc-688a-46f8-9cbc-2b484c9a61d2 service nova] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Updated VIF entry in instance network info cache for port 43ead9d3-4205-480c-bace-f8e91986bbf1. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:26:38 user nova-compute[73104]: DEBUG nova.network.neutron [req-976618dc-1a0d-46f5-bf00-6e1bf223af20 req-f29c6dcc-688a-46f8-9cbc-2b484c9a61d2 service nova] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Updating instance_info_cache with network_info: [{"id": "43ead9d3-4205-480c-bace-f8e91986bbf1", "address": "fa:16:3e:50:53:2c", "network": {"id": "83a42b92-0209-424b-90c3-cd30bc69ac18", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-322258755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b76e5ef4b1364dfd95283d46ddbf198d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ead9d3-42", "ovs_interfaceid": "43ead9d3-4205-480c-bace-f8e91986bbf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:26:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-976618dc-1a0d-46f5-bf00-6e1bf223af20 req-f29c6dcc-688a-46f8-9cbc-2b484c9a61d2 service nova] Releasing lock "refresh_cache-cf7abefb-4f52-47f9-8710-7731fe1d1b95" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:26:38 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:26:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:26:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:26:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:26:39 user nova-compute[73104]: DEBUG nova.compute.manager [req-26d97ddc-c34f-4c81-8f2b-a1b5a16a1bfa req-904d6890-2a0e-4e21-b0ed-30f90b55900f service nova] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Received event network-vif-plugged-43ead9d3-4205-480c-bace-f8e91986bbf1 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:26:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-26d97ddc-c34f-4c81-8f2b-a1b5a16a1bfa req-904d6890-2a0e-4e21-b0ed-30f90b55900f service nova] Acquiring lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:26:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-26d97ddc-c34f-4c81-8f2b-a1b5a16a1bfa req-904d6890-2a0e-4e21-b0ed-30f90b55900f service nova] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:26:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-26d97ddc-c34f-4c81-8f2b-a1b5a16a1bfa req-904d6890-2a0e-4e21-b0ed-30f90b55900f service nova] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:26:39 user nova-compute[73104]: DEBUG nova.compute.manager [req-26d97ddc-c34f-4c81-8f2b-a1b5a16a1bfa req-904d6890-2a0e-4e21-b0ed-30f90b55900f service nova] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] No waiting events found dispatching network-vif-plugged-43ead9d3-4205-480c-bace-f8e91986bbf1 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:26:39 user nova-compute[73104]: WARNING nova.compute.manager [req-26d97ddc-c34f-4c81-8f2b-a1b5a16a1bfa req-904d6890-2a0e-4e21-b0ed-30f90b55900f service nova] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Received unexpected event network-vif-plugged-43ead9d3-4205-480c-bace-f8e91986bbf1 for instance with vm_state building and task_state spawning.
Aug 26 09:26:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:26:39 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:26:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:26:41 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693042001.5980103, cf7abefb-4f52-47f9-8710-7731fe1d1b95 => Resumed> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:26:41 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] VM Resumed (Lifecycle Event)
Aug 26 09:26:41 user nova-compute[73104]: DEBUG nova.compute.manager [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Instance event wait completed in 0 seconds for  {{(pid=73104) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 09:26:41 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Guest created on hypervisor {{(pid=73104) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 09:26:41 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Instance spawned successfully.
Aug 26 09:26:41 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 09:26:41 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:26:41 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:26:41 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Found default for hw_cdrom_bus of ide {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:26:41 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Found default for hw_disk_bus of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:26:41 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Found default for hw_input_bus of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:26:41 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Found default for hw_pointer_model of None {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:26:41 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Found default for hw_video_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:26:41 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Found default for hw_vif_model of virtio {{(pid=73104) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 09:26:41 user nova-compute[73104]: DEBUG nova.compute.manager [req-8a600c24-354d-4980-aebf-8fe40cf5250c req-13298953-815b-4a10-9fa8-a5180e3f254a service nova] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Received event network-vif-plugged-43ead9d3-4205-480c-bace-f8e91986bbf1 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:26:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-8a600c24-354d-4980-aebf-8fe40cf5250c req-13298953-815b-4a10-9fa8-a5180e3f254a service nova] Acquiring lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:26:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-8a600c24-354d-4980-aebf-8fe40cf5250c req-13298953-815b-4a10-9fa8-a5180e3f254a service nova] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:26:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-8a600c24-354d-4980-aebf-8fe40cf5250c req-13298953-815b-4a10-9fa8-a5180e3f254a service nova] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:26:41 user nova-compute[73104]: DEBUG nova.compute.manager [req-8a600c24-354d-4980-aebf-8fe40cf5250c req-13298953-815b-4a10-9fa8-a5180e3f254a service nova] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] No waiting events found dispatching network-vif-plugged-43ead9d3-4205-480c-bace-f8e91986bbf1 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:26:41 user nova-compute[73104]: WARNING nova.compute.manager [req-8a600c24-354d-4980-aebf-8fe40cf5250c req-13298953-815b-4a10-9fa8-a5180e3f254a service nova] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Received unexpected event network-vif-plugged-43ead9d3-4205-480c-bace-f8e91986bbf1 for instance with vm_state building and task_state spawning.
Aug 26 09:26:41 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 09:26:41 user nova-compute[73104]: DEBUG nova.virt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Emitting event <LifecycleEvent: 1693042001.6018605, cf7abefb-4f52-47f9-8710-7731fe1d1b95 => Started> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:26:41 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] VM Started (Lifecycle Event)
Aug 26 09:26:41 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:26:41 user nova-compute[73104]: DEBUG nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73104) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 09:26:41 user nova-compute[73104]: INFO nova.compute.manager [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 09:26:41 user nova-compute[73104]: INFO nova.compute.manager [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Took 6.37 seconds to spawn the instance on the hypervisor.
Aug 26 09:26:41 user nova-compute[73104]: DEBUG nova.compute.manager [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:26:41 user nova-compute[73104]: INFO nova.compute.manager [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Took 7.24 seconds to build instance.
Aug 26 09:26:41 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-6b775385-4e9b-449f-b463-bee9ba288ae8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.347s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:26:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:26:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:26:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:26:50 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:26:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:26:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:27:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:27:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:27:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:27:06 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:27:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:27:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:27:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:27:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:27:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:27:23 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:27:23 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:27:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:27:30 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:27:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:27:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:27:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:27:30 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:27:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:27:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:27:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:27:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:27:31 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:27:31 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:27:31 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8588MB free_disk=24.070934295654297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:27:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:27:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:27:31 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance cf7abefb-4f52-47f9-8710-7731fe1d1b95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:27:31 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:27:31 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:27:31 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:27:31 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:27:31 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:27:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.236s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:27:32 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:27:32 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:27:32 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:27:32 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Rebuilding the list of instances to heal {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 09:27:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-cf7abefb-4f52-47f9-8710-7731fe1d1b95" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:27:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-cf7abefb-4f52-47f9-8710-7731fe1d1b95" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:27:32 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 09:27:32 user nova-compute[73104]: DEBUG nova.objects.instance [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lazy-loading 'info_cache' on Instance uuid cf7abefb-4f52-47f9-8710-7731fe1d1b95 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:27:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:27:32 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Updating instance_info_cache with network_info: [{"id": "43ead9d3-4205-480c-bace-f8e91986bbf1", "address": "fa:16:3e:50:53:2c", "network": {"id": "83a42b92-0209-424b-90c3-cd30bc69ac18", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-322258755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b76e5ef4b1364dfd95283d46ddbf198d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ead9d3-42", "ovs_interfaceid": "43ead9d3-4205-480c-bace-f8e91986bbf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:27:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-cf7abefb-4f52-47f9-8710-7731fe1d1b95" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:27:32 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 09:27:32 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:27:32 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:27:34 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:27:36 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:27:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:27:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:27:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:27:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:27:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:27:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:27:40 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:27:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:27:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:27:48 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:27:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:27:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:27:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:27:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:27:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:27:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:27:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:27:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:27:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:27:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:27:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:27:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:28:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:28:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:28:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:28:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:28:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:28:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:28:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:28:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:28:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:28:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:28:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:28:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:28:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:28:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:28:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:28:24 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:28:24 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:28:26 user nova-compute[73104]: DEBUG nova.compute.manager [req-e2e5565d-a5c3-4863-8bf6-bccc275d3be6 req-c5dee207-f340-4de3-88f4-f878bb422a4d service nova] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Received event network-changed-43ead9d3-4205-480c-bace-f8e91986bbf1 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:28:26 user nova-compute[73104]: DEBUG nova.compute.manager [req-e2e5565d-a5c3-4863-8bf6-bccc275d3be6 req-c5dee207-f340-4de3-88f4-f878bb422a4d service nova] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Refreshing instance network info cache due to event network-changed-43ead9d3-4205-480c-bace-f8e91986bbf1. {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 09:28:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e2e5565d-a5c3-4863-8bf6-bccc275d3be6 req-c5dee207-f340-4de3-88f4-f878bb422a4d service nova] Acquiring lock "refresh_cache-cf7abefb-4f52-47f9-8710-7731fe1d1b95" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:28:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e2e5565d-a5c3-4863-8bf6-bccc275d3be6 req-c5dee207-f340-4de3-88f4-f878bb422a4d service nova] Acquired lock "refresh_cache-cf7abefb-4f52-47f9-8710-7731fe1d1b95" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:28:26 user nova-compute[73104]: DEBUG nova.network.neutron [req-e2e5565d-a5c3-4863-8bf6-bccc275d3be6 req-c5dee207-f340-4de3-88f4-f878bb422a4d service nova] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Refreshing network info cache for port 43ead9d3-4205-480c-bace-f8e91986bbf1 {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 09:28:26 user nova-compute[73104]: DEBUG nova.network.neutron [req-e2e5565d-a5c3-4863-8bf6-bccc275d3be6 req-c5dee207-f340-4de3-88f4-f878bb422a4d service nova] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Updated VIF entry in instance network info cache for port 43ead9d3-4205-480c-bace-f8e91986bbf1. {{(pid=73104) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 09:28:26 user nova-compute[73104]: DEBUG nova.network.neutron [req-e2e5565d-a5c3-4863-8bf6-bccc275d3be6 req-c5dee207-f340-4de3-88f4-f878bb422a4d service nova] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Updating instance_info_cache with network_info: [{"id": "43ead9d3-4205-480c-bace-f8e91986bbf1", "address": "fa:16:3e:50:53:2c", "network": {"id": "83a42b92-0209-424b-90c3-cd30bc69ac18", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-322258755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b76e5ef4b1364dfd95283d46ddbf198d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ead9d3-42", "ovs_interfaceid": "43ead9d3-4205-480c-bace-f8e91986bbf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:28:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-e2e5565d-a5c3-4863-8bf6-bccc275d3be6 req-c5dee207-f340-4de3-88f4-f878bb422a4d service nova] Releasing lock "refresh_cache-cf7abefb-4f52-47f9-8710-7731fe1d1b95" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:28:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:28:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:28:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:28:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:28:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:28:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:28:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:28:30 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:28:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:28:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:28:30 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:28:30 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:28:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:28:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:28:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:28:30 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:28:31 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:28:31 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:28:31 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8706MB free_disk=24.06122589111328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:28:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:28:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:28:31 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance cf7abefb-4f52-47f9-8710-7731fe1d1b95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:28:31 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:28:31 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:28:31 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Refreshing inventories for resource provider 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 09:28:31 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Updating ProviderTree inventory for provider 8a2a2397-4d47-4524-8146-84db4225a812 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 09:28:31 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Updating inventory in ProviderTree for provider 8a2a2397-4d47-4524-8146-84db4225a812 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 09:28:31 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Refreshing aggregate associations for resource provider 8a2a2397-4d47-4524-8146-84db4225a812, aggregates: None {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 09:28:31 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Refreshing trait associations for resource provider 8a2a2397-4d47-4524-8146-84db4225a812, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 09:28:31 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:28:31 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:28:31 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:28:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.399s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:28:31 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:28:31 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73104) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 09:28:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Acquiring lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:28:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:28:31 user nova-compute[73104]: DEBUG nova.objects.instance [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lazy-loading 'flavor' on Instance uuid cf7abefb-4f52-47f9-8710-7731fe1d1b95 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:28:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:28:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Acquiring lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:28:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:28:31 user nova-compute[73104]: INFO nova.compute.manager [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Attaching volume e2aa201e-c072-4718-ad2f-a377842dd9b9 to /dev/vdb
Aug 26 09:28:31 user nova-compute[73104]: DEBUG os_brick.utils [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:28:31 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:28:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:28:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8579078-1c78-43c1-aa89-d3288b139a47]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:28:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:28:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:28:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a95e30-9986-4688-a09c-fdaccef0dd65]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:28:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:28:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:28:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb8bdf0-8616-4446-a873-9df46cff609c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:28:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b08b23-e575-475b-9f14-62ca482bd96b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:28:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:28:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:28:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 09:28:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:28:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:28:32 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 09:28:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d3ec48-f1d1-4c60-9fa1-0233c389897b]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:28:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 09:28:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 09:28:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 09:28:32 user nova-compute[73104]: DEBUG os_brick.utils [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:28:32 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Updating existing volume attachment record: 9b62d2ed-6a4e-4b2e-ab5a-5ef9f0253d70 {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 09:28:32 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:28:32 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:28:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:28:33 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:28:33 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:28:33 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Rebuilding the list of instances to heal {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 09:28:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-cf7abefb-4f52-47f9-8710-7731fe1d1b95" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:28:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-cf7abefb-4f52-47f9-8710-7731fe1d1b95" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:28:33 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 09:28:33 user nova-compute[73104]: DEBUG nova.objects.instance [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lazy-loading 'info_cache' on Instance uuid cf7abefb-4f52-47f9-8710-7731fe1d1b95 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:28:33 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Updating instance_info_cache with network_info: [{"id": "43ead9d3-4205-480c-bace-f8e91986bbf1", "address": "fa:16:3e:50:53:2c", "network": {"id": "83a42b92-0209-424b-90c3-cd30bc69ac18", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-322258755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b76e5ef4b1364dfd95283d46ddbf198d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ead9d3-42", "ovs_interfaceid": "43ead9d3-4205-480c-bace-f8e91986bbf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:28:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-cf7abefb-4f52-47f9-8710-7731fe1d1b95" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:28:33 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 09:28:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:28:34 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:28:35 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:28:36 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:28:36 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:28:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QikZGhDN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:28:42 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:28:42 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:28:42 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:28:42 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:28:42 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 09:28:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[533c7f1c-c4f1-46fa-bd5e-7aa899a6d403]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 09:28:42 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5222d9-0ebe-4d3f-99d6-6a137aec7aa7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9] added
Aug 26 09:28:42 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7d72a1-9aea-4710-b971-2ad09eec15a0]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fc9a00-8a6f-4562-bcbd-d2c347a72401]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QikZGhDN {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QikZGhDN" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae8cdb4-d1d8-49a1-9929-21b5069727fe]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QikZGhDN'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf73f92-6d3b-4e7e-9f94-7f0c3d290e1a]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b03003a-d5c0-434d-a334-23d3b0b46042]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 09:28:42 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 09:28:42 user nova-compute[73104]:  {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:28:42 user nova-compute[73104]: WARNING os_brick.initiator.connectors.iscsi [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 09:28:42 user nova-compute[73104]: 
Aug 26 09:28:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1657e1-cebe-43c4-b16c-ed098c47a546]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9, portal: 172.16.0.220,3260]
Aug 26 09:28:42 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9, portal: 172.16.0.220,3260] successful.
Aug 26 09:28:42 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cc5ab0-51d0-4d18-a0b4-622c1511c97f]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae62b51-d680-4822-9a58-e3af63ef3845]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9 (non-flash)
Aug 26 09:28:42 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9 (non-flash)
Aug 26 09:28:42 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[83be327f-6400-4a6d-9f3d-b37ea4ee6acd]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 09:28:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:28:43 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 09:28:43 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QikZGhDN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 09:28:43 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:28:43 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23534306438373463', 'path': '/dev/sdb'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:28:43 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534306438373463', 'path': '/dev/sdb'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 09:28:43 user nova-compute[73104]: DEBUG nova.objects.instance [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lazy-loading 'flavor' on Instance uuid cf7abefb-4f52-47f9-8710-7731fe1d1b95 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:28:43 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 09:28:43 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:28:43 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 09:28:43 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:28:43 user nova-compute[73104]:   <serial>e2aa201e-c072-4718-ad2f-a377842dd9b9</serial>
Aug 26 09:28:43 user nova-compute[73104]: </disk>
Aug 26 09:28:43 user nova-compute[73104]:  {{(pid=73104) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 09:28:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:28:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:28:44 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] No VIF found with MAC fa:16:3e:50:53:2c, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 09:28:44 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-3901d6b1-e514-46a6-9fba-4625abdc4bea tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.485s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:28:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:28:47 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:28:47 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Cleaning up deleted instances {{(pid=73104) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 09:28:47 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] There are 0 instances to clean {{(pid=73104) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 09:28:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:28:50 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:28:51 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:28:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:28:55 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:28:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:29:00 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:29:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:29:05 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:29:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:29:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:29:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:29:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a6b839ec-19a1-48f6-b677-f7400177e31d tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Acquiring lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:29:13 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a6b839ec-19a1-48f6-b677-f7400177e31d tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:29:13 user nova-compute[73104]: INFO nova.compute.manager [None req-a6b839ec-19a1-48f6-b677-f7400177e31d tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Detaching volume e2aa201e-c072-4718-ad2f-a377842dd9b9
Aug 26 09:29:13 user nova-compute[73104]: INFO nova.virt.block_device [None req-a6b839ec-19a1-48f6-b677-f7400177e31d tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Attempting to driver detach volume e2aa201e-c072-4718-ad2f-a377842dd9b9 from mountpoint /dev/vdb
Aug 26 09:29:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6b839ec-19a1-48f6-b677-f7400177e31d tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Attempting to detach device vdb from instance cf7abefb-4f52-47f9-8710-7731fe1d1b95 from the persistent domain config. {{(pid=73104) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 09:29:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-a6b839ec-19a1-48f6-b677-f7400177e31d tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 09:29:13 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:29:13 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 09:29:13 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:29:13 user nova-compute[73104]:   <serial>e2aa201e-c072-4718-ad2f-a377842dd9b9</serial>
Aug 26 09:29:13 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 09:29:13 user nova-compute[73104]: </disk>
Aug 26 09:29:13 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 09:29:13 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-a6b839ec-19a1-48f6-b677-f7400177e31d tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Successfully detached device vdb from instance cf7abefb-4f52-47f9-8710-7731fe1d1b95 from the persistent domain config.
Aug 26 09:29:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6b839ec-19a1-48f6-b677-f7400177e31d tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cf7abefb-4f52-47f9-8710-7731fe1d1b95 from the live domain config. {{(pid=73104) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 09:29:13 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-a6b839ec-19a1-48f6-b677-f7400177e31d tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 09:29:13 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:29:13 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 09:29:13 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:29:13 user nova-compute[73104]:   <serial>e2aa201e-c072-4718-ad2f-a377842dd9b9</serial>
Aug 26 09:29:13 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 09:29:13 user nova-compute[73104]: </disk>
Aug 26 09:29:13 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Received event <DeviceRemovedEvent: 1693042154.3088796, cf7abefb-4f52-47f9-8710-7731fe1d1b95 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73104) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-a6b839ec-19a1-48f6-b677-f7400177e31d tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cf7abefb-4f52-47f9-8710-7731fe1d1b95 {{(pid=73104) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 09:29:14 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-a6b839ec-19a1-48f6-b677-f7400177e31d tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Successfully detached device vdb from instance cf7abefb-4f52-47f9-8710-7731fe1d1b95 from the live domain config.
Aug 26 09:29:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6b839ec-19a1-48f6-b677-f7400177e31d tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b839ec-19a1-48f6-b677-f7400177e31d tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QikZGhDN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:29:14 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-a6b839ec-19a1-48f6-b677-f7400177e31d tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:29:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-a6b839ec-19a1-48f6-b677-f7400177e31d tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-a6b839ec-19a1-48f6-b677-f7400177e31d tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b839ec-19a1-48f6-b677-f7400177e31d tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bad7ce1-4a38-4cf3-8d6b-6ac17fcc911f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59e7e0f-3bc2-4edd-b1d9-8311887132ff]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b839ec-19a1-48f6-b677-f7400177e31d tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9 (non-flash)
Aug 26 09:29:14 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b839ec-19a1-48f6-b677-f7400177e31d tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9 (non-flash)
Aug 26 09:29:14 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b839ec-19a1-48f6-b677-f7400177e31d tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0cc06a200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9'): ({'sdb'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-a6b839ec-19a1-48f6-b677-f7400177e31d tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Removing single pathed devices sdb {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f464ab8-c90c-4a5e-b893-f8b46b8d303e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[137d07ae-18cd-49f5-9b25-89f0df3b4f4e]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-a6b839ec-19a1-48f6-b677-f7400177e31d tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Flushing IO for device /dev/sdb {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99cec88-3ca6-486e-be6f-dc07ac5d35b7]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-a6b839ec-19a1-48f6-b677-f7400177e31d tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af3c72a-4cd8-469f-b2c1-d514efb905a1]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-a6b839ec-19a1-48f6-b677-f7400177e31d tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-a6b839ec-19a1-48f6-b677-f7400177e31d tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b839ec-19a1-48f6-b677-f7400177e31d tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2640a3-3816-4d68-a23e-ca5cea966083]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b839ec-19a1-48f6-b677-f7400177e31d tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fa320c-9580-48f2-b03a-2447682510e1]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b839ec-19a1-48f6-b677-f7400177e31d tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9, portal: 172.16.0.220,3260]
Aug 26 09:29:14 user nova-compute[73104]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9, portal: 172.16.0.220,3260] successful.
Aug 26 09:29:14 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2aa201e-c072-4718-ad2f-a377842dd9b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82581df-bbd7-4536-93de-a54c355b0c3f]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b839ec-19a1-48f6-b677-f7400177e31d tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-a6b839ec-19a1-48f6-b677-f7400177e31d tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b839ec-19a1-48f6-b677-f7400177e31d tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] <== disconnect_volume: return (273ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:29:14 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6b839ec-19a1-48f6-b677-f7400177e31d tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 09:29:15 user nova-compute[73104]: DEBUG nova.objects.instance [None req-a6b839ec-19a1-48f6-b677-f7400177e31d tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lazy-loading 'flavor' on Instance uuid cf7abefb-4f52-47f9-8710-7731fe1d1b95 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:29:15 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-a6b839ec-19a1-48f6-b677-f7400177e31d tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.712s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:29:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:29:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:29:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:29:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:29:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:29:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:29:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:29:24 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:29:24 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:29:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:29:31 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:29:31 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:29:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:29:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:29:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:29:31 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:29:31 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:29:31 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:29:31 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:29:31 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:29:32 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:29:32 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:29:32 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8764MB free_disk=24.059803009033203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:29:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:29:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:29:32 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance cf7abefb-4f52-47f9-8710-7731fe1d1b95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:29:32 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:29:32 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:29:32 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:29:32 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:29:32 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:29:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:29:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:29:34 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:29:34 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:29:34 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:29:34 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Rebuilding the list of instances to heal {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 09:29:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-cf7abefb-4f52-47f9-8710-7731fe1d1b95" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:29:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-cf7abefb-4f52-47f9-8710-7731fe1d1b95" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:29:34 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 09:29:34 user nova-compute[73104]: DEBUG nova.objects.instance [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lazy-loading 'info_cache' on Instance uuid cf7abefb-4f52-47f9-8710-7731fe1d1b95 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:29:34 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Updating instance_info_cache with network_info: [{"id": "43ead9d3-4205-480c-bace-f8e91986bbf1", "address": "fa:16:3e:50:53:2c", "network": {"id": "83a42b92-0209-424b-90c3-cd30bc69ac18", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-322258755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b76e5ef4b1364dfd95283d46ddbf198d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ead9d3-42", "ovs_interfaceid": "43ead9d3-4205-480c-bace-f8e91986bbf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:29:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-cf7abefb-4f52-47f9-8710-7731fe1d1b95" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:29:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 09:29:35 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:29:36 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:29:37 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:29:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:29:42 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:29:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:29:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:29:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:29:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:29:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:29:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:29:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:29:50 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:29:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:29:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:30:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:30:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:30:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Acquiring lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:30:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:30:07 user nova-compute[73104]: DEBUG nova.objects.instance [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lazy-loading 'flavor' on Instance uuid cf7abefb-4f52-47f9-8710-7731fe1d1b95 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:30:07 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:30:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Acquiring lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:30:08 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:30:08 user nova-compute[73104]: INFO nova.compute.manager [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Attaching volume 6a11fd45-409e-414c-8799-ca3cd3128670 to /dev/vdb
Aug 26 09:30:08 user nova-compute[73104]: DEBUG os_brick.utils [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:30:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:30:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:30:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cd4dfa-32aa-422d-9c0b-ec262d359612]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:30:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:30:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:30:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[236749e3-6e5f-45ef-aad2-357ecaa1dd3c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:30:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:30:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:30:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[693b2c87-b4da-4ed8-a71a-78122f769165]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:30:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a53818-9f94-4c59-a623-0b723f8117e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:30:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:30:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:30:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 09:30:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:30:08 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:30:08 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 09:30:08 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[3547988a-d419-40ac-98d9-2d50f6f7a3ed]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:30:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 09:30:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 09:30:08 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 09:30:08 user nova-compute[73104]: DEBUG os_brick.utils [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:30:08 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Updating existing volume attachment record: 94579300-cc50-47e1-a828-41949ad42325 {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 09:30:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:30:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:30:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CBpagTHq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:30:18 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:30:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:30:18 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:30:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:30:18 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 09:30:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc9737b-13cf-4c96-abba-99030c578aba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 09:30:18 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[163c611b-6427-4ab7-99fd-8a3494ae5bcc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670] added
Aug 26 09:30:18 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46ea90b-58a4-42dd-9a3b-c2e5f8143cd2]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe3d535-a2ed-43c1-b51c-9347ffcd2e61]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CBpagTHq {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CBpagTHq" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbeafd28-a78f-48bb-b6ae-4d8412277357]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CBpagTHq'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31774ac-0564-4161-870d-7ea7b2b55cbc]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[5482266b-a089-461f-a1b5-8c655b32e817]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 09:30:18 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 09:30:18 user nova-compute[73104]:  {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:30:18 user nova-compute[73104]: WARNING os_brick.initiator.connectors.iscsi [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 09:30:18 user nova-compute[73104]: 
Aug 26 09:30:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed38953e-3402-4bce-b763-1cdd28dd7df1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670, portal: 172.16.0.220,3260]
Aug 26 09:30:18 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670, portal: 172.16.0.220,3260] successful.
Aug 26 09:30:18 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7ba626-5cca-40a1-bbfa-a20e29b489f1]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0200b430-d946-4580-870c-cc935d47fd86]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670 (non-flash)
Aug 26 09:30:18 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670 (non-flash)
Aug 26 09:30:18 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3ba402-30f9-4bb3-94dc-efb8e74e9235]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 09:30:18 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CBpagTHq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 09:30:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:30:19 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26539393239626333', 'path': '/dev/sdb'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:30:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539393239626333', 'path': '/dev/sdb'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 09:30:19 user nova-compute[73104]: DEBUG nova.objects.instance [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lazy-loading 'flavor' on Instance uuid cf7abefb-4f52-47f9-8710-7731fe1d1b95 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:30:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 09:30:19 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:30:19 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 09:30:19 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:30:19 user nova-compute[73104]:   <serial>6a11fd45-409e-414c-8799-ca3cd3128670</serial>
Aug 26 09:30:19 user nova-compute[73104]: </disk>
Aug 26 09:30:19 user nova-compute[73104]:  {{(pid=73104) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 09:30:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:30:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:30:19 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] No VIF found with MAC fa:16:3e:50:53:2c, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 09:30:20 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-4f820fe8-5946-4768-9a0f-fa13c8d8a2d4 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.026s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:30:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d2f1d756-997d-4b2f-acd0-aedf9ad9c3a0 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Acquiring lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:30:22 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d2f1d756-997d-4b2f-acd0-aedf9ad9c3a0 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:30:22 user nova-compute[73104]: INFO nova.compute.manager [None req-d2f1d756-997d-4b2f-acd0-aedf9ad9c3a0 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Detaching volume 6a11fd45-409e-414c-8799-ca3cd3128670
Aug 26 09:30:22 user nova-compute[73104]: INFO nova.virt.block_device [None req-d2f1d756-997d-4b2f-acd0-aedf9ad9c3a0 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Attempting to driver detach volume 6a11fd45-409e-414c-8799-ca3cd3128670 from mountpoint /dev/vdb
Aug 26 09:30:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d2f1d756-997d-4b2f-acd0-aedf9ad9c3a0 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Attempting to detach device vdb from instance cf7abefb-4f52-47f9-8710-7731fe1d1b95 from the persistent domain config. {{(pid=73104) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 09:30:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-d2f1d756-997d-4b2f-acd0-aedf9ad9c3a0 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 09:30:22 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:30:22 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 09:30:22 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:30:22 user nova-compute[73104]:   <serial>6a11fd45-409e-414c-8799-ca3cd3128670</serial>
Aug 26 09:30:22 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 09:30:22 user nova-compute[73104]: </disk>
Aug 26 09:30:22 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 09:30:22 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-d2f1d756-997d-4b2f-acd0-aedf9ad9c3a0 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Successfully detached device vdb from instance cf7abefb-4f52-47f9-8710-7731fe1d1b95 from the persistent domain config.
Aug 26 09:30:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d2f1d756-997d-4b2f-acd0-aedf9ad9c3a0 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cf7abefb-4f52-47f9-8710-7731fe1d1b95 from the live domain config. {{(pid=73104) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 09:30:22 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-d2f1d756-997d-4b2f-acd0-aedf9ad9c3a0 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 09:30:22 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:30:22 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 09:30:22 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:30:22 user nova-compute[73104]:   <serial>6a11fd45-409e-414c-8799-ca3cd3128670</serial>
Aug 26 09:30:22 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 09:30:22 user nova-compute[73104]: </disk>
Aug 26 09:30:22 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 09:30:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Received event <DeviceRemovedEvent: 1693042223.3336818, cf7abefb-4f52-47f9-8710-7731fe1d1b95 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73104) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d2f1d756-997d-4b2f-acd0-aedf9ad9c3a0 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cf7abefb-4f52-47f9-8710-7731fe1d1b95 {{(pid=73104) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 09:30:23 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-d2f1d756-997d-4b2f-acd0-aedf9ad9c3a0 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Successfully detached device vdb from instance cf7abefb-4f52-47f9-8710-7731fe1d1b95 from the live domain config.
Aug 26 09:30:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2f1d756-997d-4b2f-acd0-aedf9ad9c3a0 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f1d756-997d-4b2f-acd0-aedf9ad9c3a0 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CBpagTHq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:30:23 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-d2f1d756-997d-4b2f-acd0-aedf9ad9c3a0 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:30:23 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-d2f1d756-997d-4b2f-acd0-aedf9ad9c3a0 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-d2f1d756-997d-4b2f-acd0-aedf9ad9c3a0 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f1d756-997d-4b2f-acd0-aedf9ad9c3a0 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f259864a-1395-49e2-b9f3-9bd334aa8671]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a14286-d172-4786-b3c4-d30dbe327fe8]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f1d756-997d-4b2f-acd0-aedf9ad9c3a0 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670 (non-flash)
Aug 26 09:30:23 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f1d756-997d-4b2f-acd0-aedf9ad9c3a0 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670 (non-flash)
Aug 26 09:30:23 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f1d756-997d-4b2f-acd0-aedf9ad9c3a0 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0c4185c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670'): ({'sdb'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-d2f1d756-997d-4b2f-acd0-aedf9ad9c3a0 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Removing single pathed devices sdb {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7d444b-8b8e-413f-80c3-f6d1807502d3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f5c09a-d983-43c8-a92e-beca834477d0]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-d2f1d756-997d-4b2f-acd0-aedf9ad9c3a0 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Flushing IO for device /dev/sdb {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[1297a5f7-329a-4e73-a75f-63e786e44142]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-d2f1d756-997d-4b2f-acd0-aedf9ad9c3a0 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a809da9-dcaa-43c2-affa-b8adb5a9b6dc]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-d2f1d756-997d-4b2f-acd0-aedf9ad9c3a0 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-d2f1d756-997d-4b2f-acd0-aedf9ad9c3a0 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f1d756-997d-4b2f-acd0-aedf9ad9c3a0 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d0c79b-13a6-4f84-aee2-e1647cffdb65]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f1d756-997d-4b2f-acd0-aedf9ad9c3a0 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b98d82-3dc7-4478-9db9-6cf2a61dbdf4]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f1d756-997d-4b2f-acd0-aedf9ad9c3a0 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670, portal: 172.16.0.220,3260]
Aug 26 09:30:23 user nova-compute[73104]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670, portal: 172.16.0.220,3260] successful.
Aug 26 09:30:23 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a11fd45-409e-414c-8799-ca3cd3128670 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d86385-caaf-454e-b393-61b18b5cfec8]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f1d756-997d-4b2f-acd0-aedf9ad9c3a0 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-d2f1d756-997d-4b2f-acd0-aedf9ad9c3a0 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f1d756-997d-4b2f-acd0-aedf9ad9c3a0 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] <== disconnect_volume: return (281ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:30:23 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2f1d756-997d-4b2f-acd0-aedf9ad9c3a0 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 09:30:24 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:30:24 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:30:24 user nova-compute[73104]: DEBUG nova.objects.instance [None req-d2f1d756-997d-4b2f-acd0-aedf9ad9c3a0 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lazy-loading 'flavor' on Instance uuid cf7abefb-4f52-47f9-8710-7731fe1d1b95 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:30:24 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d2f1d756-997d-4b2f-acd0-aedf9ad9c3a0 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.643s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:30:25 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:30:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:30:32 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:30:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:30:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:30:32 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:30:32 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:30:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:30:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:30:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:30:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:30:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:30:33 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:30:33 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:30:33 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8745MB free_disk=24.05877685546875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:30:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:30:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:30:33 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance cf7abefb-4f52-47f9-8710-7731fe1d1b95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:30:33 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:30:33 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:30:33 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:30:33 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:30:33 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:30:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:30:34 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:30:34 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:30:35 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:30:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:30:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Rebuilding the list of instances to heal {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 09:30:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-cf7abefb-4f52-47f9-8710-7731fe1d1b95" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:30:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-cf7abefb-4f52-47f9-8710-7731fe1d1b95" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:30:35 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 09:30:35 user nova-compute[73104]: DEBUG nova.objects.instance [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lazy-loading 'info_cache' on Instance uuid cf7abefb-4f52-47f9-8710-7731fe1d1b95 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:30:35 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Updating instance_info_cache with network_info: [{"id": "43ead9d3-4205-480c-bace-f8e91986bbf1", "address": "fa:16:3e:50:53:2c", "network": {"id": "83a42b92-0209-424b-90c3-cd30bc69ac18", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-322258755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b76e5ef4b1364dfd95283d46ddbf198d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ead9d3-42", "ovs_interfaceid": "43ead9d3-4205-480c-bace-f8e91986bbf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:30:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-cf7abefb-4f52-47f9-8710-7731fe1d1b95" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:30:35 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 09:30:35 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:30:37 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:30:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:30:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:30:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:30:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:30:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:30:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:30:38 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:30:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:30:43 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:30:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:30:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:30:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:31:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:31:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:31:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:31:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Acquiring lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:31:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:31:17 user nova-compute[73104]: DEBUG nova.objects.instance [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lazy-loading 'flavor' on Instance uuid cf7abefb-4f52-47f9-8710-7731fe1d1b95 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:31:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:31:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Acquiring lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:31:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:31:17 user nova-compute[73104]: INFO nova.compute.manager [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Attaching volume a7ff2da9-4c01-4161-8202-32aa865c87fe to /dev/vdb
Aug 26 09:31:17 user nova-compute[73104]: DEBUG os_brick.utils [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:31:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:31:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:31:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[70177715-7550-4ab5-b3c6-c2b77785b68d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:31:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:31:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:31:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[468f0275-b0af-4a6d-9e25-822411aa4e3f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:31:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:31:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:31:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c238fd82-6418-4172-868d-da3aa0113ddf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:31:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8605c3f-2f26-4380-a878-2686a40ec38f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:31:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:31:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:31:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 09:31:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:31:17 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:31:17 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 09:31:17 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f1dc09-29f4-4854-8e46-190135942135]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:31:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 09:31:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 09:31:17 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 09:31:17 user nova-compute[73104]: DEBUG os_brick.utils [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:31:17 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Updating existing volume attachment record: 98733ae6-4afb-4323-93cb-b54fd7cf37ae {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 09:31:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:31:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:31:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:31:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:31:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:31:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:31:20 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:31:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:31:25 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:31:25 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KdvmHnif', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:31:27 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:31:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:31:27 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:31:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:31:27 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 09:31:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cdec54-8af2-4fbf-9327-b646346a308d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 09:31:27 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48e47c9-a1a2-41c2-b81c-0e1c191ab136]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe] added
Aug 26 09:31:27 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6442f0-c492-4dd5-80e4-729d65189342]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.041s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e15ef88-8be8-4921-abdf-e79abf104b90]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KdvmHnif {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KdvmHnif" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f585385-6f96-4e7c-ba04-1abad24556e2]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KdvmHnif'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9e7b32-063c-42ca-83d3-feabcbc15c90]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2292a85-4693-4d68-8ee2-48f182e7fc30]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 09:31:27 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 09:31:27 user nova-compute[73104]:  {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:31:27 user nova-compute[73104]: WARNING os_brick.initiator.connectors.iscsi [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 09:31:27 user nova-compute[73104]: 
Aug 26 09:31:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[df28169e-9c0f-4c9a-876b-c11117fc83d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe, portal: 172.16.0.220,3260]
Aug 26 09:31:27 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe, portal: 172.16.0.220,3260] successful.
Aug 26 09:31:27 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8349224-ec16-4a18-aaa9-5f6d7fad95d7]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[463c5818-198f-432a-86d0-331069834fdd]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe (non-flash)
Aug 26 09:31:27 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe (non-flash)
Aug 26 09:31:27 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c1591e-8b5a-4301-a6e5-755855b95c22]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:31:27 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 09:31:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:31:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:31:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:31:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:31:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:31:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:31:28 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 09:31:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KdvmHnif', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 09:31:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:31:28 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23837613066313863', 'path': '/dev/sdb'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:31:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837613066313863', 'path': '/dev/sdb'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 09:31:28 user nova-compute[73104]: DEBUG nova.objects.instance [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lazy-loading 'flavor' on Instance uuid cf7abefb-4f52-47f9-8710-7731fe1d1b95 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:31:28 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 09:31:28 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:31:28 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 09:31:28 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:31:28 user nova-compute[73104]:   <serial>a7ff2da9-4c01-4161-8202-32aa865c87fe</serial>
Aug 26 09:31:28 user nova-compute[73104]: </disk>
Aug 26 09:31:28 user nova-compute[73104]:  {{(pid=73104) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 09:31:29 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:31:29 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:31:29 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] No VIF found with MAC fa:16:3e:50:53:2c, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 09:31:29 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-b6a90928-1044-4c55-af99-c0896f207e29 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.116s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:31:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:31:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-dad0df91-1817-43b3-85e2-6858a0abe315 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Acquiring lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:31:31 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-dad0df91-1817-43b3-85e2-6858a0abe315 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:31:31 user nova-compute[73104]: INFO nova.compute.manager [None req-dad0df91-1817-43b3-85e2-6858a0abe315 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Detaching volume a7ff2da9-4c01-4161-8202-32aa865c87fe
Aug 26 09:31:31 user nova-compute[73104]: INFO nova.virt.block_device [None req-dad0df91-1817-43b3-85e2-6858a0abe315 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Attempting to driver detach volume a7ff2da9-4c01-4161-8202-32aa865c87fe from mountpoint /dev/vdb
Aug 26 09:31:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-dad0df91-1817-43b3-85e2-6858a0abe315 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Attempting to detach device vdb from instance cf7abefb-4f52-47f9-8710-7731fe1d1b95 from the persistent domain config. {{(pid=73104) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 09:31:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-dad0df91-1817-43b3-85e2-6858a0abe315 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 09:31:31 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:31:31 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 09:31:31 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:31:31 user nova-compute[73104]:   <serial>a7ff2da9-4c01-4161-8202-32aa865c87fe</serial>
Aug 26 09:31:31 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 09:31:31 user nova-compute[73104]: </disk>
Aug 26 09:31:31 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 09:31:31 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-dad0df91-1817-43b3-85e2-6858a0abe315 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Successfully detached device vdb from instance cf7abefb-4f52-47f9-8710-7731fe1d1b95 from the persistent domain config.
Aug 26 09:31:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-dad0df91-1817-43b3-85e2-6858a0abe315 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cf7abefb-4f52-47f9-8710-7731fe1d1b95 from the live domain config. {{(pid=73104) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 09:31:31 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-dad0df91-1817-43b3-85e2-6858a0abe315 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 09:31:31 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:31:31 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 09:31:31 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:31:31 user nova-compute[73104]:   <serial>a7ff2da9-4c01-4161-8202-32aa865c87fe</serial>
Aug 26 09:31:31 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 09:31:31 user nova-compute[73104]: </disk>
Aug 26 09:31:31 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Received event <DeviceRemovedEvent: 1693042292.2100792, cf7abefb-4f52-47f9-8710-7731fe1d1b95 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73104) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-dad0df91-1817-43b3-85e2-6858a0abe315 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cf7abefb-4f52-47f9-8710-7731fe1d1b95 {{(pid=73104) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 09:31:32 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-dad0df91-1817-43b3-85e2-6858a0abe315 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Successfully detached device vdb from instance cf7abefb-4f52-47f9-8710-7731fe1d1b95 from the live domain config.
Aug 26 09:31:32 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dad0df91-1817-43b3-85e2-6858a0abe315 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad0df91-1817-43b3-85e2-6858a0abe315 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KdvmHnif', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:31:32 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-dad0df91-1817-43b3-85e2-6858a0abe315 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:31:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-dad0df91-1817-43b3-85e2-6858a0abe315 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-dad0df91-1817-43b3-85e2-6858a0abe315 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad0df91-1817-43b3-85e2-6858a0abe315 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c5bc36-355e-4204-a773-ad5838857d83]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2b4068-9a50-4d92-9965-c79c48acfb2b]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad0df91-1817-43b3-85e2-6858a0abe315 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe (non-flash)
Aug 26 09:31:32 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad0df91-1817-43b3-85e2-6858a0abe315 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe (non-flash)
Aug 26 09:31:32 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad0df91-1817-43b3-85e2-6858a0abe315 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0c418c3a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe'): ({'sdb'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-dad0df91-1817-43b3-85e2-6858a0abe315 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Removing single pathed devices sdb {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b52c0b3-a824-4848-9d2a-4445c60f410b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b77a10-c38a-45a4-a304-ffa14a8a1bdd]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-dad0df91-1817-43b3-85e2-6858a0abe315 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Flushing IO for device /dev/sdb {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[385e9216-0202-44a4-bdaa-973960dfa892]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-dad0df91-1817-43b3-85e2-6858a0abe315 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9414da85-d0f8-4fa8-80d0-bc6b92cff1d3]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-dad0df91-1817-43b3-85e2-6858a0abe315 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-dad0df91-1817-43b3-85e2-6858a0abe315 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad0df91-1817-43b3-85e2-6858a0abe315 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[090a2886-d205-4333-bef9-43e41cccb08a]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad0df91-1817-43b3-85e2-6858a0abe315 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[c101fc85-e429-40bd-b057-909b458c1d1b]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad0df91-1817-43b3-85e2-6858a0abe315 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe, portal: 172.16.0.220,3260]
Aug 26 09:31:32 user nova-compute[73104]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe, portal: 172.16.0.220,3260] successful.
Aug 26 09:31:32 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7ff2da9-4c01-4161-8202-32aa865c87fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c4a25b-d716-4281-a358-91b322d4e1c1]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad0df91-1817-43b3-85e2-6858a0abe315 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-dad0df91-1817-43b3-85e2-6858a0abe315 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad0df91-1817-43b3-85e2-6858a0abe315 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] <== disconnect_volume: return (264ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:31:32 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dad0df91-1817-43b3-85e2-6858a0abe315 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 09:31:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:31:33 user nova-compute[73104]: DEBUG nova.objects.instance [None req-dad0df91-1817-43b3-85e2-6858a0abe315 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lazy-loading 'flavor' on Instance uuid cf7abefb-4f52-47f9-8710-7731fe1d1b95 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:31:33 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:31:33 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-dad0df91-1817-43b3-85e2-6858a0abe315 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.595s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:31:34 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:31:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:31:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:31:34 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:31:34 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:31:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:31:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:31:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:31:34 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:31:35 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:31:35 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:31:35 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8739MB free_disk=24.057777404785156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:31:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:31:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:31:35 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:31:35 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance cf7abefb-4f52-47f9-8710-7731fe1d1b95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:31:35 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:31:35 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:31:35 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:31:35 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:31:35 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:31:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.403s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:31:36 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:31:36 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:31:36 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:31:36 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Rebuilding the list of instances to heal {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 09:31:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-cf7abefb-4f52-47f9-8710-7731fe1d1b95" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:31:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-cf7abefb-4f52-47f9-8710-7731fe1d1b95" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:31:36 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 09:31:36 user nova-compute[73104]: DEBUG nova.objects.instance [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lazy-loading 'info_cache' on Instance uuid cf7abefb-4f52-47f9-8710-7731fe1d1b95 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:31:37 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Updating instance_info_cache with network_info: [{"id": "43ead9d3-4205-480c-bace-f8e91986bbf1", "address": "fa:16:3e:50:53:2c", "network": {"id": "83a42b92-0209-424b-90c3-cd30bc69ac18", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-322258755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b76e5ef4b1364dfd95283d46ddbf198d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ead9d3-42", "ovs_interfaceid": "43ead9d3-4205-480c-bace-f8e91986bbf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:31:37 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-cf7abefb-4f52-47f9-8710-7731fe1d1b95" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:31:37 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 09:31:37 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:31:37 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:31:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:31:40 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:31:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:31:44 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:31:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:31:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:31:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:31:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:31:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:31:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:31:51 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:31:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:31:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:31:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:31:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:31:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:31:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:31:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:32:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:32:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:32:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:32:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:32:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:32:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:32:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:32:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:32:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:32:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:32:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:32:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:32:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:32:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:32:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:32:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Acquiring lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:32:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:32:25 user nova-compute[73104]: DEBUG nova.objects.instance [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lazy-loading 'flavor' on Instance uuid cf7abefb-4f52-47f9-8710-7731fe1d1b95 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:32:25 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:32:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Acquiring lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:32:26 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:32:26 user nova-compute[73104]: INFO nova.compute.manager [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Attaching volume fd7557b0-fdbd-40cb-b096-3101a48e7c63 to /dev/vdb
Aug 26 09:32:26 user nova-compute[73104]: DEBUG os_brick.utils [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:32:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:32:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:32:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ef3807-ecb5-4be8-8970-81042bd717a5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25338395a1af\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:32:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:32:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:32:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc8a9b9-75fb-4633-bf2e-d4897bc29b90]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:32:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:32:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:32:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf635cc-0108-4985-ad7d-7ba6cfd682a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:32:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4f2c79-6f1d-48b0-8d53-72c25c5af2bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:32:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Running cmd (subprocess): nvme version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:32:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] 'nvme version' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:32:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.nvmeof [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] nvme not present on system {{(pid=73104) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 09:32:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:32:26 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 09:32:26 user nova-compute[73104]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 09:32:26 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[e265326f-b0dc-47aa-bd7f-2a790c0d5fc7]: (4, '') {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:32:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73104) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 09:32:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 09:32:26 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.lightos [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] LIGHTOS: no hostnqn found. {{(pid=73104) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 09:32:26 user nova-compute[73104]: DEBUG os_brick.utils [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25338395a1af', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:32:26 user nova-compute[73104]: DEBUG nova.virt.block_device [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Updating existing volume attachment record: 9cfe47be-38e8-4642-9abf-cc18e8f9e5ba {{(pid=73104) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 09:32:27 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:32:27 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:32:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:32:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:32:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:32:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:32:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:32:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:32:30 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:32:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:32:33 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:32:35 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:32:35 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:32:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:32:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:32:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:32:35 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:32:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:32:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:32:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:32:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:32:36 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:32:36 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:32:36 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8739MB free_disk=24.057022094726562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance cf7abefb-4f52-47f9-8710-7731fe1d1b95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Calling os-brick to attach iSCSI Volume {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SoXNnuVJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:32:36 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:32:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:32:36 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:32:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:32:36 user nova-compute[73104]: INFO os_brick.initiator.connectors.iscsi [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63 -p 172.16.0.220:3260 {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d9c49f-7823-4da6-8b91-5db784662d6c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 09:32:36 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63 -p 172.16.0.220:3260 --interface default --op new {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[212bb5d0-15bb-41aa-bac3-dae785c53de4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63] added\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63] added
Aug 26 09:32:36 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d46344-692c-466c-9533-ca862a29ecff]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aad0c1f-243b-46f6-93ee-f4d869a4a337]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SoXNnuVJ {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SoXNnuVJ" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd0eb44-66ba-47b3-a13b-0af004938d8a]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SoXNnuVJ'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ccc0cf-e304-4066-8da7-4865735ac4e4]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[97184b59-bf2a-4e46-9d8d-ff233d43eaaa]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 09:32:36 user nova-compute[73104]:  {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 09:32:36 user nova-compute[73104]:  {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:32:36 user nova-compute[73104]: WARNING os_brick.initiator.connectors.iscsi [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 09:32:36 user nova-compute[73104]: 
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63 -p 172.16.0.220:3260 --login {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[365f97d1-c931-4305-b77d-40e65e3711be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63, portal: 172.16.0.220,3260]
Aug 26 09:32:36 user nova-compute[73104]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63, portal: 172.16.0.220,3260] successful.
Aug 26 09:32:36 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[06552ca6-c6bc-4239-a06b-da88d674428e]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[47088ce9-b166-44f9-a4ad-59a87209f25b]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63 (non-flash)
Aug 26 09:32:36 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63 (non-flash)
Aug 26 09:32:36 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Connected to 172.16.0.220:3260 {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=73104) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73104) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8b000b-4c7a-41f3-aca2-8f90e762e4be]: (4, ('- - 0', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:32:36 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 09:32:37 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73104) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 09:32:37 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SoXNnuVJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73104) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 09:32:37 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:32:37 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23536366633326636', 'path': '/dev/sdb'} {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:32:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536366633326636', 'path': '/dev/sdb'} {{(pid=73104) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 09:32:37 user nova-compute[73104]: DEBUG nova.objects.instance [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lazy-loading 'flavor' on Instance uuid cf7abefb-4f52-47f9-8710-7731fe1d1b95 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:32:37 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 09:32:37 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:32:37 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 09:32:37 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:32:37 user nova-compute[73104]:   <serial>fd7557b0-fdbd-40cb-b096-3101a48e7c63</serial>
Aug 26 09:32:37 user nova-compute[73104]: </disk>
Aug 26 09:32:37 user nova-compute[73104]:  {{(pid=73104) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 09:32:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:32:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:32:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:32:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:32:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:32:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:32:38 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:32:38 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:32:38 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Rebuilding the list of instances to heal {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 09:32:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] No BDM found with device name vda, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:32:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73104) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 09:32:38 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] No VIF found with MAC fa:16:3e:50:53:2c, not building metadata {{(pid=73104) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 09:32:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-cf7abefb-4f52-47f9-8710-7731fe1d1b95" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:32:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-cf7abefb-4f52-47f9-8710-7731fe1d1b95" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:32:38 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 09:32:38 user nova-compute[73104]: DEBUG nova.objects.instance [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lazy-loading 'info_cache' on Instance uuid cf7abefb-4f52-47f9-8710-7731fe1d1b95 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:32:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-741f8169-4ca9-4a28-b993-d839b06229e8 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.446s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:32:38 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Updating instance_info_cache with network_info: [{"id": "43ead9d3-4205-480c-bace-f8e91986bbf1", "address": "fa:16:3e:50:53:2c", "network": {"id": "83a42b92-0209-424b-90c3-cd30bc69ac18", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-322258755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b76e5ef4b1364dfd95283d46ddbf198d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ead9d3-42", "ovs_interfaceid": "43ead9d3-4205-480c-bace-f8e91986bbf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:32:38 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-cf7abefb-4f52-47f9-8710-7731fe1d1b95" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:32:38 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 09:32:38 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:32:38 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:32:38 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:32:40 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:32:40 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:32:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d9b8293c-11dc-4be6-a52d-63d9bbb8b84c tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Acquiring lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:32:40 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d9b8293c-11dc-4be6-a52d-63d9bbb8b84c tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:32:40 user nova-compute[73104]: INFO nova.compute.manager [None req-d9b8293c-11dc-4be6-a52d-63d9bbb8b84c tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Detaching volume fd7557b0-fdbd-40cb-b096-3101a48e7c63
Aug 26 09:32:40 user nova-compute[73104]: INFO nova.virt.block_device [None req-d9b8293c-11dc-4be6-a52d-63d9bbb8b84c tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Attempting to driver detach volume fd7557b0-fdbd-40cb-b096-3101a48e7c63 from mountpoint /dev/vdb
Aug 26 09:32:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d9b8293c-11dc-4be6-a52d-63d9bbb8b84c tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Attempting to detach device vdb from instance cf7abefb-4f52-47f9-8710-7731fe1d1b95 from the persistent domain config. {{(pid=73104) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 09:32:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-d9b8293c-11dc-4be6-a52d-63d9bbb8b84c tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 09:32:40 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:32:40 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 09:32:40 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:32:40 user nova-compute[73104]:   <serial>fd7557b0-fdbd-40cb-b096-3101a48e7c63</serial>
Aug 26 09:32:40 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 09:32:40 user nova-compute[73104]: </disk>
Aug 26 09:32:40 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 09:32:40 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-d9b8293c-11dc-4be6-a52d-63d9bbb8b84c tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Successfully detached device vdb from instance cf7abefb-4f52-47f9-8710-7731fe1d1b95 from the persistent domain config.
Aug 26 09:32:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d9b8293c-11dc-4be6-a52d-63d9bbb8b84c tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cf7abefb-4f52-47f9-8710-7731fe1d1b95 from the live domain config. {{(pid=73104) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 09:32:40 user nova-compute[73104]: DEBUG nova.virt.libvirt.guest [None req-d9b8293c-11dc-4be6-a52d-63d9bbb8b84c tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 09:32:40 user nova-compute[73104]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 09:32:40 user nova-compute[73104]:   <source dev="/dev/sdb"/>
Aug 26 09:32:40 user nova-compute[73104]:   <target dev="vdb" bus="virtio"/>
Aug 26 09:32:40 user nova-compute[73104]:   <serial>fd7557b0-fdbd-40cb-b096-3101a48e7c63</serial>
Aug 26 09:32:40 user nova-compute[73104]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 09:32:40 user nova-compute[73104]: </disk>
Aug 26 09:32:40 user nova-compute[73104]:  {{(pid=73104) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-d9b8293c-11dc-4be6-a52d-63d9bbb8b84c tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cf7abefb-4f52-47f9-8710-7731fe1d1b95 {{(pid=73104) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG nova.virt.libvirt.driver [None req-684dab98-834c-4190-be86-52ac55fc1ac3 None None] Received event <DeviceRemovedEvent: 1693042361.1952279, cf7abefb-4f52-47f9-8710-7731fe1d1b95 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73104) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 09:32:41 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-d9b8293c-11dc-4be6-a52d-63d9bbb8b84c tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Successfully detached device vdb from instance cf7abefb-4f52-47f9-8710-7731fe1d1b95 from the live domain config.
Aug 26 09:32:41 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9b8293c-11dc-4be6-a52d-63d9bbb8b84c tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] calling os-brick to detach iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9b8293c-11dc-4be6-a52d-63d9bbb8b84c tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0c43ec460>, {'target_iqns': ['iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SoXNnuVJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 09:32:41 user nova-compute[73104]: WARNING os_brick.initiator.connectors.base [None req-d9b8293c-11dc-4be6-a52d-63d9bbb8b84c tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 09:32:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-d9b8293c-11dc-4be6-a52d-63d9bbb8b84c tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-d9b8293c-11dc-4be6-a52d-63d9bbb8b84c tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9b8293c-11dc-4be6-a52d-63d9bbb8b84c tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63', 0)] {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df3d40e-469e-4c7d-b2df-a1f9e9dca255]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a40868-f862-4ee7-b3a4-aa137665339c]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63 (non-flash)\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9b8293c-11dc-4be6-a52d-63d9bbb8b84c tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63 (non-flash)
Aug 26 09:32:41 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9b8293c-11dc-4be6-a52d-63d9bbb8b84c tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63 (non-flash)
Aug 26 09:32:41 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9b8293c-11dc-4be6-a52d-63d9bbb8b84c tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0c418eb00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63'): ({'sdb'}, set())}) {{(pid=73104) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-d9b8293c-11dc-4be6-a52d-63d9bbb8b84c tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Removing single pathed devices sdb {{(pid=73104) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c98a4f-e2c9-444e-84ad-4eb9992d82ce]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c738fe-5f5e-4797-a1dc-9d1efe043b2f]: (4, ('ok\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-d9b8293c-11dc-4be6-a52d-63d9bbb8b84c tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Flushing IO for device /dev/sdb {{(pid=73104) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6e7fa9-0f70-4a20-b2a9-6d55531e4210]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-d9b8293c-11dc-4be6-a52d-63d9bbb8b84c tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73104) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[316001e9-1328-40af-a406-fba1e47f26ac]: (4, ('1', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-d9b8293c-11dc-4be6-a52d-63d9bbb8b84c tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG os_brick.initiator.linuxscsi [None req-d9b8293c-11dc-4be6-a52d-63d9bbb8b84c tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] SCSI volumes sdb have been removed. {{(pid=73104) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9b8293c-11dc-4be6-a52d-63d9bbb8b84c tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63')] {{(pid=73104) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[27df8ba3-b2d2-4626-a4ca-c820b5c37d1e]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9b8293c-11dc-4be6-a52d-63d9bbb8b84c tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63 -p 172.16.0.220:3260 --logout {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63 -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bc4976-932e-40f7-8d77-a5ce77ed2179]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9b8293c-11dc-4be6-a52d-63d9bbb8b84c tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63, portal: 172.16.0.220,3260]
Aug 26 09:32:41 user nova-compute[73104]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63, portal: 172.16.0.220,3260] successful.
Aug 26 09:32:41 user nova-compute[73104]:  stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63 -p 172.16.0.220:3260 --op delete {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd7557b0-fdbd-40cb-b096-3101a48e7c63 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84263) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e0902c-3643-4dc9-b2ed-2729268f8a0c]: (4, ('', '')) {{(pid=84263) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9b8293c-11dc-4be6-a52d-63d9bbb8b84c tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73104) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.base [None req-d9b8293c-11dc-4be6-a52d-63d9bbb8b84c tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.255s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9b8293c-11dc-4be6-a52d-63d9bbb8b84c tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] <== disconnect_volume: return (256ms) None {{(pid=73104) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 09:32:41 user nova-compute[73104]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9b8293c-11dc-4be6-a52d-63d9bbb8b84c tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Disconnected iSCSI Volume {{(pid=73104) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 09:32:42 user nova-compute[73104]: DEBUG nova.objects.instance [None req-d9b8293c-11dc-4be6-a52d-63d9bbb8b84c tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lazy-loading 'flavor' on Instance uuid cf7abefb-4f52-47f9-8710-7731fe1d1b95 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:32:42 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-d9b8293c-11dc-4be6-a52d-63d9bbb8b84c tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.623s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:32:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:32:44 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:32:45 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:32:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:32:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:32:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:32:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:32:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:32:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:32:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:32:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:32:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:32:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:32:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:32:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:32:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:32:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:33:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:33:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:33:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:33:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:33:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:33:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:33:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:33:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:33:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:33:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:33:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:33:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:33:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:33:18 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:33:19 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:33:23 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:33:28 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:33:29 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:33:29 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:33:31 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:33:31 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73104) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 09:33:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:33:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:33:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:33:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:33:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:33:33 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:33:34 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:33:35 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:33:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:33:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:33:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:33:35 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:33:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:33:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:33:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk --force-share --output=json {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 09:33:35 user nova-compute[73104]: DEBUG oslo_concurrency.processutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 09:33:36 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:33:36 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:33:36 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8755MB free_disk=24.05611801147461GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:33:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:33:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:33:36 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Instance cf7abefb-4f52-47f9-8710-7731fe1d1b95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73104) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 09:33:36 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:33:36 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:33:36 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Refreshing inventories for resource provider 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 09:33:36 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Updating ProviderTree inventory for provider 8a2a2397-4d47-4524-8146-84db4225a812 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 09:33:36 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Updating inventory in ProviderTree for provider 8a2a2397-4d47-4524-8146-84db4225a812 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 09:33:36 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Refreshing aggregate associations for resource provider 8a2a2397-4d47-4524-8146-84db4225a812, aggregates: None {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 09:33:36 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Refreshing trait associations for resource provider 8a2a2397-4d47-4524-8146-84db4225a812, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS {{(pid=73104) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 09:33:36 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:33:36 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:33:36 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:33:36 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.268s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:33:37 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:33:38 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:33:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:33:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:33:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:33:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:33:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:33:38 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:33:39 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:33:39 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:33:39 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Rebuilding the list of instances to heal {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 09:33:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "refresh_cache-cf7abefb-4f52-47f9-8710-7731fe1d1b95" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 09:33:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquired lock "refresh_cache-cf7abefb-4f52-47f9-8710-7731fe1d1b95" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 09:33:39 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Forcefully refreshing network info cache for instance {{(pid=73104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 09:33:39 user nova-compute[73104]: DEBUG nova.objects.instance [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lazy-loading 'info_cache' on Instance uuid cf7abefb-4f52-47f9-8710-7731fe1d1b95 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:33:39 user nova-compute[73104]: DEBUG nova.network.neutron [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Updating instance_info_cache with network_info: [{"id": "43ead9d3-4205-480c-bace-f8e91986bbf1", "address": "fa:16:3e:50:53:2c", "network": {"id": "83a42b92-0209-424b-90c3-cd30bc69ac18", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-322258755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b76e5ef4b1364dfd95283d46ddbf198d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ead9d3-42", "ovs_interfaceid": "43ead9d3-4205-480c-bace-f8e91986bbf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:33:39 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Releasing lock "refresh_cache-cf7abefb-4f52-47f9-8710-7731fe1d1b95" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 09:33:39 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Updated the network info_cache for instance {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 09:33:40 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:33:41 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:33:43 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:33:46 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:33:47 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:33:47 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Cleaning up deleted instances {{(pid=73104) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 09:33:47 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] There are 0 instances to clean {{(pid=73104) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 09:33:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:33:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:33:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:33:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:33:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:33:48 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:33:52 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:33:52 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Triggering sync for uuid cf7abefb-4f52-47f9-8710-7731fe1d1b95 {{(pid=73104) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 09:33:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:33:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:33:52 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:33:53 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:33:54 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:33:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:33:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:33:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:33:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:33:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:33:58 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:34:02 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:34:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:34:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:34:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:34:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:34:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:34:03 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:34:08 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:34:13 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:34:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-66a5aeb5-c2f9-4704-a67c-a6eabae5bd27 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Acquiring lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:34:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-66a5aeb5-c2f9-4704-a67c-a6eabae5bd27 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:34:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-66a5aeb5-c2f9-4704-a67c-a6eabae5bd27 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Acquiring lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:34:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-66a5aeb5-c2f9-4704-a67c-a6eabae5bd27 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:34:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-66a5aeb5-c2f9-4704-a67c-a6eabae5bd27 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:34:17 user nova-compute[73104]: INFO nova.compute.manager [None req-66a5aeb5-c2f9-4704-a67c-a6eabae5bd27 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Terminating instance
Aug 26 09:34:17 user nova-compute[73104]: DEBUG nova.compute.manager [None req-66a5aeb5-c2f9-4704-a67c-a6eabae5bd27 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Start destroying the instance on the hypervisor. {{(pid=73104) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 09:34:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:34:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:34:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:34:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:34:17 user nova-compute[73104]: DEBUG nova.compute.manager [req-995072b1-06b7-4c30-a2f9-bb72b91d0ad3 req-0c8f322a-16bc-442c-84d1-ff3c9caa98e5 service nova] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Received event network-vif-unplugged-43ead9d3-4205-480c-bace-f8e91986bbf1 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:34:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-995072b1-06b7-4c30-a2f9-bb72b91d0ad3 req-0c8f322a-16bc-442c-84d1-ff3c9caa98e5 service nova] Acquiring lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:34:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-995072b1-06b7-4c30-a2f9-bb72b91d0ad3 req-0c8f322a-16bc-442c-84d1-ff3c9caa98e5 service nova] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:34:17 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-995072b1-06b7-4c30-a2f9-bb72b91d0ad3 req-0c8f322a-16bc-442c-84d1-ff3c9caa98e5 service nova] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:34:17 user nova-compute[73104]: DEBUG nova.compute.manager [req-995072b1-06b7-4c30-a2f9-bb72b91d0ad3 req-0c8f322a-16bc-442c-84d1-ff3c9caa98e5 service nova] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] No waiting events found dispatching network-vif-unplugged-43ead9d3-4205-480c-bace-f8e91986bbf1 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:34:17 user nova-compute[73104]: DEBUG nova.compute.manager [req-995072b1-06b7-4c30-a2f9-bb72b91d0ad3 req-0c8f322a-16bc-442c-84d1-ff3c9caa98e5 service nova] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Received event network-vif-unplugged-43ead9d3-4205-480c-bace-f8e91986bbf1 for instance with task_state deleting. {{(pid=73104) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 09:34:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:34:17 user nova-compute[73104]: INFO nova.virt.libvirt.driver [-] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Instance destroyed successfully.
Aug 26 09:34:17 user nova-compute[73104]: DEBUG nova.objects.instance [None req-66a5aeb5-c2f9-4704-a67c-a6eabae5bd27 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lazy-loading 'resources' on Instance uuid cf7abefb-4f52-47f9-8710-7731fe1d1b95 {{(pid=73104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 09:34:17 user nova-compute[73104]: DEBUG nova.virt.libvirt.vif [None req-66a5aeb5-c2f9-4704-a67c-a6eabae5bd27 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T09:26:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1509733539',display_name='tempest-SnapshotDataIntegrityTests-server-1509733539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1509733539',id=53,image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0OEsvdAlnlIyrF3na+qaFLlUa3PzoOF0PZ+CWi7hZ9NjA/Ay/NfXpKk1sOQ9Ik0ZbpROvxb6p8J0smgtBicDgnLkUEMUp6IHGoX3icnTx116+R+K8zgYZNdbeNGWBqDA==',key_name='tempest-keypair-468890120',keypairs=<?>,launch_index=0,launched_at=2023-08-26T09:26:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b76e5ef4b1364dfd95283d46ddbf198d',ramdisk_id='',reservation_id='r-75g8xqep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e28116ef-1f27-40e2-be41-f8cc5c10ee86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-756955482',owner_user_name='tempest-SnapshotDataIntegrityTests-756955482-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T09:26:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52a9f5bf03d1463488bdc3c4222297ce',uuid=cf7abefb-4f52-47f9-8710-7731fe1d1b95,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43ead9d3-4205-480c-bace-f8e91986bbf1", "address": "fa:16:3e:50:53:2c", "network": {"id": "83a42b92-0209-424b-90c3-cd30bc69ac18", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-322258755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b76e5ef4b1364dfd95283d46ddbf198d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ead9d3-42", "ovs_interfaceid": "43ead9d3-4205-480c-bace-f8e91986bbf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 09:34:17 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-66a5aeb5-c2f9-4704-a67c-a6eabae5bd27 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Converting VIF {"id": "43ead9d3-4205-480c-bace-f8e91986bbf1", "address": "fa:16:3e:50:53:2c", "network": {"id": "83a42b92-0209-424b-90c3-cd30bc69ac18", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-322258755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b76e5ef4b1364dfd95283d46ddbf198d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ead9d3-42", "ovs_interfaceid": "43ead9d3-4205-480c-bace-f8e91986bbf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 09:34:17 user nova-compute[73104]: DEBUG nova.network.os_vif_util [None req-66a5aeb5-c2f9-4704-a67c-a6eabae5bd27 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:53:2c,bridge_name='br-int',has_traffic_filtering=True,id=43ead9d3-4205-480c-bace-f8e91986bbf1,network=Network(83a42b92-0209-424b-90c3-cd30bc69ac18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43ead9d3-42') {{(pid=73104) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 09:34:17 user nova-compute[73104]: DEBUG os_vif [None req-66a5aeb5-c2f9-4704-a67c-a6eabae5bd27 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:53:2c,bridge_name='br-int',has_traffic_filtering=True,id=43ead9d3-4205-480c-bace-f8e91986bbf1,network=Network(83a42b92-0209-424b-90c3-cd30bc69ac18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43ead9d3-42') {{(pid=73104) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 09:34:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:34:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43ead9d3-42, bridge=br-int, if_exists=True) {{(pid=73104) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 09:34:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:34:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:34:17 user nova-compute[73104]: INFO os_vif [None req-66a5aeb5-c2f9-4704-a67c-a6eabae5bd27 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:53:2c,bridge_name='br-int',has_traffic_filtering=True,id=43ead9d3-4205-480c-bace-f8e91986bbf1,network=Network(83a42b92-0209-424b-90c3-cd30bc69ac18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43ead9d3-42')
Aug 26 09:34:17 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-66a5aeb5-c2f9-4704-a67c-a6eabae5bd27 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Deleting instance files /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95_del
Aug 26 09:34:17 user nova-compute[73104]: INFO nova.virt.libvirt.driver [None req-66a5aeb5-c2f9-4704-a67c-a6eabae5bd27 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Deletion of /opt/stack/data/nova/instances/cf7abefb-4f52-47f9-8710-7731fe1d1b95_del complete
Aug 26 09:34:17 user nova-compute[73104]: INFO nova.compute.manager [None req-66a5aeb5-c2f9-4704-a67c-a6eabae5bd27 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 26 09:34:17 user nova-compute[73104]: DEBUG oslo.service.loopingcall [None req-66a5aeb5-c2f9-4704-a67c-a6eabae5bd27 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73104) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 09:34:17 user nova-compute[73104]: DEBUG nova.compute.manager [-] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Deallocating network for instance {{(pid=73104) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 09:34:17 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] deallocate_for_instance() {{(pid=73104) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 09:34:19 user nova-compute[73104]: DEBUG nova.network.neutron [-] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Updating instance_info_cache with network_info: [] {{(pid=73104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 09:34:19 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Took 1.64 seconds to deallocate network for instance.
Aug 26 09:34:19 user nova-compute[73104]: DEBUG nova.compute.manager [req-978eee4b-f3a8-4873-8169-ace23f509578 req-125b7b22-fa5e-4229-a684-2af07073a1fe service nova] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Received event network-vif-plugged-43ead9d3-4205-480c-bace-f8e91986bbf1 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:34:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-978eee4b-f3a8-4873-8169-ace23f509578 req-125b7b22-fa5e-4229-a684-2af07073a1fe service nova] Acquiring lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:34:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-978eee4b-f3a8-4873-8169-ace23f509578 req-125b7b22-fa5e-4229-a684-2af07073a1fe service nova] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:34:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [req-978eee4b-f3a8-4873-8169-ace23f509578 req-125b7b22-fa5e-4229-a684-2af07073a1fe service nova] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:34:19 user nova-compute[73104]: DEBUG nova.compute.manager [req-978eee4b-f3a8-4873-8169-ace23f509578 req-125b7b22-fa5e-4229-a684-2af07073a1fe service nova] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] No waiting events found dispatching network-vif-plugged-43ead9d3-4205-480c-bace-f8e91986bbf1 {{(pid=73104) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 09:34:19 user nova-compute[73104]: WARNING nova.compute.manager [req-978eee4b-f3a8-4873-8169-ace23f509578 req-125b7b22-fa5e-4229-a684-2af07073a1fe service nova] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Received unexpected event network-vif-plugged-43ead9d3-4205-480c-bace-f8e91986bbf1 for instance with vm_state active and task_state deleting.
Aug 26 09:34:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-66a5aeb5-c2f9-4704-a67c-a6eabae5bd27 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:34:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-66a5aeb5-c2f9-4704-a67c-a6eabae5bd27 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:34:19 user nova-compute[73104]: DEBUG nova.compute.manager [req-53402823-8526-404e-8b05-87f07f0e76db req-65a38700-3914-403a-89a3-f939e43c4e78 service nova] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Received event network-vif-deleted-43ead9d3-4205-480c-bace-f8e91986bbf1 {{(pid=73104) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 09:34:19 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-66a5aeb5-c2f9-4704-a67c-a6eabae5bd27 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:34:19 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-66a5aeb5-c2f9-4704-a67c-a6eabae5bd27 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:34:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-66a5aeb5-c2f9-4704-a67c-a6eabae5bd27 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.141s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:34:19 user nova-compute[73104]: INFO nova.scheduler.client.report [None req-66a5aeb5-c2f9-4704-a67c-a6eabae5bd27 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Deleted allocations for instance cf7abefb-4f52-47f9-8710-7731fe1d1b95
Aug 26 09:34:19 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-66a5aeb5-c2f9-4704-a67c-a6eabae5bd27 tempest-SnapshotDataIntegrityTests-756955482 tempest-SnapshotDataIntegrityTests-756955482-project-member] Lock "cf7abefb-4f52-47f9-8710-7731fe1d1b95" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.850s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:34:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:34:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:34:31 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:34:31 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:34:32 user nova-compute[73104]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693042457.7818394, cf7abefb-4f52-47f9-8710-7731fe1d1b95 => Stopped> {{(pid=73104) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 09:34:32 user nova-compute[73104]: INFO nova.compute.manager [-] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] VM Stopped (Lifecycle Event)
Aug 26 09:34:32 user nova-compute[73104]: DEBUG nova.compute.manager [None req-3110767e-7a99-4152-8404-1078d840810a None None] [instance: cf7abefb-4f52-47f9-8710-7731fe1d1b95] Checking state {{(pid=73104) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 09:34:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:34:35 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:34:35 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:34:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:34:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:34:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:34:35 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:34:35 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:34:35 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:34:35 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8889MB free_disk=24.08319854736328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:34:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:34:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:34:35 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:34:35 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:34:35 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:34:35 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:34:35 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:34:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:34:36 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:34:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:34:39 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:34:39 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Starting heal instance info cache {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 09:34:39 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Rebuilding the list of instances to heal {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 09:34:39 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Didn't find any instances for network info cache update. {{(pid=73104) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 09:34:40 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:34:41 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:34:41 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:34:42 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:34:47 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:34:48 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:34:52 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:34:57 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:35:02 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:35:07 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:35:10 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:35:11 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:35:12 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:35:14 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:35:17 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:35:22 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:35:27 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:35:32 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:35:33 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:35:33 user nova-compute[73104]: DEBUG nova.compute.manager [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73104) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 09:35:35 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:35:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:35:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:35:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:35:35 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73104) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 09:35:35 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:35:35 user nova-compute[73104]: WARNING nova.virt.libvirt.driver [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 09:35:35 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Hypervisor/Node resource view: name=user free_ram=8998MB free_disk=24.04891586303711GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73104) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 09:35:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 09:35:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 09:35:35 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 09:35:35 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73104) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 09:35:35 user nova-compute[73104]: DEBUG nova.compute.provider_tree [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed in ProviderTree for provider: 8a2a2397-4d47-4524-8146-84db4225a812 {{(pid=73104) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 09:35:35 user nova-compute[73104]: DEBUG nova.scheduler.client.report [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Inventory has not changed for provider 8a2a2397-4d47-4524-8146-84db4225a812 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73104) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 09:35:35 user nova-compute[73104]: DEBUG nova.compute.resource_tracker [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Compute_service record updated for user:user {{(pid=73104) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 09:35:35 user nova-compute[73104]: DEBUG oslo_concurrency.lockutils [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=73104) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 09:35:36 user nova-compute[73104]: DEBUG oslo_service.periodic_task [None req-12cd289a-f169-4256-bf48-ba6ad313ffa9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 09:35:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 09:35:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 09:35:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73104) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 09:35:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:35:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73104) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 09:35:37 user nova-compute[73104]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73104) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}